Jul 16 23:11:55 devstack cinder-volume[76527]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 16 23:11:55 devstack cinder-volume[76527]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 16 23:11:55 devstack cinder-volume[76527]: we strongly recommend against using it for new projects. Jul 16 23:11:55 devstack cinder-volume[76527]: If you are already using Eventlet, we recommend migrating to a different Jul 16 23:11:55 devstack cinder-volume[76527]: framework. For more detail see Jul 16 23:11:55 devstack cinder-volume[76527]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 16 23:11:55 devstack cinder-volume[76527]: import eventlet # noqa Jul 16 23:11:58 devstack cinder-volume[76527]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76527) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 16 23:11:58 devstack cinder-volume[76527]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76527) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 16 23:11:58 devstack cinder-volume[76527]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76527) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 16 23:11:59 devstack cinder-volume[76527]: INFO dbcounter [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] Registered counter for database cinder Jul 16 23:11:59 devstack cinder-volume[76527]: DEBUG oslo_db.sqlalchemy.engines [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76527) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG dbcounter [-] [76527] Writer thread running {{(pid=76527) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 16 23:12:00 devstack cinder-volume[76527]: INFO cinder.rpc [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 16 23:12:00 devstack cinder-volume[76527]: INFO cinder.rpc [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_db.sqlalchemy.engines [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76527) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 16 23:12:00 devstack cinder-volume[76527]: INFO cinder.volume.manager [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] Determined volume DB was empty at startup. Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG cinder.volume.manager [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76527) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 16 23:12:00 devstack cinder-volume[76527]: INFO cinder.volume.manager [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 16 23:12:00 devstack cinder-volume[76527]: WARNING stevedore.named [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 16 23:12:00 devstack cinder-volume[76527]: WARNING castellan.key_manager [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 16 23:12:00 devstack cinder-volume[76527]: WARNING cinder.keymgr.conf_key_mgr [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG cinder.volume.drivers.lvm [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76527) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_concurrency.processutils [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76527) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_concurrency.processutils [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] CMD "cinder-rtstool verify" returned: 0 in 0.427s {{(pid=76527) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_db.sqlalchemy.engines [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76527) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 16 23:12:00 devstack cinder-volume[76527]: INFO cinder.rpc [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 16 23:12:00 devstack cinder-volume[76527]: INFO cinder.rpc [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 16 23:12:00 devstack cinder-volume[76527]: WARNING stevedore.named [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 16 23:12:00 devstack cinder-volume[76527]: WARNING castellan.key_manager [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 16 23:12:00 devstack cinder-volume[76527]: INFO cinder.volume.manager [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_db.sqlalchemy.engines [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76527) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 16 23:12:00 devstack cinder-volume[76527]: INFO oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] Starting 1 workers Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] Started child 76683 {{(pid=76527) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] Full set of CONF: {{(pid=76527) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] ******************************************************************************** {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] Configuration options gathered from: {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] ================================================================================ {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] allow_availability_zone_fallback = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] allow_compression_on_image_upload = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76683]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] allowed_direct_url_schemes = [] {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] api_rate_limit = True {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] auth_strategy = keystone {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] az_cache_duration = 3600 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_availability_zone = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_host = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_name = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_stats_polling_interval = 60 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backup_api_class = cinder.backup.api.API {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backup_name_template = backup-%s {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backup_use_same_host = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backup_use_temp_snapshot = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] chap_password = **** {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] chap_username = {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cinder_internal_tenant_project_id = 2392824f4e5145c5bc5974cafbb5eee7 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cinder_internal_tenant_user_id = a7a55d9c0fb34c47b614c47905227c41 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cloned_volume_same_az = True {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cluster = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] compression_format = gzip {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] compute_api_class = cinder.compute.nova.API {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] config_dir = [] {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] config_source = [] {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] control_exchange = openstack {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] debug = True {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] default_availability_zone = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] default_group_type = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] default_volume_type = lvmdriver-1 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] disk_geometry = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] driver_client_cert = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] driver_client_cert_key = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] driver_data_namespace = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] driver_ssl_cert_path = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] driver_ssl_cert_verify = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] driver_use_ssl = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] enable_force_upload = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] enable_new_services = True {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] enable_unsupported_driver = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] enforce_multipath_for_image_xfer = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] filter_function = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] glance_api_insecure = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] glance_api_servers = ['http://192.168.122.154/image'] {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] glance_api_ssl_compression = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] glance_ca_certificates_file = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:00 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] glance_catalog_info = image:glance:publicURL {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] glance_certfile = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] glance_keyfile = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] glance_num_retries = 3 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] glance_request_timeout = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] goodness_function = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] graceful_shutdown_timeout = 5 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] group_api_class = cinder.group.api.API {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] host = devstack {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] image_compress_on_upload = True {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] image_conversion_address_space_limit = 1 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] image_conversion_cpu_limit = 60 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] image_conversion_disable = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] image_upload_use_cinder_backend = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] image_upload_use_internal_tenant = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] image_volume_cache_enabled = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] image_volume_cache_max_count = 0 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] image_volume_cache_max_size_gb = 0 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] init_host_max_objects_retrieval = 0 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] instance_format = [instance: %(uuid)s] {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] iscsi_target_flags = {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] iscsi_write_cache = on {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] iser_helper = tgtadm {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] iser_ip_address = 192.168.122.154 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] iser_port = 3260 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] log_color = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] log_config_append = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] log_dir = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] log_file = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] log_options = True {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] log_rotate_interval = 1 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] log_rotate_interval_type = days {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] log_rotation_type = none {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] max_age = 0 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] max_logfile_count = 30 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] max_logfile_size_mb = 200 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] max_over_subscription_ratio = 20.0 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] message_reap_interval = 86400 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] message_ttl = 2592000 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] migration_create_volume_timeout_secs = 300 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] monkey_patch = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] monkey_patch_modules = [] {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] my_ip = 192.168.122.154 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] no_snapshot_gb_quota = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] num_iser_scan_tries = 3 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] num_shell_tries = 3 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] num_volume_device_scan_tries = 3 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] nvmeof_conn_info_version = 1 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] nvmet_ns_id = 10 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] nvmet_port_id = 1 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] osapi_max_limit = 1000 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] osapi_volume_ext_list = [] {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] osapi_volume_listen_port = 8776 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] osapi_volume_use_ssl = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] osapi_volume_workers = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] per_volume_size_limit = -1 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] periodic_fuzzy_delay = 60 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] periodic_interval = 60 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] public_endpoint = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] publish_errors = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] quota_backup_gigabytes = 1000 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] quota_backups = 10 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] quota_gigabytes = 1000 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] quota_groups = 10 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] quota_snapshots = 10 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] quota_volumes = 10 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] rate_limit_burst = 0 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] rate_limit_except_level = CRITICAL {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] rate_limit_interval = 0 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] reinit_driver_count = 3 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] replication_device = **** {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] report_discard_supported = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] report_interval = 120 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] reservation_clean_interval = 86400 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] reservation_expire = 86400 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] reserved_image_namespaces = [] {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] reserved_percentage = 0 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] rpc_response_timeout = 120 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] run_external_periodic_tasks = True {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] scst_target_driver = iscsi {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] scst_target_iqn_name = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] service_down_time = 720 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] shell_completion = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] snapshot_name_template = snapshot-%s {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] snapshot_same_host = True {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] split_loggers = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] state_path = /opt/stack/data/cinder {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] storage_availability_zone = nova {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] storage_protocol = iSCSI {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] syslog_log_facility = LOG_USER {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] target_helper = lioadm {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] target_ip_address = 192.168.122.154 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] target_port = 3260 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] target_protocol = iscsi {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] target_secondary_ip_addresses = [] {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] trace_flags = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] transport_url = **** {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] until_refresh = 0 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] use_chap_auth = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] use_default_quota_class = True {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] use_journal = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] use_json = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] use_multipath_for_image_xfer = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] use_stderr = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] use_syslog = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] verify_glance_signatures = enabled {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] volume_api_class = cinder.volume.api.API {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] volume_backend_name = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] volume_clear = zero {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] volume_clear_ionice = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] volume_clear_size = 0 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] volume_copy_bps_limit = 0 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] volume_dd_blocksize = 1M {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] volume_name_template = volume-%s {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] volume_service_inithost_offload = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] volume_usage_audit_period = month {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] zoning_mode = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_concurrency.disable_process_locking = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] keystone_authtoken.auth_section = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] keystone_authtoken.auth_type = password {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] keystone_authtoken.auth_version = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] keystone_authtoken.cache = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] keystone_authtoken.certfile = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] keystone_authtoken.include_service_catalog = True {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] keystone_authtoken.insecure = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] keystone_authtoken.interface = public {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] keystone_authtoken.keyfile = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] keystone_authtoken.memcache_password = {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76683]: INFO cinder.volume.manager [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] keystone_authtoken.memcache_username = {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] keystone_authtoken.region_name = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] keystone_authtoken.service_type = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.154/identity {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cache.backend = dogpile.cache.null {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cache.backend_argument = **** {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cache.backend_expiration_time = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cache.config_prefix = cache.oslo {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cache.debug_cache_backend = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cache.enable_retry_client = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cache.enable_socket_keepalive = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cache.enabled = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cache.expiration_time = 600 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cache.hashclient_retry_attempts = 2 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cache.memcache_dead_retry = 300 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cache.memcache_pool_maxsize = 10 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cache.memcache_sasl_enabled = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cache.password = **** {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cache.proxies = [] {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cache.redis_db = 0 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cache.redis_server = localhost:6379 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cache.retry_attempts = 2 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cache.retry_delay = 0.0 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cache.socket_keepalive_count = 1 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cache.socket_keepalive_idle = 1 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cache.socket_keepalive_interval = 1 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cache.socket_timeout = 1.0 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cache.tls_allowed_ciphers = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cache.tls_cafile = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cache.tls_certfile = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cache.tls_enabled = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cache.tls_keyfile = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cache.username = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] coordination.backend_url = **** {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] database.asyncio_connection = **** {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] database.asyncio_slave_connection = **** {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] database.backend = sqlalchemy {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] database.connection = **** {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] database.connection_debug = 0 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] database.connection_parameters = {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] database.connection_recycle_time = 3600 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] database.connection_trace = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] database.db_inc_retry_interval = True {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] database.db_max_retries = 20 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] database.db_max_retry_interval = 10 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] database.db_retry_interval = 1 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] database.max_overflow = 50 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] database.max_pool_size = 5 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] database.max_retries = 10 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] database.mysql_wsrep_sync_wait = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] database.pool_timeout = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] database.retry_interval = 10 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] database.slave_connection = **** {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] database.sqlite_synchronous = True {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] database.synchronous_reader = True {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] database.use_db_reconnect = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] profiler.connection_string = messaging:// {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] profiler.enabled = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] profiler.es_doc_type = notification {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] profiler.es_scroll_size = 10000 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] profiler.es_scroll_time = 2m {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] profiler.filter_error_trace = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] profiler.hmac_keys = **** {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] profiler.sentinel_service_name = mymaster {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] profiler.socket_timeout = 0.1 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] profiler.trace_requests = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] profiler.trace_sqlalchemy = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] profiler_jaeger.process_tags = {} {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] profiler_jaeger.service_name_prefix = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] profiler_otlp.service_name_prefix = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_policy.enforce_new_defaults = True {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_policy.enforce_scope = True {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_policy.policy_default_rule = default {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_policy.policy_file = policy.yaml {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] privsep_osbrick.group = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] privsep_osbrick.helper_command = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] privsep_osbrick.user = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cinder_sys_admin.group = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cinder_sys_admin.helper_command = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] cinder_sys_admin.user = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] service_user.auth_section = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] service_user.auth_type = password {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] service_user.cafile = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] service_user.certfile = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] service_user.collect_timing = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] service_user.insecure = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] service_user.keyfile = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] service_user.send_service_user_token = True {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] service_user.split_loggers = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] service_user.timeout = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] glance.auth_section = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] glance.auth_type = password {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] glance.certfile = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] glance.collect_timing = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] glance.insecure = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] glance.keyfile = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] glance.region_name = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] glance.split_loggers = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] glance.timeout = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.backend_availability_zone = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.chap_password = **** {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.chap_username = {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.disk_geometry = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.driver_client_cert = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.driver_client_cert_key = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.driver_data_namespace = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.075s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.driver_use_ssl = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.extra_capabilities = {} {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.filter_function = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.goodness_function = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.iscsi_target_flags = {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.iscsi_write_cache = on {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.iser_helper = tgtadm {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.iser_ip_address = 192.168.122.154 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.iser_port = 3260 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.lvm_share_target = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.lvm_type = auto {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.num_shell_tries = 3 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.replication_device = **** {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.report_discard_supported = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.reserved_percentage = 0 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.target_helper = tgtadm {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.target_ip_address = 192.168.122.154 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.target_port = 3260 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.target_protocol = iscsi {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.trace_flags = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.unique_fqdn_network = True {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.use_chap_auth = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.volume_backend_name = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.volume_clear = zero {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.volume_clear_ionice = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.volume_clear_size = 0 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_reports.file_event_handler = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_reports.log_dir = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.backend_host = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.chap_password = **** {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.chap_username = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.disk_geometry = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.driver_client_cert = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.extra_capabilities = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.filter_function = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.goodness_function = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.iser_helper = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.iser_ip_address = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.iser_port = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.lvm_share_target = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.lvm_type = auto {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.num_shell_tries = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.replication_device = **** {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.report_discard_supported = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.reserved_percentage = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.scst_target_driver = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.storage_protocol = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.target_helper = lioadm {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.target_ip_address = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.target_port = 3260 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.trace_flags = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.use_chap_auth = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.volume_clear = zero {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.volume_clear_size = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.061s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] lvmdriver-1.volumes_dir = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_rabbit.ssl = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_notifications.driver = [] {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_notifications.retry = -1 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] key_manager.fixed_key = **** {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] barbican.barbican_api_version = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] barbican.barbican_endpoint = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] barbican.barbican_endpoint_type = public {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] barbican.barbican_region_name = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] barbican.cafile = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack sudo[76698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] barbican.certfile = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] barbican.collect_timing = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] barbican.insecure = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] barbican.keyfile = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] barbican.number_of_retries = 60 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] barbican.retry_delay = 1 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] barbican.send_service_user_token = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack sudo[76698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:12:01 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] barbican.split_loggers = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] barbican.timeout = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] barbican.verify_ssl = True {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] barbican.verify_ssl_path = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] barbican_service_user.auth_section = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] barbican_service_user.auth_type = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] barbican_service_user.cafile = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] barbican_service_user.certfile = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] barbican_service_user.collect_timing = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] barbican_service_user.insecure = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] barbican_service_user.keyfile = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] barbican_service_user.split_loggers = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] barbican_service_user.timeout = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] vault.approle_role_id = **** {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] vault.approle_secret_id = **** {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] vault.auth_method = approle {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] vault.auth_path = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] vault.kv_mountpoint = secret {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] vault.kv_path = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] vault.kv_version = 2 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] vault.namespace = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] vault.root_token_id = **** {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] vault.ssl_ca_crt_file = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] vault.timeout = 60.0 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] vault.token_file = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] vault.token_role = None {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] vault.use_ssl = False {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:12:01 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] ******************************************************************************** {{(pid=76527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 16 23:12:01 devstack sudo[76698]: pam_unix(sudo:session): session closed for user root Jul 16 23:12:01 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.345s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:12:01 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:12:01 devstack sudo[76858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 16 23:12:01 devstack sudo[76858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:12:01 devstack sudo[76858]: pam_unix(sudo:session): session closed for user root Jul 16 23:12:01 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.258s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:12:01 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 23:12:01 devstack cinder-volume[76683]: INFO cinder.brick.local_dev.lvm [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 16 23:12:01 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:12:01 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:12:01 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:12:01 devstack sudo[76948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 16 23:12:01 devstack sudo[76948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:12:02 devstack sudo[76948]: pam_unix(sudo:session): session closed for user root Jul 16 23:12:02 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:12:02 devstack cinder-volume[76683]: DEBUG cinder.brick.local_dev.lvm [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76683) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 16 23:12:02 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:12:02 devstack sudo[77052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 16 23:12:02 devstack sudo[77052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:12:02 devstack sudo[77052]: pam_unix(sudo:session): session closed for user root Jul 16 23:12:02 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.491s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:12:02 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:12:02 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:12:02 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:12:02 devstack sudo[77233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 16 23:12:02 devstack sudo[77233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:12:02 devstack sudo[77233]: pam_unix(sudo:session): session closed for user root Jul 16 23:12:02 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.334s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:12:02 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:12:03 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:12:03 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:12:03 devstack sudo[77296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 16 23:12:03 devstack sudo[77296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:12:03 devstack sudo[77296]: pam_unix(sudo:session): session closed for user root Jul 16 23:12:03 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.265s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:12:03 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:12:03 devstack sudo[77338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 16 23:12:03 devstack sudo[77338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:12:03 devstack sudo[77338]: pam_unix(sudo:session): session closed for user root Jul 16 23:12:03 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:12:03 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:12:03 devstack sudo[77382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 16 23:12:03 devstack sudo[77382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:12:03 devstack sudo[77382]: pam_unix(sudo:session): session closed for user root Jul 16 23:12:03 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:12:03 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:12:03 devstack sudo[77391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 16 23:12:03 devstack sudo[77391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:12:04 devstack sudo[77391]: pam_unix(sudo:session): session closed for user root Jul 16 23:12:04 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.319s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:12:04 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:12:04 devstack sudo[77474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 16 23:12:04 devstack sudo[77474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:12:04 devstack sudo[77474]: pam_unix(sudo:session): session closed for user root Jul 16 23:12:04 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:12:04 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:12:04 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:12:04 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:12:04 devstack sudo[77478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 16 23:12:04 devstack sudo[77478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:12:04 devstack sudo[77478]: pam_unix(sudo:session): session closed for user root Jul 16 23:12:04 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:12:04 devstack cinder-volume[76683]: INFO cinder.volume.drivers.lvm [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 16 23:12:04 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:12:04 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:12:04 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:12:04 devstack sudo[77488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 16 23:12:04 devstack sudo[77488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:12:05 devstack sudo[77488]: pam_unix(sudo:session): session closed for user root Jul 16 23:12:05 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:12:05 devstack cinder-volume[76683]: DEBUG cinder.volume.drivers.lvm [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Updating volume stats {{(pid=76683) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 16 23:12:05 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:12:05 devstack sudo[77491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 16 23:12:05 devstack sudo[77491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:12:05 devstack sudo[77491]: pam_unix(sudo:session): session closed for user root Jul 16 23:12:05 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:12:05 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:12:05 devstack sudo[77494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 16 23:12:05 devstack sudo[77494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:12:05 devstack sudo[77494]: pam_unix(sudo:session): session closed for user root Jul 16 23:12:05 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:12:05 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:12:05 devstack sudo[77497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 16 23:12:05 devstack sudo[77497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:12:05 devstack sudo[77497]: pam_unix(sudo:session): session closed for user root Jul 16 23:12:05 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:12:05 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:12:05 devstack sudo[77500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 16 23:12:05 devstack sudo[77500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:12:06 devstack sudo[77500]: pam_unix(sudo:session): session closed for user root Jul 16 23:12:06 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:12:06 devstack cinder-volume[76683]: INFO cinder.volume.driver [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Driver hasn't implemented _init_vendor_properties() Jul 16 23:12:06 devstack cinder-volume[76683]: DEBUG cinder.volume.driver [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76683) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 16 23:12:06 devstack cinder-volume[76683]: DEBUG oslo_db.sqlalchemy.engines [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76683) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 16 23:12:06 devstack cinder-volume[76683]: DEBUG dbcounter [-] [76683] Writer thread running {{(pid=76683) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 16 23:12:06 devstack cinder-volume[76683]: DEBUG cinder.db.api [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Building query based on filter {{(pid=76683) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 16 23:12:06 devstack cinder-volume[76683]: DEBUG cinder.image.image_utils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76683) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 16 23:12:06 devstack cinder-volume[76683]: INFO cinder.keymgr.migration [None req-20a3234d-c97d-434a-a781-31f8375ee11a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 16 23:12:06 devstack cinder-volume[76683]: DEBUG cinder.volume.drivers.lvm [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Updating volume stats {{(pid=76683) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 16 23:12:06 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:12:06 devstack sudo[77505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 16 23:12:06 devstack sudo[77505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:12:06 devstack sudo[77505]: pam_unix(sudo:session): session closed for user root Jul 16 23:12:06 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:12:06 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:12:06 devstack sudo[77508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 16 23:12:06 devstack sudo[77508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:12:06 devstack sudo[77508]: pam_unix(sudo:session): session closed for user root Jul 16 23:12:06 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:12:06 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:12:06 devstack sudo[77512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 16 23:12:06 devstack sudo[77512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:12:07 devstack sudo[77512]: pam_unix(sudo:session): session closed for user root Jul 16 23:12:07 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:12:07 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:12:07 devstack sudo[77516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 16 23:12:07 devstack sudo[77516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:12:07 devstack sudo[77516]: pam_unix(sudo:session): session closed for user root Jul 16 23:12:07 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:12:07 devstack cinder-volume[76683]: DEBUG cinder.manager [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Notifying Schedulers of capabilities ... {{(pid=76683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:12:07 devstack cinder-volume[76683]: INFO cinder.volume.manager [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Driver initialization completed successfully. Jul 16 23:12:07 devstack cinder-volume[76683]: INFO cinder.manager [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Initiating service 2 cleanup Jul 16 23:12:07 devstack cinder-volume[76683]: INFO cinder.manager [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Service 2 cleanup completed. Jul 16 23:12:07 devstack cinder-volume[76683]: DEBUG cinder.service [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Creating RPC server for service cinder-volume {{(pid=76683) start /opt/stack/cinder/cinder/service.py:231}} Jul 16 23:12:07 devstack cinder-volume[76683]: DEBUG cinder.service [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76683) start /opt/stack/cinder/cinder/service.py:237}} Jul 16 23:12:07 devstack cinder-volume[76683]: INFO cinder.volume.manager [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 16 23:12:07 devstack cinder-volume[76683]: DEBUG cinder.volume.drivers.lvm [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Updating volume stats {{(pid=76683) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 16 23:12:07 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:12:07 devstack sudo[77520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 16 23:12:07 devstack sudo[77520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:12:07 devstack sudo[77520]: pam_unix(sudo:session): session closed for user root Jul 16 23:12:07 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:12:07 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:12:07 devstack sudo[77523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 16 23:12:07 devstack sudo[77523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:12:08 devstack sudo[77523]: pam_unix(sudo:session): session closed for user root Jul 16 23:12:08 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:12:08 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:12:08 devstack sudo[77527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 16 23:12:08 devstack sudo[77527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:12:08 devstack sudo[77527]: pam_unix(sudo:session): session closed for user root Jul 16 23:12:08 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:12:08 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:12:08 devstack sudo[77533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 16 23:12:08 devstack sudo[77533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:12:08 devstack sudo[77533]: pam_unix(sudo:session): session closed for user root Jul 16 23:12:08 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:12:08 devstack cinder-volume[76683]: INFO cinder.volume.manager [None req-2821b070-81de-4b06-a566-c9a8146ddd96 None None] Driver post RPC initialization completed successfully. Jul 16 23:12:10 devstack cinder-volume[76527]: DEBUG dbcounter [-] [76527] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76527) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:12:18 devstack cinder-volume[76683]: DEBUG dbcounter [-] [76683] Writing DB stats cinder:SELECT=3 {{(pid=76683) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:12:18 devstack cinder-volume[76683]: DEBUG dbcounter [-] [76683] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76683) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:12:27 devstack cinder-volume[76683]: DEBUG oslo_service.periodic_task [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] Running periodic task VolumeManager._thread_info {{(pid=76683) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:12:27 devstack cinder-volume[76683]: DEBUG cinder.volume.manager [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] thread count: 6 {{(pid=76683) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 23:12:27 devstack cinder-volume[76683]: DEBUG cinder.volume.manager [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] thread info: [<_MainThread(MainThread, started 128777136115840)>, , , , , ] {{(pid=76683) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 23:13:27 devstack cinder-volume[76683]: DEBUG oslo_service.periodic_task [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76683) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:13:27 devstack cinder-volume[76683]: DEBUG cinder.volume.drivers.lvm [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] Updating volume stats {{(pid=76683) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 16 23:13:27 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:13:27 devstack sudo[80166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 16 23:13:27 devstack sudo[80166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:13:27 devstack sudo[80166]: pam_unix(sudo:session): session closed for user root Jul 16 23:13:27 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:13:27 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:13:27 devstack sudo[80169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 16 23:13:27 devstack sudo[80169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:13:28 devstack sudo[80169]: pam_unix(sudo:session): session closed for user root Jul 16 23:13:28 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:13:28 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:13:28 devstack sudo[80173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 16 23:13:28 devstack sudo[80173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:13:28 devstack sudo[80173]: pam_unix(sudo:session): session closed for user root Jul 16 23:13:28 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.244s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:13:28 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:13:28 devstack sudo[80176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 16 23:13:28 devstack sudo[80176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:13:28 devstack sudo[80176]: pam_unix(sudo:session): session closed for user root Jul 16 23:13:28 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:13:28 devstack cinder-volume[76683]: DEBUG cinder.manager [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] Notifying Schedulers of capabilities ... {{(pid=76683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:13:28 devstack cinder-volume[76683]: DEBUG oslo_service.periodic_task [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] Running periodic task VolumeManager._thread_info {{(pid=76683) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:13:28 devstack cinder-volume[76683]: DEBUG cinder.volume.manager [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] thread count: 6 {{(pid=76683) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 23:13:28 devstack cinder-volume[76683]: DEBUG cinder.volume.manager [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] thread info: [<_MainThread(MainThread, started 128777136115840)>, , , , , ] {{(pid=76683) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 23:14:18 devstack cinder-volume[76683]: DEBUG dbcounter [-] [76683] Writing DB stats cinder:SELECT=1 {{(pid=76683) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:14:18 devstack cinder-volume[76683]: DEBUG dbcounter [-] [76683] Writing DB stats cinder:UPDATE=1 {{(pid=76683) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:14:27 devstack cinder-volume[76683]: DEBUG oslo_service.periodic_task [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76683) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:14:27 devstack cinder-volume[76683]: DEBUG cinder.volume.drivers.lvm [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] Updating volume stats {{(pid=76683) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 16 23:14:27 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:14:27 devstack sudo[83186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 16 23:14:27 devstack sudo[83186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:14:27 devstack sudo[83186]: pam_unix(sudo:session): session closed for user root Jul 16 23:14:27 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:14:27 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:14:27 devstack sudo[83189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 16 23:14:27 devstack sudo[83189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:14:28 devstack sudo[83189]: pam_unix(sudo:session): session closed for user root Jul 16 23:14:28 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:14:28 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:14:28 devstack sudo[83193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 16 23:14:28 devstack sudo[83193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:14:28 devstack sudo[83193]: pam_unix(sudo:session): session closed for user root Jul 16 23:14:28 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:14:28 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:14:28 devstack sudo[83196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 16 23:14:28 devstack sudo[83196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:14:28 devstack sudo[83196]: pam_unix(sudo:session): session closed for user root Jul 16 23:14:28 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.237s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:14:28 devstack cinder-volume[76683]: DEBUG cinder.manager [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] Notifying Schedulers of capabilities ... {{(pid=76683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:15:27 devstack cinder-volume[76683]: DEBUG oslo_service.periodic_task [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76683) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:15:27 devstack cinder-volume[76683]: DEBUG cinder.volume.drivers.lvm [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] Updating volume stats {{(pid=76683) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 16 23:15:27 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:15:27 devstack sudo[85422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 16 23:15:27 devstack sudo[85422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:15:27 devstack sudo[85422]: pam_unix(sudo:session): session closed for user root Jul 16 23:15:27 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:15:27 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:15:27 devstack sudo[85425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 16 23:15:27 devstack sudo[85425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:15:28 devstack sudo[85425]: pam_unix(sudo:session): session closed for user root Jul 16 23:15:28 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:15:28 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:15:28 devstack sudo[85440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 16 23:15:28 devstack sudo[85440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:15:28 devstack sudo[85440]: pam_unix(sudo:session): session closed for user root Jul 16 23:15:28 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.235s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:15:28 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:15:28 devstack sudo[85443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 16 23:15:28 devstack sudo[85443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:15:28 devstack sudo[85443]: pam_unix(sudo:session): session closed for user root Jul 16 23:15:28 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:15:28 devstack cinder-volume[76683]: DEBUG cinder.manager [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] Notifying Schedulers of capabilities ... {{(pid=76683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:15:28 devstack cinder-volume[76683]: DEBUG oslo_service.periodic_task [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] Running periodic task VolumeManager._thread_info {{(pid=76683) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:15:28 devstack cinder-volume[76683]: DEBUG cinder.volume.manager [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] thread count: 6 {{(pid=76683) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 23:15:28 devstack cinder-volume[76683]: DEBUG cinder.volume.manager [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] thread info: [<_MainThread(MainThread, started 128777136115840)>, , , , , ] {{(pid=76683) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 23:16:18 devstack cinder-volume[76683]: DEBUG dbcounter [-] [76683] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76683) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:16:27 devstack cinder-volume[76683]: DEBUG oslo_service.periodic_task [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76683) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:16:27 devstack cinder-volume[76683]: DEBUG cinder.volume.drivers.lvm [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] Updating volume stats {{(pid=76683) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 16 23:16:27 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:16:27 devstack sudo[86777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 16 23:16:27 devstack sudo[86777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:16:27 devstack cinder-volume[76527]: INFO oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] Caught SIGTERM, stopping children Jul 16 23:16:27 devstack cinder-volume[76527]: DEBUG oslo_concurrency.lockutils [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] Acquiring lock "singleton_lock" {{(pid=76527) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 16 23:16:27 devstack cinder-volume[76527]: DEBUG oslo_concurrency.lockutils [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] Acquired lock "singleton_lock" {{(pid=76527) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 16 23:16:27 devstack cinder-volume[76527]: DEBUG oslo_concurrency.lockutils [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] Releasing lock "singleton_lock" {{(pid=76527) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 16 23:16:27 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] Stop services. {{(pid=76527) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 16 23:16:27 devstack cinder-volume[76527]: DEBUG oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] Killing children. {{(pid=76527) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 16 23:16:27 devstack cinder-volume[76527]: INFO oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] Waiting on 1 children to exit Jul 16 23:16:27 devstack sudo[86777]: pam_unix(sudo:session): session closed for user root Jul 16 23:16:27 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:16:27 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:16:27 devstack sudo[86782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 16 23:16:27 devstack sudo[86782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:16:28 devstack sudo[86782]: pam_unix(sudo:session): session closed for user root Jul 16 23:16:28 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:16:28 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:16:28 devstack sudo[86786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 16 23:16:28 devstack sudo[86786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:16:28 devstack sudo[86786]: pam_unix(sudo:session): session closed for user root Jul 16 23:16:28 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.242s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:16:28 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:16:28 devstack sudo[86789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 16 23:16:28 devstack sudo[86789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:16:28 devstack sudo[86789]: pam_unix(sudo:session): session closed for user root Jul 16 23:16:28 devstack cinder-volume[76683]: DEBUG oslo_concurrency.processutils [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=76683) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:16:28 devstack cinder-volume[76683]: DEBUG cinder.manager [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] Notifying Schedulers of capabilities ... {{(pid=76683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:16:28 devstack cinder-volume[76683]: DEBUG oslo_service.periodic_task [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] Running periodic task VolumeManager._thread_info {{(pid=76683) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:16:28 devstack cinder-volume[76683]: DEBUG cinder.volume.manager [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] thread count: 6 {{(pid=76683) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 23:16:28 devstack cinder-volume[76683]: DEBUG cinder.volume.manager [None req-68f949ab-26d6-4b4d-830c-04f8e7c64a59 None None] thread info: [<_MainThread(MainThread, started 128777136115840)>, , , , , ] {{(pid=76683) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 23:16:32 devstack cinder-volume[76683]: DEBUG oslo_concurrency.lockutils [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] Acquiring lock "singleton_lock" {{(pid=76683) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 16 23:16:32 devstack cinder-volume[76683]: DEBUG oslo_concurrency.lockutils [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] Acquired lock "singleton_lock" {{(pid=76683) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 16 23:16:32 devstack cinder-volume[76683]: DEBUG oslo_concurrency.lockutils [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] Releasing lock "singleton_lock" {{(pid=76683) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 16 23:16:32 devstack cinder-volume[76683]: WARNING amqp [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 16 23:16:32 devstack cinder-volume[76683]: WARNING amqp [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 16 23:16:32 devstack cinder-volume[76527]: INFO oslo_service.backend._eventlet.service [None req-8298bc43-dc45-41ac-afaa-df28fb193704 None None] Child 76683 exited with status 0 Jul 16 23:16:32 devstack cinder-volume[86793]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 16 23:16:32 devstack cinder-volume[86793]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 16 23:16:32 devstack cinder-volume[86793]: we strongly recommend against using it for new projects. Jul 16 23:16:32 devstack cinder-volume[86793]: If you are already using Eventlet, we recommend migrating to a different Jul 16 23:16:32 devstack cinder-volume[86793]: framework. For more detail see Jul 16 23:16:32 devstack cinder-volume[86793]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 16 23:16:32 devstack cinder-volume[86793]: import eventlet # noqa Jul 16 23:16:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86793) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 16 23:16:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86793) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 16 23:16:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86793) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 16 23:16:35 devstack cinder-volume[86793]: INFO dbcounter [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] Registered counter for database cinder Jul 16 23:16:35 devstack cinder-volume[86793]: DEBUG oslo_db.sqlalchemy.engines [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86793) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 16 23:16:35 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writer thread running {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 16 23:16:35 devstack cinder-volume[86793]: INFO cinder.rpc [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 16 23:16:35 devstack cinder-volume[86793]: INFO cinder.rpc [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_db.sqlalchemy.engines [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86793) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 16 23:16:36 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] Determined volume DB was empty at startup. Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86793) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 16 23:16:36 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 16 23:16:36 devstack cinder-volume[86793]: WARNING stevedore.named [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 16 23:16:36 devstack cinder-volume[86793]: WARNING castellan.key_manager [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 16 23:16:36 devstack cinder-volume[86793]: WARNING cinder.keymgr.conf_key_mgr [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 16 23:16:36 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_db.sqlalchemy.engines [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86793) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 16 23:16:36 devstack cinder-volume[86793]: INFO oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] Starting 1 workers Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] Started child 87006 {{(pid=86793) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] Full set of CONF: {{(pid=86793) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] ******************************************************************************** {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] Configuration options gathered from: {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] ================================================================================ {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] allow_availability_zone_fallback = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] allow_compression_on_image_upload = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] allowed_direct_url_schemes = [] {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] api_rate_limit = True {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] auth_strategy = keystone {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[87006]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_availability_zone = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_host = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_name = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_stats_polling_interval = 60 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backup_api_class = cinder.backup.api.API {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backup_name_template = backup-%s {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backup_use_same_host = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backup_use_temp_snapshot = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] chap_password = **** {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] chap_username = {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cinder_internal_tenant_project_id = 2392824f4e5145c5bc5974cafbb5eee7 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cinder_internal_tenant_user_id = a7a55d9c0fb34c47b614c47905227c41 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cluster = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] compression_format = gzip {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] compute_api_class = cinder.compute.nova.API {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] config_dir = [] {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] config_source = [] {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] control_exchange = openstack {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] debug = True {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] default_availability_zone = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] default_group_type = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] default_volume_type = QuobyteHD {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] disk_geometry = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] driver_client_cert = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] driver_client_cert_key = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] driver_data_namespace = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] driver_ssl_cert_path = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] driver_ssl_cert_verify = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] driver_use_ssl = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] enable_new_services = True {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] enable_unsupported_driver = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] enabled_backends = ['QuobyteHD'] {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] enforce_multipath_for_image_xfer = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] filter_function = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] glance_api_insecure = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] glance_api_servers = ['http://192.168.122.154/image'] {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] glance_api_ssl_compression = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] glance_ca_certificates_file = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] glance_catalog_info = image:glance:publicURL {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] glance_certfile = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] glance_keyfile = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] glance_num_retries = 3 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] glance_request_timeout = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] goodness_function = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] graceful_shutdown_timeout = 5 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] group_api_class = cinder.group.api.API {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] host = devstack {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] image_compress_on_upload = True {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] image_conversion_address_space_limit = 1 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] image_conversion_cpu_limit = 60 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] image_conversion_disable = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] image_upload_use_cinder_backend = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] image_upload_use_internal_tenant = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] image_volume_cache_enabled = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] image_volume_cache_max_count = 0 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] image_volume_cache_max_size_gb = 0 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] init_host_max_objects_retrieval = 0 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] instance_format = [instance: %(uuid)s] {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] iscsi_target_flags = {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] iscsi_write_cache = on {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] iser_helper = tgtadm {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] iser_ip_address = 192.168.122.154 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] iser_port = 3260 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] log_color = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[87006]: INFO cinder.volume.manager [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] Starting volume driver QuobyteDriver (1.2) Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] log_config_append = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[87006]: DEBUG cinder.volume.drivers.remotefs [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87006) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] log_dir = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] log_file = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] log_options = True {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] log_rotate_interval = 1 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] log_rotate_interval_type = days {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] log_rotation_type = none {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] max_age = 0 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] max_logfile_count = 30 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] max_logfile_size_mb = 200 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] max_over_subscription_ratio = 20.0 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] message_reap_interval = 86400 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] message_ttl = 2592000 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] migration_create_volume_timeout_secs = 300 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] monkey_patch = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] monkey_patch_modules = [] {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] my_ip = 192.168.122.154 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] no_snapshot_gb_quota = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] num_iser_scan_tries = 3 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] num_shell_tries = 3 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] num_volume_device_scan_tries = 3 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] nvmeof_conn_info_version = 1 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] nvmet_ns_id = 10 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] nvmet_port_id = 1 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] osapi_max_limit = 1000 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] osapi_volume_ext_list = [] {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] osapi_volume_listen_port = 8776 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] osapi_volume_use_ssl = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] osapi_volume_workers = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] per_volume_size_limit = -1 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] periodic_fuzzy_delay = 60 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] periodic_interval = 60 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] public_endpoint = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] publish_errors = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] quota_backup_gigabytes = 1000 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] quota_backups = 10 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] quota_gigabytes = 1000 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] quota_groups = 10 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] quota_snapshots = 10 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] quota_volumes = 10 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] rate_limit_burst = 0 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] rate_limit_except_level = CRITICAL {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] rate_limit_interval = 0 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] reinit_driver_count = 3 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] replication_device = **** {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] report_discard_supported = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] report_interval = 120 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] reservation_clean_interval = 86400 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] reservation_expire = 86400 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] reserved_image_namespaces = [] {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] reserved_percentage = 0 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] rpc_response_timeout = 120 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] run_external_periodic_tasks = True {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] scst_target_driver = iscsi {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] scst_target_iqn_name = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] service_down_time = 720 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] shell_completion = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] snapshot_name_template = snapshot-%s {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] split_loggers = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] state_path = /opt/stack/data/cinder {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] storage_availability_zone = nova {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] storage_protocol = iSCSI {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] syslog_log_facility = LOG_USER {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] target_helper = lioadm {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] target_ip_address = 192.168.122.154 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] target_port = 3260 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] target_protocol = iscsi {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] target_secondary_ip_addresses = [] {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] trace_flags = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] transport_url = **** {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] until_refresh = 0 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] use_chap_auth = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] use_default_quota_class = True {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] use_journal = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] use_json = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] use_multipath_for_image_xfer = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] use_stderr = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] use_syslog = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] verify_glance_signatures = enabled {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] volume_api_class = cinder.volume.api.API {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] volume_backend_name = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] volume_clear = zero {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] volume_clear_ionice = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] volume_clear_size = 0 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] volume_copy_bps_limit = 0 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] volume_dd_blocksize = 1M {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] volume_name_template = volume-%s {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] volume_service_inithost_offload = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] volume_usage_audit_period = month {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] zoning_mode = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_concurrency.disable_process_locking = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] keystone_authtoken.auth_section = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] keystone_authtoken.auth_type = password {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] keystone_authtoken.auth_version = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] keystone_authtoken.cache = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] keystone_authtoken.certfile = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] keystone_authtoken.include_service_catalog = True {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] keystone_authtoken.insecure = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] keystone_authtoken.interface = public {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] keystone_authtoken.keyfile = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] keystone_authtoken.memcache_password = {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] keystone_authtoken.memcache_username = {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] keystone_authtoken.region_name = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] keystone_authtoken.service_type = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.154/identity {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cache.backend = dogpile.cache.null {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cache.backend_argument = **** {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cache.backend_expiration_time = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cache.config_prefix = cache.oslo {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cache.debug_cache_backend = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cache.enable_retry_client = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cache.enable_socket_keepalive = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cache.enabled = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cache.expiration_time = 600 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cache.hashclient_retry_attempts = 2 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cache.memcache_dead_retry = 300 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cache.memcache_pool_maxsize = 10 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cache.memcache_sasl_enabled = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cache.password = **** {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cache.proxies = [] {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cache.redis_db = 0 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cache.redis_server = localhost:6379 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cache.retry_attempts = 2 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cache.retry_delay = 0.0 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cache.socket_keepalive_count = 1 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cache.socket_keepalive_idle = 1 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cache.socket_keepalive_interval = 1 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cache.socket_timeout = 1.0 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cache.tls_allowed_ciphers = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cache.tls_cafile = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cache.tls_certfile = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cache.tls_enabled = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cache.tls_keyfile = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cache.username = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] coordination.backend_url = **** {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] database.asyncio_connection = **** {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] database.asyncio_slave_connection = **** {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] database.backend = sqlalchemy {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] database.connection = **** {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] database.connection_debug = 0 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] database.connection_parameters = {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] database.connection_recycle_time = 3600 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] database.connection_trace = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] database.db_inc_retry_interval = True {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] database.db_max_retries = 20 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] database.db_max_retry_interval = 10 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] database.db_retry_interval = 1 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] database.max_overflow = 50 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] database.max_pool_size = 5 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] database.max_retries = 10 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[87006]: DEBUG cinder.volume.drivers.quobyte [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87006) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[87006]: WARNING cinder.volume.drivers.quobyte [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] database.mysql_wsrep_sync_wait = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] database.pool_timeout = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[87006]: WARNING cinder.volume.drivers.quobyte [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] database.retry_interval = 10 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] database.slave_connection = **** {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[87006]: DEBUG oslo_concurrency.processutils [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] Running cmd (subprocess): mount.quobyte {{(pid=87006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] database.sqlite_synchronous = True {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] database.synchronous_reader = True {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] database.use_db_reconnect = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] profiler.connection_string = messaging:// {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] profiler.enabled = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] profiler.es_doc_type = notification {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] profiler.es_scroll_size = 10000 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] profiler.es_scroll_time = 2m {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] profiler.filter_error_trace = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] profiler.hmac_keys = **** {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] profiler.sentinel_service_name = mymaster {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] profiler.socket_timeout = 0.1 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] profiler.trace_requests = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] profiler.trace_sqlalchemy = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] profiler_jaeger.process_tags = {} {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] profiler_jaeger.service_name_prefix = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] profiler_otlp.service_name_prefix = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_policy.enforce_new_defaults = True {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_policy.enforce_scope = True {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_policy.policy_default_rule = default {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_policy.policy_file = policy.yaml {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] privsep_osbrick.group = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] privsep_osbrick.helper_command = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] privsep_osbrick.user = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cinder_sys_admin.group = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cinder_sys_admin.helper_command = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] cinder_sys_admin.user = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] service_user.auth_section = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] service_user.auth_type = password {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] service_user.cafile = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] service_user.certfile = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] service_user.collect_timing = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] service_user.insecure = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] service_user.keyfile = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] service_user.send_service_user_token = True {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] service_user.split_loggers = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] service_user.timeout = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] glance.auth_section = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] glance.auth_type = password {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] glance.certfile = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] glance.collect_timing = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] glance.insecure = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] glance.keyfile = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] glance.region_name = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] glance.split_loggers = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] glance.timeout = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.backend_availability_zone = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.chap_password = **** {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.chap_username = {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.disk_geometry = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.driver_client_cert = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.driver_client_cert_key = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.driver_data_namespace = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.driver_use_ssl = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.extra_capabilities = {} {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.filter_function = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.goodness_function = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.iscsi_target_flags = {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.iscsi_write_cache = on {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.iser_helper = tgtadm {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.iser_ip_address = 192.168.122.154 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.iser_port = 3260 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.nas_host = {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.nas_login = admin {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.nas_mount_options = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.nas_password = **** {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.nas_private_key = {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.nas_share_path = {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.num_shell_tries = 3 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.quobyte_volume_url = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.replication_device = **** {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.report_discard_supported = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.reserved_percentage = 0 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.target_helper = tgtadm {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.target_ip_address = 192.168.122.154 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.target_port = 3260 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.target_protocol = iscsi {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.trace_flags = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.unique_fqdn_network = True {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.use_chap_auth = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.volume_backend_name = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.volume_clear = zero {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.volume_clear_ionice = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.volume_clear_size = 0 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_reports.file_event_handler = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_reports.log_dir = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.backend_availability_zone = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.backend_host = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.chap_password = **** {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.chap_username = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.chiscsi_conf = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.disk_geometry = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.driver_client_cert = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.driver_data_namespace = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.driver_use_ssl = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.extra_capabilities = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.filter_function = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.goodness_function = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.iser_helper = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.iser_ip_address = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.iser_port = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.iser_target_prefix = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.nas_host = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.nas_login = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.nas_mount_options = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.nas_password = **** {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.nas_private_key = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.nas_share_path = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.nas_ssh_port = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.num_shell_tries = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.nvmet_port_id = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.replication_device = **** {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.report_discard_supported = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.reserved_percentage = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.scst_target_driver = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.storage_protocol = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.target_helper = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.target_ip_address = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.target_port = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.target_prefix = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.target_protocol = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.trace_flags = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.use_chap_auth = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.volume_clear = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.volume_clear_size = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] QuobyteHD.volumes_dir = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_rabbit.ssl = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_notifications.driver = [] {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_notifications.retry = -1 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] key_manager.fixed_key = **** {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] barbican.barbican_api_version = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] barbican.barbican_endpoint = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] barbican.barbican_endpoint_type = public {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] barbican.barbican_region_name = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] barbican.cafile = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] barbican.certfile = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] barbican.collect_timing = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] barbican.insecure = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] barbican.keyfile = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] barbican.number_of_retries = 60 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] barbican.retry_delay = 1 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] barbican.send_service_user_token = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] barbican.split_loggers = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] barbican.timeout = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] barbican.verify_ssl = True {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] barbican.verify_ssl_path = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] barbican_service_user.auth_section = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] barbican_service_user.auth_type = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] barbican_service_user.cafile = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] barbican_service_user.certfile = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] barbican_service_user.collect_timing = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] barbican_service_user.insecure = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] barbican_service_user.keyfile = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] barbican_service_user.split_loggers = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] barbican_service_user.timeout = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] vault.approle_role_id = **** {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack quobyte-client[87010]: Reading configuration file: /etc/quobyte/client.cfg Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] vault.approle_secret_id = **** {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] vault.auth_method = approle {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] vault.auth_path = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] vault.kv_mountpoint = secret {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] vault.kv_path = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] vault.kv_version = 2 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] vault.namespace = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack quobyte-client[87010]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] vault.root_token_id = **** {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] vault.ssl_ca_crt_file = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[87006]: DEBUG oslo_concurrency.processutils [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] CMD "mount.quobyte" returned: 1 in 0.126s {{(pid=87006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] vault.timeout = 60.0 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] vault.token_file = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] vault.token_role = None {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] vault.use_ssl = False {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:36 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] ******************************************************************************** {{(pid=86793) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 16 23:16:36 devstack cinder-volume[87006]: DEBUG oslo_concurrency.lockutils [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87006) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:16:36 devstack cinder-volume[87006]: DEBUG oslo_concurrency.lockutils [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87006) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:16:36 devstack cinder-volume[87006]: DEBUG cinder.volume.drivers.quobyte [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87006) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:16:36 devstack cinder-volume[87006]: INFO cinder.volume.drivers.quobyte [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 ... Jul 16 23:16:36 devstack cinder-volume[87006]: DEBUG oslo_concurrency.processutils [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 -c /etc/quobyte/client-cinder.cfg {{(pid=87006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:16:36 devstack sudo[87012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 -c /etc/quobyte/client-cinder.cfg Jul 16 23:16:36 devstack sudo[87012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:16:37 devstack sudo[87012]: pam_unix(sudo:session): session closed for user root Jul 16 23:16:37 devstack cinder-volume[87006]: DEBUG oslo_concurrency.processutils [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.418s {{(pid=87006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:16:37 devstack cinder-volume[87006]: INFO cinder.volume.drivers.quobyte [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 succeeded Jul 16 23:16:37 devstack cinder-volume[87006]: DEBUG cinder.volume.drivers.quobyte [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87006) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:16:37 devstack cinder-volume[87006]: DEBUG oslo_concurrency.lockutils [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.433s {{(pid=87006) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:16:37 devstack cinder-volume[87006]: DEBUG oslo_concurrency.processutils [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:16:37 devstack sudo[87081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:16:37 devstack sudo[87081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:16:37 devstack sudo[87081]: pam_unix(sudo:session): session closed for user root Jul 16 23:16:37 devstack cinder-volume[87006]: DEBUG oslo_concurrency.processutils [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.248s {{(pid=87006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:16:37 devstack cinder-volume[87006]: INFO cinder.volume.driver [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] Driver hasn't implemented _init_vendor_properties() Jul 16 23:16:37 devstack cinder-volume[87006]: DEBUG cinder.volume.driver [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87006) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 16 23:16:37 devstack cinder-volume[87006]: DEBUG oslo_db.sqlalchemy.engines [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87006) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 16 23:16:37 devstack cinder-volume[87006]: DEBUG dbcounter [-] [87006] Writer thread running {{(pid=87006) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 16 23:16:37 devstack cinder-volume[87006]: DEBUG cinder.db.api [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] Building query based on filter {{(pid=87006) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 16 23:16:37 devstack cinder-volume[87006]: DEBUG cinder.image.image_utils [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87006) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 16 23:16:37 devstack cinder-volume[87006]: INFO cinder.keymgr.migration [None req-897cf3e7-89f5-4072-9c81-4a0d66e63134 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 16 23:16:37 devstack cinder-volume[87006]: DEBUG oslo_concurrency.lockutils [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87006) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:16:37 devstack cinder-volume[87006]: DEBUG oslo_concurrency.lockutils [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87006) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:16:37 devstack cinder-volume[87006]: DEBUG cinder.volume.drivers.quobyte [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87006) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:16:37 devstack cinder-volume[87006]: DEBUG cinder.volume.drivers.quobyte [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87006) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:16:37 devstack cinder-volume[87006]: DEBUG oslo_concurrency.lockutils [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87006) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:16:37 devstack cinder-volume[87006]: DEBUG oslo_concurrency.processutils [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:16:37 devstack sudo[87093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:16:37 devstack sudo[87093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:16:37 devstack sudo[87093]: pam_unix(sudo:session): session closed for user root Jul 16 23:16:37 devstack cinder-volume[87006]: DEBUG oslo_concurrency.processutils [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.263s {{(pid=87006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:16:37 devstack cinder-volume[87006]: DEBUG cinder.manager [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] Notifying Schedulers of capabilities ... {{(pid=87006) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:16:37 devstack cinder-volume[87006]: INFO cinder.volume.manager [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] Driver initialization completed successfully. Jul 16 23:16:37 devstack cinder-volume[87006]: INFO cinder.manager [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] Initiating service 3 cleanup Jul 16 23:16:37 devstack cinder-volume[87006]: INFO cinder.manager [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] Service 3 cleanup completed. Jul 16 23:16:37 devstack cinder-volume[87006]: DEBUG cinder.service [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] Creating RPC server for service cinder-volume {{(pid=87006) start /opt/stack/cinder/cinder/service.py:231}} Jul 16 23:16:37 devstack cinder-volume[87006]: DEBUG cinder.service [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87006) start /opt/stack/cinder/cinder/service.py:237}} Jul 16 23:16:38 devstack cinder-volume[87006]: INFO cinder.volume.manager [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 16 23:16:38 devstack cinder-volume[87006]: DEBUG oslo_concurrency.lockutils [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87006) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:16:38 devstack cinder-volume[87006]: DEBUG oslo_concurrency.lockutils [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87006) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:16:38 devstack cinder-volume[87006]: DEBUG cinder.volume.drivers.quobyte [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87006) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:16:38 devstack cinder-volume[87006]: DEBUG cinder.volume.drivers.quobyte [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87006) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:16:38 devstack cinder-volume[87006]: DEBUG oslo_concurrency.lockutils [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87006) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:16:38 devstack cinder-volume[87006]: DEBUG oslo_concurrency.processutils [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:16:38 devstack sudo[87114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:16:38 devstack sudo[87114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:16:38 devstack sudo[87114]: pam_unix(sudo:session): session closed for user root Jul 16 23:16:38 devstack cinder-volume[87006]: DEBUG oslo_concurrency.processutils [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.397s {{(pid=87006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:16:38 devstack cinder-volume[87006]: INFO cinder.volume.manager [None req-e520a918-d23d-44a6-9273-e295ff628491 None None] Driver post RPC initialization completed successfully. Jul 16 23:16:41 devstack cinder-volume[87006]: DEBUG oslo_concurrency.lockutils [None req-96dcae3f-68a1-4e2d-a2a1-60581b61d7bf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87006) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:16:41 devstack cinder-volume[87006]: DEBUG oslo_concurrency.lockutils [None req-96dcae3f-68a1-4e2d-a2a1-60581b61d7bf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87006) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:16:41 devstack cinder-volume[87006]: DEBUG cinder.volume.drivers.quobyte [None req-96dcae3f-68a1-4e2d-a2a1-60581b61d7bf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87006) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:16:41 devstack cinder-volume[87006]: DEBUG cinder.volume.drivers.quobyte [None req-96dcae3f-68a1-4e2d-a2a1-60581b61d7bf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87006) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:16:41 devstack cinder-volume[87006]: DEBUG oslo_concurrency.lockutils [None req-96dcae3f-68a1-4e2d-a2a1-60581b61d7bf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87006) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:16:41 devstack cinder-volume[87006]: DEBUG oslo_concurrency.processutils [None req-96dcae3f-68a1-4e2d-a2a1-60581b61d7bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:16:41 devstack sudo[87216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:16:41 devstack sudo[87216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:16:42 devstack sudo[87216]: pam_unix(sudo:session): session closed for user root Jul 16 23:16:42 devstack cinder-volume[87006]: DEBUG oslo_concurrency.processutils [None req-96dcae3f-68a1-4e2d-a2a1-60581b61d7bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.237s {{(pid=87006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:16:42 devstack cinder-volume[87006]: DEBUG cinder.manager [None req-96dcae3f-68a1-4e2d-a2a1-60581b61d7bf None None] Notifying Schedulers of capabilities ... {{(pid=87006) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:16:42 devstack cinder-volume[86793]: INFO oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] Caught SIGTERM, stopping children Jul 16 23:16:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] Acquiring lock "singleton_lock" {{(pid=86793) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 16 23:16:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] Acquired lock "singleton_lock" {{(pid=86793) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 16 23:16:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] Releasing lock "singleton_lock" {{(pid=86793) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 16 23:16:42 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] Stop services. {{(pid=86793) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 16 23:16:42 devstack cinder-volume[86793]: DEBUG oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] Killing children. {{(pid=86793) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 16 23:16:42 devstack cinder-volume[86793]: INFO oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] Waiting on 1 children to exit Jul 16 23:16:46 devstack cinder-volume[87006]: DEBUG oslo_concurrency.lockutils [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] Acquiring lock "singleton_lock" {{(pid=87006) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 16 23:16:46 devstack cinder-volume[87006]: DEBUG oslo_concurrency.lockutils [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] Acquired lock "singleton_lock" {{(pid=87006) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 16 23:16:46 devstack cinder-volume[87006]: DEBUG oslo_concurrency.lockutils [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] Releasing lock "singleton_lock" {{(pid=87006) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 16 23:16:46 devstack cinder-volume[87006]: WARNING amqp [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 16 23:16:46 devstack cinder-volume[87006]: WARNING amqp [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 16 23:16:46 devstack cinder-volume[86793]: INFO oslo_service.backend._eventlet.service [None req-6eb0c4ad-68b2-4c85-a21d-a2400a6ec638 None None] Child 87006 exited with status 0 Jul 16 23:16:46 devstack cinder-volume[87292]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 16 23:16:46 devstack cinder-volume[87292]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 16 23:16:46 devstack cinder-volume[87292]: we strongly recommend against using it for new projects. Jul 16 23:16:46 devstack cinder-volume[87292]: If you are already using Eventlet, we recommend migrating to a different Jul 16 23:16:46 devstack cinder-volume[87292]: framework. For more detail see Jul 16 23:16:46 devstack cinder-volume[87292]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 16 23:16:46 devstack cinder-volume[87292]: import eventlet # noqa Jul 16 23:16:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87292) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 16 23:16:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87292) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 16 23:16:49 devstack cinder-volume[87292]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87292) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 16 23:16:50 devstack cinder-volume[87292]: INFO dbcounter [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] Registered counter for database cinder Jul 16 23:16:50 devstack cinder-volume[87292]: DEBUG oslo_db.sqlalchemy.engines [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87292) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 16 23:16:50 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writer thread running {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 16 23:16:50 devstack cinder-volume[87292]: INFO cinder.rpc [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 16 23:16:51 devstack cinder-volume[87292]: INFO cinder.rpc [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_db.sqlalchemy.engines [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87292) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 16 23:16:51 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] Determined volume DB was empty at startup. Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG cinder.volume.manager [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87292) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 16 23:16:51 devstack cinder-volume[87292]: WARNING stevedore.named [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 16 23:16:51 devstack cinder-volume[87292]: WARNING castellan.key_manager [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 16 23:16:51 devstack cinder-volume[87292]: WARNING cinder.keymgr.conf_key_mgr [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 16 23:16:51 devstack cinder-volume[87292]: INFO cinder.volume.manager [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_db.sqlalchemy.engines [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87292) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 16 23:16:51 devstack cinder-volume[87292]: INFO oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] Starting 1 workers Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] Started child 87607 {{(pid=87292) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] Full set of CONF: {{(pid=87292) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] ******************************************************************************** {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] Configuration options gathered from: {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] ================================================================================ {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] allow_availability_zone_fallback = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87607]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] allow_compression_on_image_upload = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] allowed_direct_url_schemes = [] {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] api_rate_limit = True {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] auth_strategy = keystone {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_availability_zone = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_host = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_name = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_stats_polling_interval = 60 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backup_api_class = cinder.backup.api.API {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backup_name_template = backup-%s {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backup_use_same_host = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backup_use_temp_snapshot = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] chap_password = **** {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] chap_username = {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cinder_internal_tenant_project_id = 2392824f4e5145c5bc5974cafbb5eee7 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cinder_internal_tenant_user_id = a7a55d9c0fb34c47b614c47905227c41 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cluster = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] compression_format = gzip {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] compute_api_class = cinder.compute.nova.API {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] config_dir = [] {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] config_source = [] {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] control_exchange = openstack {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] debug = True {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] default_availability_zone = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] default_group_type = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] default_volume_type = QuobyteHD {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] disk_geometry = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] driver_client_cert = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] driver_client_cert_key = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] driver_data_namespace = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] driver_ssl_cert_path = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] driver_ssl_cert_verify = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] driver_use_ssl = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] enable_new_services = True {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] enable_unsupported_driver = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] enabled_backends = ['QuobyteHD'] {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] enforce_multipath_for_image_xfer = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] filter_function = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] glance_api_insecure = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] glance_api_servers = ['http://192.168.122.154/image'] {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] glance_api_ssl_compression = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] glance_ca_certificates_file = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] glance_catalog_info = image:glance:publicURL {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] glance_certfile = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] glance_keyfile = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] glance_num_retries = 3 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] glance_request_timeout = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] goodness_function = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] graceful_shutdown_timeout = 5 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] group_api_class = cinder.group.api.API {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] host = devstack {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] image_compress_on_upload = True {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] image_conversion_address_space_limit = 1 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] image_conversion_cpu_limit = 60 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] image_conversion_disable = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] image_upload_use_cinder_backend = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] image_upload_use_internal_tenant = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] image_volume_cache_enabled = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] image_volume_cache_max_count = 0 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] image_volume_cache_max_size_gb = 0 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] init_host_max_objects_retrieval = 0 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] instance_format = [instance: %(uuid)s] {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] iscsi_target_flags = {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] iscsi_write_cache = on {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] iser_helper = tgtadm {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] iser_ip_address = 192.168.122.154 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] iser_port = 3260 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] log_color = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] log_config_append = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] log_dir = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] log_file = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] log_options = True {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] log_rotate_interval = 1 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-055227f3-cd11-489e-9ffa-db0c75291990 None None] Starting volume driver QuobyteDriver (1.2) Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] log_rotate_interval_type = days {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-055227f3-cd11-489e-9ffa-db0c75291990 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87607) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] log_rotation_type = none {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] max_age = 0 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] max_logfile_count = 30 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] max_logfile_size_mb = 200 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] max_over_subscription_ratio = 20.0 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] message_reap_interval = 86400 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] message_ttl = 2592000 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] migration_create_volume_timeout_secs = 300 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] monkey_patch = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] monkey_patch_modules = [] {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] my_ip = 192.168.122.154 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] no_snapshot_gb_quota = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] num_iser_scan_tries = 3 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] num_shell_tries = 3 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] num_volume_device_scan_tries = 3 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] nvmeof_conn_info_version = 1 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] nvmet_ns_id = 10 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] nvmet_port_id = 1 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] osapi_max_limit = 1000 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] osapi_volume_ext_list = [] {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] osapi_volume_listen = 0.0.0.0 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] osapi_volume_listen_port = 8776 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] osapi_volume_use_ssl = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] osapi_volume_workers = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] per_volume_size_limit = -1 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] periodic_fuzzy_delay = 60 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] periodic_interval = 60 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] project_id_regex = [0-9a-f\-]+ {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] public_endpoint = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] publish_errors = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] quota_backup_gigabytes = 1000 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] quota_backups = 10 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] quota_gigabytes = 1000 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] quota_groups = 10 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] quota_snapshots = 10 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] quota_volumes = 10 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] rate_limit_burst = 0 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] rate_limit_except_level = CRITICAL {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] rate_limit_interval = 0 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] reinit_driver_count = 3 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] replication_device = **** {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] report_discard_supported = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] report_interval = 120 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] reservation_clean_interval = 86400 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] reservation_expire = 86400 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] reserved_image_namespaces = [] {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] reserved_percentage = 0 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] rpc_response_timeout = 120 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] run_external_periodic_tasks = True {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] scst_target_driver = iscsi {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] scst_target_iqn_name = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] service_down_time = 720 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] shell_completion = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] snapshot_name_template = snapshot-%s {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] split_loggers = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] state_path = /opt/stack/data/cinder {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] storage_availability_zone = nova {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] storage_protocol = iSCSI {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] syslog_log_facility = LOG_USER {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] target_helper = lioadm {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] target_ip_address = 192.168.122.154 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] target_port = 3260 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] target_protocol = iscsi {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] target_secondary_ip_addresses = [] {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] trace_flags = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] transfer_api_class = cinder.transfer.api.API {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] transport_url = **** {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] until_refresh = 0 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] use_chap_auth = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] use_default_quota_class = True {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] use_journal = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] use_json = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] use_multipath_for_image_xfer = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] use_stderr = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] use_syslog = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] verify_glance_signatures = enabled {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] volume_api_class = cinder.volume.api.API {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] volume_backend_name = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] volume_clear = zero {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] volume_clear_ionice = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] volume_clear_size = 0 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] volume_copy_bps_limit = 0 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] volume_dd_blocksize = 1M {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] volume_name_template = volume-%s {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] volume_service_inithost_offload = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] volume_usage_audit_period = month {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] zoning_mode = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_concurrency.disable_process_locking = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] keystone_authtoken.auth_section = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] keystone_authtoken.auth_type = password {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] keystone_authtoken.auth_version = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] keystone_authtoken.cache = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] keystone_authtoken.certfile = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] keystone_authtoken.delay_auth_decision = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] keystone_authtoken.http_connect_timeout = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] keystone_authtoken.include_service_catalog = True {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] keystone_authtoken.insecure = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] keystone_authtoken.interface = public {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] keystone_authtoken.keyfile = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] keystone_authtoken.memcache_password = {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] keystone_authtoken.memcache_username = {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] keystone_authtoken.region_name = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] keystone_authtoken.service_token_roles_required = True {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] keystone_authtoken.service_type = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] keystone_authtoken.token_cache_time = 300 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.154/identity {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cache.backend = dogpile.cache.null {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cache.backend_argument = **** {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cache.backend_expiration_time = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cache.config_prefix = cache.oslo {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cache.debug_cache_backend = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cache.enable_retry_client = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cache.enable_socket_keepalive = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cache.enabled = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cache.expiration_time = 600 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cache.hashclient_retry_attempts = 2 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cache.memcache_dead_retry = 300 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cache.memcache_pool_maxsize = 10 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cache.memcache_sasl_enabled = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cache.password = **** {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cache.proxies = [] {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-055227f3-cd11-489e-9ffa-db0c75291990 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87607) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 16 23:16:51 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.quobyte [None req-055227f3-cd11-489e-9ffa-db0c75291990 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 16 23:16:51 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.quobyte [None req-055227f3-cd11-489e-9ffa-db0c75291990 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cache.redis_db = 0 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cache.redis_sentinel_service_name = mymaster {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cache.redis_server = localhost:6379 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cache.retry_attempts = 2 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cache.retry_delay = 0.0 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cache.socket_keepalive_count = 1 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cache.socket_keepalive_idle = 1 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-055227f3-cd11-489e-9ffa-db0c75291990 None None] Running cmd (subprocess): mount.quobyte {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cache.socket_keepalive_interval = 1 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cache.socket_timeout = 1.0 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cache.tls_allowed_ciphers = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cache.tls_cafile = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cache.tls_certfile = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cache.tls_enabled = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cache.tls_keyfile = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cache.username = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] coordination.backend_url = **** {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] database.asyncio_connection = **** {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] database.asyncio_slave_connection = **** {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] database.backend = sqlalchemy {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] database.connection = **** {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] database.connection_debug = 0 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] database.connection_parameters = {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] database.connection_recycle_time = 3600 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] database.connection_trace = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] database.db_inc_retry_interval = True {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] database.db_max_retries = 20 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] database.db_max_retry_interval = 10 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] database.db_retry_interval = 1 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] database.max_overflow = 50 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] database.max_pool_size = 5 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] database.max_retries = 10 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] database.mysql_wsrep_sync_wait = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] database.pool_timeout = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] database.retry_interval = 10 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] database.slave_connection = **** {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] database.sqlite_synchronous = True {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] database.synchronous_reader = True {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] database.use_db_reconnect = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] profiler.connection_string = messaging:// {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] profiler.enabled = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] profiler.es_doc_type = notification {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] profiler.es_scroll_size = 10000 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] profiler.es_scroll_time = 2m {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] profiler.filter_error_trace = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] profiler.hmac_keys = **** {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] profiler.sentinel_service_name = mymaster {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] profiler.socket_timeout = 0.1 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] profiler.trace_requests = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] profiler.trace_sqlalchemy = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] profiler_jaeger.process_tags = {} {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] profiler_jaeger.service_name_prefix = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] profiler_otlp.service_name_prefix = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_policy.enforce_new_defaults = True {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_policy.enforce_scope = True {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_policy.policy_default_rule = default {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_policy.policy_file = policy.yaml {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_policy.remote_timeout = 60.0 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] privsep_osbrick.group = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] privsep_osbrick.helper_command = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] privsep_osbrick.user = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cinder_sys_admin.group = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cinder_sys_admin.helper_command = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] cinder_sys_admin.user = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] service_user.auth_section = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] service_user.auth_type = password {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] service_user.cafile = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] service_user.certfile = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] service_user.collect_timing = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] service_user.insecure = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] service_user.keyfile = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] service_user.send_service_user_token = True {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] service_user.split_loggers = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] service_user.timeout = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] glance.auth_section = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] glance.auth_type = password {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] glance.certfile = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] glance.collect_timing = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] glance.insecure = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] glance.keyfile = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] glance.region_name = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] glance.split_loggers = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] glance.timeout = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.backend_availability_zone = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.chap_password = **** {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.chap_username = {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.disk_geometry = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.driver_client_cert = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.driver_client_cert_key = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.driver_data_namespace = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.driver_use_ssl = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.enable_unsupported_driver = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.extra_capabilities = {} {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.filter_function = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.goodness_function = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.iscsi_target_flags = {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.iscsi_write_cache = on {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.iser_helper = tgtadm {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.iser_ip_address = 192.168.122.154 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.iser_port = 3260 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.nas_host = {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.nas_login = admin {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.nas_mount_options = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.nas_password = **** {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.nas_private_key = {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.nas_share_path = {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.nas_ssh_port = 22 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-055227f3-cd11-489e-9ffa-db0c75291990 None None] CMD "mount.quobyte" returned: 1 in 0.074s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:16:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-055227f3-cd11-489e-9ffa-db0c75291990 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.num_shell_tries = 3 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.nvmet_port_id = 1 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-055227f3-cd11-489e-9ffa-db0c75291990 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:16:51 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-055227f3-cd11-489e-9ffa-db0c75291990 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.quobyte_client_cfg = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.quobyte_volume_url = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.replication_device = **** {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.report_discard_supported = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.reserved_percentage = 0 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.scst_target_driver = iscsi {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.scst_target_iqn_name = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.storage_protocol = iSCSI {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.target_helper = tgtadm {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.target_ip_address = 192.168.122.154 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.target_port = 3260 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.target_protocol = iscsi {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.trace_flags = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.unique_fqdn_network = True {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-055227f3-cd11-489e-9ffa-db0c75291990 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:16:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-055227f3-cd11-489e-9ffa-db0c75291990 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.use_chap_auth = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.volume_backend_name = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.volume_clear = zero {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.volume_clear_ionice = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.volume_clear_size = 0 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-055227f3-cd11-489e-9ffa-db0c75291990 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_reports.file_event_handler = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_reports.log_dir = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.backend_availability_zone = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.backend_host = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.chap_password = **** {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.chap_username = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.chiscsi_conf = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.disk_geometry = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.driver_client_cert = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.driver_client_cert_key = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.driver_data_namespace = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.driver_use_ssl = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.extra_capabilities = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.filter_function = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.goodness_function = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.iscsi_target_flags = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.iscsi_write_cache = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.iser_helper = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.iser_ip_address = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.iser_port = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.iser_target_prefix = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.nas_host = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.nas_login = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.nas_mount_options = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.nas_password = **** {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.nas_private_key = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.nas_share_path = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.nas_ssh_port = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.num_shell_tries = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.nvmet_ns_id = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.nvmet_port_id = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.replication_device = **** {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.report_discard_supported = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.reserved_percentage = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.scst_target_driver = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.storage_protocol = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.target_helper = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.target_ip_address = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.target_port = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.target_prefix = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.target_protocol = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.trace_flags = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.unique_fqdn_network = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.use_chap_auth = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.volume_clear = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.volume_clear_ionice = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.volume_clear_size = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] QuobyteHD.volumes_dir = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack sudo[87609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack sudo[87609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_rabbit.ssl = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_rabbit.ssl_version = {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_notifications.driver = [] {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_notifications.retry = -1 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] oslo_messaging_notifications.transport_url = **** {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] key_manager.fixed_key = **** {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] barbican.barbican_api_version = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] barbican.barbican_endpoint = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] barbican.barbican_endpoint_type = public {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] barbican.barbican_region_name = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] barbican.cafile = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] barbican.certfile = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] barbican.collect_timing = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] barbican.insecure = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] barbican.keyfile = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] barbican.number_of_retries = 60 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] barbican.retry_delay = 1 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] barbican.send_service_user_token = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] barbican.split_loggers = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] barbican.timeout = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] barbican.verify_ssl = True {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] barbican.verify_ssl_path = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] barbican_service_user.auth_section = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] barbican_service_user.auth_type = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] barbican_service_user.cafile = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] barbican_service_user.certfile = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] barbican_service_user.collect_timing = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] barbican_service_user.insecure = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] barbican_service_user.keyfile = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] barbican_service_user.split_loggers = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] barbican_service_user.timeout = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] vault.approle_role_id = **** {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] vault.approle_secret_id = **** {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] vault.auth_method = approle {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] vault.auth_path = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] vault.kv_mountpoint = secret {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] vault.kv_path = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] vault.kv_version = 2 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] vault.namespace = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] vault.root_token_id = **** {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] vault.ssl_ca_crt_file = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] vault.timeout = 60.0 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] vault.token_file = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] vault.token_role = None {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] vault.use_ssl = False {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 23:16:51 devstack cinder-volume[87292]: DEBUG oslo_service.backend._eventlet.service [None req-475a6971-29fc-43d5-99d4-b16ab041702c None None] ******************************************************************************** {{(pid=87292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 16 23:16:51 devstack sudo[87609]: pam_unix(sudo:session): session closed for user root Jul 16 23:16:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-055227f3-cd11-489e-9ffa-db0c75291990 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.258s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:16:51 devstack cinder-volume[87607]: INFO cinder.volume.driver [None req-055227f3-cd11-489e-9ffa-db0c75291990 None None] Driver hasn't implemented _init_vendor_properties() Jul 16 23:16:51 devstack cinder-volume[87607]: DEBUG cinder.volume.driver [None req-055227f3-cd11-489e-9ffa-db0c75291990 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87607) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 16 23:16:51 devstack cinder-volume[87607]: DEBUG oslo_db.sqlalchemy.engines [None req-055227f3-cd11-489e-9ffa-db0c75291990 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87607) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 16 23:16:51 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writer thread running {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 16 23:16:51 devstack cinder-volume[87607]: DEBUG cinder.db.api [None req-055227f3-cd11-489e-9ffa-db0c75291990 None None] Building query based on filter {{(pid=87607) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 16 23:16:51 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-055227f3-cd11-489e-9ffa-db0c75291990 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87607) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 16 23:16:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-055227f3-cd11-489e-9ffa-db0c75291990 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:16:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-055227f3-cd11-489e-9ffa-db0c75291990 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:16:51 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-055227f3-cd11-489e-9ffa-db0c75291990 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:16:51 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-055227f3-cd11-489e-9ffa-db0c75291990 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:16:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-055227f3-cd11-489e-9ffa-db0c75291990 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:16:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-055227f3-cd11-489e-9ffa-db0c75291990 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:16:51 devstack cinder-volume[87607]: INFO cinder.keymgr.migration [None req-34813746-735f-47e9-b3e1-cc6ec7ca422a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 16 23:16:51 devstack sudo[87620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:16:51 devstack sudo[87620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:16:52 devstack sudo[87620]: pam_unix(sudo:session): session closed for user root Jul 16 23:16:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-055227f3-cd11-489e-9ffa-db0c75291990 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.227s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:16:52 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-055227f3-cd11-489e-9ffa-db0c75291990 None None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:16:52 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-055227f3-cd11-489e-9ffa-db0c75291990 None None] Driver initialization completed successfully. Jul 16 23:16:52 devstack cinder-volume[87607]: INFO cinder.manager [None req-055227f3-cd11-489e-9ffa-db0c75291990 None None] Initiating service 3 cleanup Jul 16 23:16:52 devstack cinder-volume[87607]: INFO cinder.manager [None req-055227f3-cd11-489e-9ffa-db0c75291990 None None] Service 3 cleanup completed. Jul 16 23:16:52 devstack cinder-volume[87607]: DEBUG cinder.service [None req-055227f3-cd11-489e-9ffa-db0c75291990 None None] Creating RPC server for service cinder-volume {{(pid=87607) start /opt/stack/cinder/cinder/service.py:231}} Jul 16 23:16:52 devstack cinder-volume[87607]: DEBUG cinder.service [None req-055227f3-cd11-489e-9ffa-db0c75291990 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87607) start /opt/stack/cinder/cinder/service.py:237}} Jul 16 23:16:52 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-055227f3-cd11-489e-9ffa-db0c75291990 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 16 23:16:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-055227f3-cd11-489e-9ffa-db0c75291990 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:16:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-055227f3-cd11-489e-9ffa-db0c75291990 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:16:52 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-055227f3-cd11-489e-9ffa-db0c75291990 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:16:52 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-055227f3-cd11-489e-9ffa-db0c75291990 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:16:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-055227f3-cd11-489e-9ffa-db0c75291990 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:16:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-055227f3-cd11-489e-9ffa-db0c75291990 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:16:52 devstack sudo[87633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:16:52 devstack sudo[87633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:16:52 devstack sudo[87633]: pam_unix(sudo:session): session closed for user root Jul 16 23:16:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-055227f3-cd11-489e-9ffa-db0c75291990 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.237s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:16:52 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-055227f3-cd11-489e-9ffa-db0c75291990 None None] Driver post RPC initialization completed successfully. Jul 16 23:17:01 devstack cinder-volume[87292]: DEBUG dbcounter [-] [87292] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:17:02 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:SELECT=2 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:17:02 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:17:39 devstack cinder-volume[87607]: DEBUG oslo_service.periodic_task [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running periodic task VolumeManager._thread_info {{(pid=87607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:17:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] thread count: 6 {{(pid=87607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 23:17:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] thread info: [<_MainThread(MainThread, started 139090403627136)>, , , , , ] {{(pid=87607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 23:18:04 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-fad6bf89-a2a1-40e3-854f-99ef3411e70b tempest-DeleteServersTestJSON-188051957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:18:04 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-fad6bf89-a2a1-40e3-854f-99ef3411e70b tempest-DeleteServersTestJSON-188051957 None] Flow 'volume_create_manager' (646efc6b-a566-4a9a-a4c6-92035e523dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:18:04 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-fad6bf89-a2a1-40e3-854f-99ef3411e70b tempest-DeleteServersTestJSON-188051957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b044b6b-0bac-4902-9a08-9618e7760914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:18:04 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-fad6bf89-a2a1-40e3-854f-99ef3411e70b tempest-DeleteServersTestJSON-188051957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b044b6b-0bac-4902-9a08-9618e7760914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1437833031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e873fe0-4725-4f68-8961-5d669d4f3db7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b97a2297cfae4cf492d2ed7e762053d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:18:04Z,use_quota=True,user_id='8f9d3445247c449685e4bd309690c97f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:18:04 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-fad6bf89-a2a1-40e3-854f-99ef3411e70b tempest-DeleteServersTestJSON-188051957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f79e7a01-e0d1-454f-b4c3-8ab09c44518e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:18:04 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-fad6bf89-a2a1-40e3-854f-99ef3411e70b tempest-DeleteServersTestJSON-188051957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f79e7a01-e0d1-454f-b4c3-8ab09c44518e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:18:04 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-fad6bf89-a2a1-40e3-854f-99ef3411e70b tempest-DeleteServersTestJSON-188051957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94614c34-f7e5-4df2-811b-ac088555ef90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:18:04 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-fad6bf89-a2a1-40e3-854f-99ef3411e70b tempest-DeleteServersTestJSON-188051957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94614c34-f7e5-4df2-811b-ac088555ef90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e873fe0-4725-4f68-8961-5d669d4f3db7', 'volume_name': 'volume-3e873fe0-4725-4f68-8961-5d669d4f3db7', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:18:04 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-fad6bf89-a2a1-40e3-854f-99ef3411e70b tempest-DeleteServersTestJSON-188051957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11fa53b5-544e-47a0-a55f-64f9d4d7dae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:18:04 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-fad6bf89-a2a1-40e3-854f-99ef3411e70b tempest-DeleteServersTestJSON-188051957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11fa53b5-544e-47a0-a55f-64f9d4d7dae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:18:04 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-fad6bf89-a2a1-40e3-854f-99ef3411e70b tempest-DeleteServersTestJSON-188051957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f858f7a7-bc3d-4316-9a98-719988c05d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:18:04 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-fad6bf89-a2a1-40e3-854f-99ef3411e70b tempest-DeleteServersTestJSON-188051957 None] Volume 3e873fe0-4725-4f68-8961-5d669d4f3db7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e873fe0-4725-4f68-8961-5d669d4f3db7', 'volume_size': 1} Jul 16 23:18:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-fad6bf89-a2a1-40e3-854f-99ef3411e70b tempest-DeleteServersTestJSON-188051957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:18:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-fad6bf89-a2a1-40e3-854f-99ef3411e70b tempest-DeleteServersTestJSON-188051957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:18:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-fad6bf89-a2a1-40e3-854f-99ef3411e70b tempest-DeleteServersTestJSON-188051957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1437833031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e873fe0-4725-4f68-8961-5d669d4f3db7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b97a2297cfae4cf492d2ed7e762053d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:18:04Z,use_quota=True,user_id='8f9d3445247c449685e4bd309690c97f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:18:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-fad6bf89-a2a1-40e3-854f-99ef3411e70b tempest-DeleteServersTestJSON-188051957 None] Creating volume 3e873fe0-4725-4f68-8961-5d669d4f3db7 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:18:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-fad6bf89-a2a1-40e3-854f-99ef3411e70b tempest-DeleteServersTestJSON-188051957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:18:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-fad6bf89-a2a1-40e3-854f-99ef3411e70b tempest-DeleteServersTestJSON-188051957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:18:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-fad6bf89-a2a1-40e3-854f-99ef3411e70b tempest-DeleteServersTestJSON-188051957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:18:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-fad6bf89-a2a1-40e3-854f-99ef3411e70b tempest-DeleteServersTestJSON-188051957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:18:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-fad6bf89-a2a1-40e3-854f-99ef3411e70b tempest-DeleteServersTestJSON-188051957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:18:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-fad6bf89-a2a1-40e3-854f-99ef3411e70b tempest-DeleteServersTestJSON-188051957 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:18:04 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-fad6bf89-a2a1-40e3-854f-99ef3411e70b tempest-DeleteServersTestJSON-188051957 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:18:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fad6bf89-a2a1-40e3-854f-99ef3411e70b tempest-DeleteServersTestJSON-188051957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e873fe0-4725-4f68-8961-5d669d4f3db7 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:18:04 devstack sudo[88228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e873fe0-4725-4f68-8961-5d669d4f3db7 1073741824 Jul 16 23:18:04 devstack sudo[88228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:18:05 devstack sudo[88228]: pam_unix(sudo:session): session closed for user root Jul 16 23:18:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fad6bf89-a2a1-40e3-854f-99ef3411e70b tempest-DeleteServersTestJSON-188051957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e873fe0-4725-4f68-8961-5d669d4f3db7 1073741824" returned: 0 in 1.020s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:18:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fad6bf89-a2a1-40e3-854f-99ef3411e70b tempest-DeleteServersTestJSON-188051957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e873fe0-4725-4f68-8961-5d669d4f3db7 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:18:05 devstack sudo[88563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e873fe0-4725-4f68-8961-5d669d4f3db7 Jul 16 23:18:05 devstack sudo[88563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:18:06 devstack sudo[88563]: pam_unix(sudo:session): session closed for user root Jul 16 23:18:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fad6bf89-a2a1-40e3-854f-99ef3411e70b tempest-DeleteServersTestJSON-188051957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e873fe0-4725-4f68-8961-5d669d4f3db7" returned: 0 in 0.307s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:18:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-fad6bf89-a2a1-40e3-854f-99ef3411e70b tempest-DeleteServersTestJSON-188051957 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:18:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-fad6bf89-a2a1-40e3-854f-99ef3411e70b tempest-DeleteServersTestJSON-188051957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:18:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-fad6bf89-a2a1-40e3-854f-99ef3411e70b tempest-DeleteServersTestJSON-188051957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f858f7a7-bc3d-4316-9a98-719988c05d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e873fe0-4725-4f68-8961-5d669d4f3db7', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:18:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-fad6bf89-a2a1-40e3-854f-99ef3411e70b tempest-DeleteServersTestJSON-188051957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba3334c0-79bb-4eda-85dc-8fb311c71d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:18:06 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-fad6bf89-a2a1-40e3-854f-99ef3411e70b tempest-DeleteServersTestJSON-188051957 None] Volume volume-3e873fe0-4725-4f68-8961-5d669d4f3db7 (3e873fe0-4725-4f68-8961-5d669d4f3db7): created successfully Jul 16 23:18:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-fad6bf89-a2a1-40e3-854f-99ef3411e70b tempest-DeleteServersTestJSON-188051957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba3334c0-79bb-4eda-85dc-8fb311c71d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:18:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-fad6bf89-a2a1-40e3-854f-99ef3411e70b tempest-DeleteServersTestJSON-188051957 None] Flow 'volume_create_manager' (646efc6b-a566-4a9a-a4c6-92035e523dee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:18:06 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-fad6bf89-a2a1-40e3-854f-99ef3411e70b tempest-DeleteServersTestJSON-188051957 None] Created volume successfully. Jul 16 23:18:12 devstack cinder-volume[87607]: WARNING py.warnings [req-cd76c3fa-ee8a-4b1f-8519-fdc3bba1ac29 req-1d2eb617-decd-4d0d-9a81-18038739037e tempest-DeleteServersTestJSON-188051957 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 16 23:18:12 devstack cinder-volume[87607]: .first() Jul 16 23:18:12 devstack cinder-volume[87607]: Jul 16 23:18:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-cd76c3fa-ee8a-4b1f-8519-fdc3bba1ac29 req-1d2eb617-decd-4d0d-9a81-18038739037e tempest-DeleteServersTestJSON-188051957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:18:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-cd76c3fa-ee8a-4b1f-8519-fdc3bba1ac29 req-1d2eb617-decd-4d0d-9a81-18038739037e tempest-DeleteServersTestJSON-188051957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:18:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-cd76c3fa-ee8a-4b1f-8519-fdc3bba1ac29 req-1d2eb617-decd-4d0d-9a81-18038739037e tempest-DeleteServersTestJSON-188051957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.093s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:18:13 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-cd76c3fa-ee8a-4b1f-8519-fdc3bba1ac29 req-1d2eb617-decd-4d0d-9a81-18038739037e tempest-DeleteServersTestJSON-188051957 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72', 'name': 'volume-3e873fe0-4725-4f68-8961-5d669d4f3db7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ef7fa29a-5a03-47c1-86ec-030b17c1accc', 'enforce_multipath': True} {{(pid=87607) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 23:18:13 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-cd76c3fa-ee8a-4b1f-8519-fdc3bba1ac29 req-1d2eb617-decd-4d0d-9a81-18038739037e tempest-DeleteServersTestJSON-188051957 None] attachment_update completed successfully. Jul 16 23:18:18 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-25e3b5c2-3102-4bd7-818d-5f2224d82252 tempest-VolumesAdminNegativeTest-647730517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:18:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-25e3b5c2-3102-4bd7-818d-5f2224d82252 tempest-VolumesAdminNegativeTest-647730517 None] Flow 'volume_create_manager' (c0a2fb09-0379-439b-aaf2-57db47d0a41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:18:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-25e3b5c2-3102-4bd7-818d-5f2224d82252 tempest-VolumesAdminNegativeTest-647730517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3194cfe0-5387-42bc-a61c-d9358259b279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:18:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-25e3b5c2-3102-4bd7-818d-5f2224d82252 tempest-VolumesAdminNegativeTest-647730517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3194cfe0-5387-42bc-a61c-d9358259b279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:18:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1810797759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9800c742-7546-413f-8722-2cd84ccc990b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8a16cac9b574bcdb9be94ace4bd32bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:18:18Z,use_quota=True,user_id='de3145d7e93345d3be5653d051bc3f8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:18:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-25e3b5c2-3102-4bd7-818d-5f2224d82252 tempest-VolumesAdminNegativeTest-647730517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de02eafb-d8bd-41bc-aa94-1e113b17eade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:18:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-25e3b5c2-3102-4bd7-818d-5f2224d82252 tempest-VolumesAdminNegativeTest-647730517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de02eafb-d8bd-41bc-aa94-1e113b17eade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:18:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-25e3b5c2-3102-4bd7-818d-5f2224d82252 tempest-VolumesAdminNegativeTest-647730517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b15e4ca-6104-43ad-b81e-537bdd3408e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:18:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-25e3b5c2-3102-4bd7-818d-5f2224d82252 tempest-VolumesAdminNegativeTest-647730517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b15e4ca-6104-43ad-b81e-537bdd3408e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9800c742-7546-413f-8722-2cd84ccc990b', 'volume_name': 'volume-9800c742-7546-413f-8722-2cd84ccc990b', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:18:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-25e3b5c2-3102-4bd7-818d-5f2224d82252 tempest-VolumesAdminNegativeTest-647730517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bfed027-070e-4d30-aa60-358a11cd30f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:18:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-25e3b5c2-3102-4bd7-818d-5f2224d82252 tempest-VolumesAdminNegativeTest-647730517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bfed027-070e-4d30-aa60-358a11cd30f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:18:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-25e3b5c2-3102-4bd7-818d-5f2224d82252 tempest-VolumesAdminNegativeTest-647730517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7195f54d-0f2c-4a05-82c2-596f98cbb89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:18:18 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-25e3b5c2-3102-4bd7-818d-5f2224d82252 tempest-VolumesAdminNegativeTest-647730517 None] Volume 9800c742-7546-413f-8722-2cd84ccc990b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9800c742-7546-413f-8722-2cd84ccc990b', 'volume_size': 1} Jul 16 23:18:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-25e3b5c2-3102-4bd7-818d-5f2224d82252 tempest-VolumesAdminNegativeTest-647730517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:18:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-25e3b5c2-3102-4bd7-818d-5f2224d82252 tempest-VolumesAdminNegativeTest-647730517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:18:18 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-25e3b5c2-3102-4bd7-818d-5f2224d82252 tempest-VolumesAdminNegativeTest-647730517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:18:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1810797759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9800c742-7546-413f-8722-2cd84ccc990b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8a16cac9b574bcdb9be94ace4bd32bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:18:18Z,use_quota=True,user_id='de3145d7e93345d3be5653d051bc3f8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:18:18 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-25e3b5c2-3102-4bd7-818d-5f2224d82252 tempest-VolumesAdminNegativeTest-647730517 None] Creating volume 9800c742-7546-413f-8722-2cd84ccc990b {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:18:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-25e3b5c2-3102-4bd7-818d-5f2224d82252 tempest-VolumesAdminNegativeTest-647730517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:18:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-25e3b5c2-3102-4bd7-818d-5f2224d82252 tempest-VolumesAdminNegativeTest-647730517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:18:18 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-25e3b5c2-3102-4bd7-818d-5f2224d82252 tempest-VolumesAdminNegativeTest-647730517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:18:18 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-25e3b5c2-3102-4bd7-818d-5f2224d82252 tempest-VolumesAdminNegativeTest-647730517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:18:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-25e3b5c2-3102-4bd7-818d-5f2224d82252 tempest-VolumesAdminNegativeTest-647730517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:18:18 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-25e3b5c2-3102-4bd7-818d-5f2224d82252 tempest-VolumesAdminNegativeTest-647730517 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:18:18 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-25e3b5c2-3102-4bd7-818d-5f2224d82252 tempest-VolumesAdminNegativeTest-647730517 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:18:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-25e3b5c2-3102-4bd7-818d-5f2224d82252 tempest-VolumesAdminNegativeTest-647730517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9800c742-7546-413f-8722-2cd84ccc990b 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:18:18 devstack sudo[89211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9800c742-7546-413f-8722-2cd84ccc990b 1073741824 Jul 16 23:18:18 devstack sudo[89211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:18:19 devstack sudo[89211]: pam_unix(sudo:session): session closed for user root Jul 16 23:18:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-25e3b5c2-3102-4bd7-818d-5f2224d82252 tempest-VolumesAdminNegativeTest-647730517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9800c742-7546-413f-8722-2cd84ccc990b 1073741824" returned: 0 in 0.764s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:18:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-25e3b5c2-3102-4bd7-818d-5f2224d82252 tempest-VolumesAdminNegativeTest-647730517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9800c742-7546-413f-8722-2cd84ccc990b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:18:19 devstack sudo[89218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9800c742-7546-413f-8722-2cd84ccc990b Jul 16 23:18:19 devstack sudo[89218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:18:19 devstack sudo[89218]: pam_unix(sudo:session): session closed for user root Jul 16 23:18:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-25e3b5c2-3102-4bd7-818d-5f2224d82252 tempest-VolumesAdminNegativeTest-647730517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9800c742-7546-413f-8722-2cd84ccc990b" returned: 0 in 0.390s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:18:19 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-25e3b5c2-3102-4bd7-818d-5f2224d82252 tempest-VolumesAdminNegativeTest-647730517 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:18:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-25e3b5c2-3102-4bd7-818d-5f2224d82252 tempest-VolumesAdminNegativeTest-647730517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:18:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-25e3b5c2-3102-4bd7-818d-5f2224d82252 tempest-VolumesAdminNegativeTest-647730517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7195f54d-0f2c-4a05-82c2-596f98cbb89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9800c742-7546-413f-8722-2cd84ccc990b', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:18:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-25e3b5c2-3102-4bd7-818d-5f2224d82252 tempest-VolumesAdminNegativeTest-647730517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (960fea5d-ecc0-473d-a99a-1c666ffcb540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:18:19 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-25e3b5c2-3102-4bd7-818d-5f2224d82252 tempest-VolumesAdminNegativeTest-647730517 None] Volume volume-9800c742-7546-413f-8722-2cd84ccc990b (9800c742-7546-413f-8722-2cd84ccc990b): created successfully Jul 16 23:18:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-25e3b5c2-3102-4bd7-818d-5f2224d82252 tempest-VolumesAdminNegativeTest-647730517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (960fea5d-ecc0-473d-a99a-1c666ffcb540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:18:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-25e3b5c2-3102-4bd7-818d-5f2224d82252 tempest-VolumesAdminNegativeTest-647730517 None] Flow 'volume_create_manager' (c0a2fb09-0379-439b-aaf2-57db47d0a41f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:18:19 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-25e3b5c2-3102-4bd7-818d-5f2224d82252 tempest-VolumesAdminNegativeTest-647730517 None] Created volume successfully. Jul 16 23:18:19 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-0d58c14c-20d0-4039-b7c1-c78ae0007f84 req-c208d897-6090-495b-9680-fc5bbd08fbc7 tempest-DeleteServersTestJSON-188051957 None] Terminate volume connection completed successfully. Jul 16 23:18:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-0d58c14c-20d0-4039-b7c1-c78ae0007f84 req-c208d897-6090-495b-9680-fc5bbd08fbc7 tempest-DeleteServersTestJSON-188051957 None] Deleting attachment ef7fa29a-5a03-47c1-86ec-030b17c1accc. {{(pid=87607) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 23:18:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-becddfd2-3bc5-4117-8a24-ff4861ea4440 tempest-DeleteServersTestJSON-188051957 None] Acquiring lock "cinder-3e873fe0-4725-4f68-8961-5d669d4f3db7-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:18:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-becddfd2-3bc5-4117-8a24-ff4861ea4440 tempest-DeleteServersTestJSON-188051957 None] Lock "cinder-3e873fe0-4725-4f68-8961-5d669d4f3db7-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:18:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-becddfd2-3bc5-4117-8a24-ff4861ea4440 tempest-DeleteServersTestJSON-188051957 None] Acquiring lock "cinder-quobyte-3e873fe0-4725-4f68-8961-5d669d4f3db7" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:18:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-becddfd2-3bc5-4117-8a24-ff4861ea4440 tempest-DeleteServersTestJSON-188051957 None] Lock "cinder-quobyte-3e873fe0-4725-4f68-8961-5d669d4f3db7" acquired by "delete_volume" :: waited 0.022s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:18:21 devstack cinder-volume[87607]: INFO oslo.privsep.daemon [None req-becddfd2-3bc5-4117-8a24-ff4861ea4440 tempest-DeleteServersTestJSON-188051957 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpbjw2kj6n/privsep.sock'] Jul 16 23:18:21 devstack sudo[89227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpbjw2kj6n/privsep.sock Jul 16 23:18:21 devstack sudo[89227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:18:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-78afdf79-d68d-4a36-b8ef-c1b5eab283bb tempest-VolumesAdminNegativeTest-647730517 None] Acquiring lock "cinder-9800c742-7546-413f-8722-2cd84ccc990b-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:18:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-78afdf79-d68d-4a36-b8ef-c1b5eab283bb tempest-VolumesAdminNegativeTest-647730517 None] Lock "cinder-9800c742-7546-413f-8722-2cd84ccc990b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:18:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-78afdf79-d68d-4a36-b8ef-c1b5eab283bb tempest-VolumesAdminNegativeTest-647730517 None] Acquiring lock "cinder-quobyte-9800c742-7546-413f-8722-2cd84ccc990b" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:18:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-78afdf79-d68d-4a36-b8ef-c1b5eab283bb tempest-VolumesAdminNegativeTest-647730517 None] Lock "cinder-quobyte-9800c742-7546-413f-8722-2cd84ccc990b" acquired by "delete_volume" :: waited 0.030s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:18:22 devstack cinder-volume[87607]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 16 23:18:22 devstack cinder-volume[87607]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 16 23:18:22 devstack cinder-volume[87607]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 16 23:18:22 devstack cinder-volume[87607]: WARNING oslo.privsep.daemon [-] privsep log: Jul 16 23:18:22 devstack cinder-volume[87607]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 16 23:18:22 devstack cinder-volume[87607]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 16 23:18:22 devstack cinder-volume[87607]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 16 23:18:22 devstack cinder-volume[87607]: WARNING oslo.privsep.daemon [-] privsep log: Jul 16 23:18:22 devstack cinder-volume[87607]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 16 23:18:22 devstack sudo[89227]: pam_unix(sudo:session): session closed for user root Jul 16 23:18:22 devstack cinder-volume[87607]: INFO oslo.privsep.daemon [None req-becddfd2-3bc5-4117-8a24-ff4861ea4440 tempest-DeleteServersTestJSON-188051957 None] Spawned new privsep daemon via rootwrap Jul 16 23:18:22 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [None req-becddfd2-3bc5-4117-8a24-ff4861ea4440 tempest-DeleteServersTestJSON-188051957 None] Accepted privsep connection to /tmp/tmpbjw2kj6n/privsep.sock {{(pid=87607) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 16 23:18:22 devstack cinder-volume[87607]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 16 23:18:22 devstack cinder-volume[87607]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 16 23:18:22 devstack cinder-volume[87607]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 16 23:18:22 devstack cinder-volume[87607]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89230 Jul 16 23:18:22 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f9a66b-9543-496f-8323-6cd036403b83]: (2,) {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:18:22 devstack cinder-volume[87607]: WARNING oslo_privsep.priv_context [None req-78afdf79-d68d-4a36-b8ef-c1b5eab283bb tempest-VolumesAdminNegativeTest-647730517 None] privsep daemon already running Jul 16 23:18:22 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb68eb1-4fc6-485b-9b8c-398b67a0704e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:18:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-becddfd2-3bc5-4117-8a24-ff4861ea4440 tempest-DeleteServersTestJSON-188051957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e873fe0-4725-4f68-8961-5d669d4f3db7 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:18:22 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd7f759-e108-4c46-89bc-4833df85b7c0]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:18:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-78afdf79-d68d-4a36-b8ef-c1b5eab283bb tempest-VolumesAdminNegativeTest-647730517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9800c742-7546-413f-8722-2cd84ccc990b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:18:22 devstack sudo[89233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e873fe0-4725-4f68-8961-5d669d4f3db7 Jul 16 23:18:22 devstack sudo[89233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:18:22 devstack sudo[89234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9800c742-7546-413f-8722-2cd84ccc990b Jul 16 23:18:22 devstack sudo[89234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:18:23 devstack sudo[89234]: pam_unix(sudo:session): session closed for user root Jul 16 23:18:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-78afdf79-d68d-4a36-b8ef-c1b5eab283bb tempest-VolumesAdminNegativeTest-647730517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9800c742-7546-413f-8722-2cd84ccc990b" returned: 0 in 0.514s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:18:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-78afdf79-d68d-4a36-b8ef-c1b5eab283bb tempest-VolumesAdminNegativeTest-647730517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9800c742-7546-413f-8722-2cd84ccc990b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:18:23 devstack sudo[89233]: pam_unix(sudo:session): session closed for user root Jul 16 23:18:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-becddfd2-3bc5-4117-8a24-ff4861ea4440 tempest-DeleteServersTestJSON-188051957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e873fe0-4725-4f68-8961-5d669d4f3db7" returned: 0 in 0.556s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:18:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-becddfd2-3bc5-4117-8a24-ff4861ea4440 tempest-DeleteServersTestJSON-188051957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e873fe0-4725-4f68-8961-5d669d4f3db7 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:18:23 devstack sudo[89244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9800c742-7546-413f-8722-2cd84ccc990b Jul 16 23:18:23 devstack sudo[89244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:18:23 devstack sudo[89245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e873fe0-4725-4f68-8961-5d669d4f3db7 Jul 16 23:18:23 devstack sudo[89245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:18:23 devstack sudo[89244]: pam_unix(sudo:session): session closed for user root Jul 16 23:18:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-78afdf79-d68d-4a36-b8ef-c1b5eab283bb tempest-VolumesAdminNegativeTest-647730517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9800c742-7546-413f-8722-2cd84ccc990b" returned: 0 in 0.429s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:18:23 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-78afdf79-d68d-4a36-b8ef-c1b5eab283bb tempest-VolumesAdminNegativeTest-647730517 None] Lock "cinder-quobyte-9800c742-7546-413f-8722-2cd84ccc990b" released by "delete_volume" :: held 1.928s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:18:23 devstack sudo[89245]: pam_unix(sudo:session): session closed for user root Jul 16 23:18:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-becddfd2-3bc5-4117-8a24-ff4861ea4440 tempest-DeleteServersTestJSON-188051957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e873fe0-4725-4f68-8961-5d669d4f3db7" returned: 0 in 0.431s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:18:23 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-becddfd2-3bc5-4117-8a24-ff4861ea4440 tempest-DeleteServersTestJSON-188051957 None] Lock "cinder-quobyte-3e873fe0-4725-4f68-8961-5d669d4f3db7" released by "delete_volume" :: held 2.347s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:18:23 devstack cinder-volume[87607]: WARNING cinder.quota [None req-78afdf79-d68d-4a36-b8ef-c1b5eab283bb tempest-VolumesAdminNegativeTest-647730517 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 16 23:18:23 devstack cinder-volume[87607]: WARNING cinder.quota [None req-78afdf79-d68d-4a36-b8ef-c1b5eab283bb tempest-VolumesAdminNegativeTest-647730517 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 16 23:18:23 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-78afdf79-d68d-4a36-b8ef-c1b5eab283bb tempest-VolumesAdminNegativeTest-647730517 None] Created reservations ['d6d3da04-7d55-4fe5-8939-64b83546746e', '482dd012-895f-4459-9dea-4f8c85bfc64f', '24bec5e9-c9b8-4581-85b2-0a654545b71e', 'e2192274-11d0-49db-97d5-65db89c3bbe2'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:18:23 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-becddfd2-3bc5-4117-8a24-ff4861ea4440 tempest-DeleteServersTestJSON-188051957 None] Created reservations ['d19bb0d0-2493-486b-897a-0de832bed788', '2f8b5817-4a4d-4a08-91c6-5ac765e9cacd', 'f817faf9-01fc-4d85-9f6e-0bed0b6c933a', 'b294afd6-80a8-4d0a-9290-2a3de18f9d4c'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:18:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-78afdf79-d68d-4a36-b8ef-c1b5eab283bb tempest-VolumesAdminNegativeTest-647730517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:18:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-78afdf79-d68d-4a36-b8ef-c1b5eab283bb tempest-VolumesAdminNegativeTest-647730517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:18:23 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-78afdf79-d68d-4a36-b8ef-c1b5eab283bb tempest-VolumesAdminNegativeTest-647730517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:18:23 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-78afdf79-d68d-4a36-b8ef-c1b5eab283bb tempest-VolumesAdminNegativeTest-647730517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:18:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-78afdf79-d68d-4a36-b8ef-c1b5eab283bb tempest-VolumesAdminNegativeTest-647730517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:18:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-78afdf79-d68d-4a36-b8ef-c1b5eab283bb tempest-VolumesAdminNegativeTest-647730517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:18:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-becddfd2-3bc5-4117-8a24-ff4861ea4440 tempest-DeleteServersTestJSON-188051957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:18:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-becddfd2-3bc5-4117-8a24-ff4861ea4440 tempest-DeleteServersTestJSON-188051957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:18:23 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-becddfd2-3bc5-4117-8a24-ff4861ea4440 tempest-DeleteServersTestJSON-188051957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:18:23 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-becddfd2-3bc5-4117-8a24-ff4861ea4440 tempest-DeleteServersTestJSON-188051957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:18:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-becddfd2-3bc5-4117-8a24-ff4861ea4440 tempest-DeleteServersTestJSON-188051957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:18:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-becddfd2-3bc5-4117-8a24-ff4861ea4440 tempest-DeleteServersTestJSON-188051957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:18:23 devstack sudo[89251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:18:23 devstack sudo[89251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:18:24 devstack sudo[89252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:18:24 devstack sudo[89252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:18:24 devstack sudo[89252]: pam_unix(sudo:session): session closed for user root Jul 16 23:18:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-becddfd2-3bc5-4117-8a24-ff4861ea4440 tempest-DeleteServersTestJSON-188051957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.466s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:18:24 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-becddfd2-3bc5-4117-8a24-ff4861ea4440 tempest-DeleteServersTestJSON-188051957 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:18:24 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-becddfd2-3bc5-4117-8a24-ff4861ea4440 tempest-DeleteServersTestJSON-188051957 None] Deleted volume successfully. Jul 16 23:18:24 devstack sudo[89251]: pam_unix(sudo:session): session closed for user root Jul 16 23:18:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-78afdf79-d68d-4a36-b8ef-c1b5eab283bb tempest-VolumesAdminNegativeTest-647730517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.556s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:18:24 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-78afdf79-d68d-4a36-b8ef-c1b5eab283bb tempest-VolumesAdminNegativeTest-647730517 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:18:24 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-78afdf79-d68d-4a36-b8ef-c1b5eab283bb tempest-VolumesAdminNegativeTest-647730517 None] Deleted volume successfully. Jul 16 23:18:24 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-becddfd2-3bc5-4117-8a24-ff4861ea4440 tempest-DeleteServersTestJSON-188051957 None] Lock "cinder-3e873fe0-4725-4f68-8961-5d669d4f3db7-delete_volume" released by "delete_volume" :: held 3.341s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:18:24 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-78afdf79-d68d-4a36-b8ef-c1b5eab283bb tempest-VolumesAdminNegativeTest-647730517 None] Lock "cinder-9800c742-7546-413f-8722-2cd84ccc990b-delete_volume" released by "delete_volume" :: held 3.003s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:18:31 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ea220bb-9ace-4966-8dbe-8238b45bc3a2 tempest-ServerActionsTestOtherA-1552337055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:18:31 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0ea220bb-9ace-4966-8dbe-8238b45bc3a2 tempest-ServerActionsTestOtherA-1552337055 None] Flow 'volume_create_manager' (3942f0a3-f270-4fdf-9bc7-778f227b96b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:18:31 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0ea220bb-9ace-4966-8dbe-8238b45bc3a2 tempest-ServerActionsTestOtherA-1552337055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5de7a029-31ec-4700-bef7-6a80426fba9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:18:31 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0ea220bb-9ace-4966-8dbe-8238b45bc3a2 tempest-ServerActionsTestOtherA-1552337055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5de7a029-31ec-4700-bef7-6a80426fba9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-795059501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf4d72f5-eaa3-4eaf-bce5-e63582259844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eacc01b1271471eb65d2a06c1148386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:18:32Z,use_quota=True,user_id='138b9715af214c6eac0d6578bb4d75b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:18:31 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0ea220bb-9ace-4966-8dbe-8238b45bc3a2 tempest-ServerActionsTestOtherA-1552337055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e29d34-9bfc-4652-8daa-1ba4d008fe57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:18:31 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0ea220bb-9ace-4966-8dbe-8238b45bc3a2 tempest-ServerActionsTestOtherA-1552337055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e29d34-9bfc-4652-8daa-1ba4d008fe57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:18:31 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0ea220bb-9ace-4966-8dbe-8238b45bc3a2 tempest-ServerActionsTestOtherA-1552337055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf751b18-e990-4c2f-ac2d-b18aade40186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:18:31 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0ea220bb-9ace-4966-8dbe-8238b45bc3a2 tempest-ServerActionsTestOtherA-1552337055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf751b18-e990-4c2f-ac2d-b18aade40186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf4d72f5-eaa3-4eaf-bce5-e63582259844', 'volume_name': 'volume-cf4d72f5-eaa3-4eaf-bce5-e63582259844', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:18:31 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0ea220bb-9ace-4966-8dbe-8238b45bc3a2 tempest-ServerActionsTestOtherA-1552337055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (378561b8-1eab-4ea6-b6c4-616f483f2123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:18:31 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0ea220bb-9ace-4966-8dbe-8238b45bc3a2 tempest-ServerActionsTestOtherA-1552337055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (378561b8-1eab-4ea6-b6c4-616f483f2123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:18:32 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0ea220bb-9ace-4966-8dbe-8238b45bc3a2 tempest-ServerActionsTestOtherA-1552337055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac784fbf-c3c8-41ad-917d-369e3beac5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:18:32 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-0ea220bb-9ace-4966-8dbe-8238b45bc3a2 tempest-ServerActionsTestOtherA-1552337055 None] Volume cf4d72f5-eaa3-4eaf-bce5-e63582259844: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf4d72f5-eaa3-4eaf-bce5-e63582259844', 'volume_size': 1} Jul 16 23:18:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0ea220bb-9ace-4966-8dbe-8238b45bc3a2 tempest-ServerActionsTestOtherA-1552337055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:18:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0ea220bb-9ace-4966-8dbe-8238b45bc3a2 tempest-ServerActionsTestOtherA-1552337055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:18:32 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0ea220bb-9ace-4966-8dbe-8238b45bc3a2 tempest-ServerActionsTestOtherA-1552337055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-795059501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf4d72f5-eaa3-4eaf-bce5-e63582259844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eacc01b1271471eb65d2a06c1148386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:18:32Z,use_quota=True,user_id='138b9715af214c6eac0d6578bb4d75b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:18:32 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-0ea220bb-9ace-4966-8dbe-8238b45bc3a2 tempest-ServerActionsTestOtherA-1552337055 None] Creating volume cf4d72f5-eaa3-4eaf-bce5-e63582259844 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:18:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0ea220bb-9ace-4966-8dbe-8238b45bc3a2 tempest-ServerActionsTestOtherA-1552337055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:18:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0ea220bb-9ace-4966-8dbe-8238b45bc3a2 tempest-ServerActionsTestOtherA-1552337055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:18:32 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0ea220bb-9ace-4966-8dbe-8238b45bc3a2 tempest-ServerActionsTestOtherA-1552337055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:18:32 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0ea220bb-9ace-4966-8dbe-8238b45bc3a2 tempest-ServerActionsTestOtherA-1552337055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:18:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0ea220bb-9ace-4966-8dbe-8238b45bc3a2 tempest-ServerActionsTestOtherA-1552337055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:18:32 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0ea220bb-9ace-4966-8dbe-8238b45bc3a2 tempest-ServerActionsTestOtherA-1552337055 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:18:32 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-0ea220bb-9ace-4966-8dbe-8238b45bc3a2 tempest-ServerActionsTestOtherA-1552337055 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:18:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0ea220bb-9ace-4966-8dbe-8238b45bc3a2 tempest-ServerActionsTestOtherA-1552337055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cf4d72f5-eaa3-4eaf-bce5-e63582259844 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:18:32 devstack sudo[89326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cf4d72f5-eaa3-4eaf-bce5-e63582259844 1073741824 Jul 16 23:18:32 devstack sudo[89326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:18:32 devstack sudo[89326]: pam_unix(sudo:session): session closed for user root Jul 16 23:18:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0ea220bb-9ace-4966-8dbe-8238b45bc3a2 tempest-ServerActionsTestOtherA-1552337055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cf4d72f5-eaa3-4eaf-bce5-e63582259844 1073741824" returned: 0 in 0.531s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:18:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0ea220bb-9ace-4966-8dbe-8238b45bc3a2 tempest-ServerActionsTestOtherA-1552337055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cf4d72f5-eaa3-4eaf-bce5-e63582259844 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:18:32 devstack sudo[89332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cf4d72f5-eaa3-4eaf-bce5-e63582259844 Jul 16 23:18:32 devstack sudo[89332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:18:32 devstack sudo[89332]: pam_unix(sudo:session): session closed for user root Jul 16 23:18:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0ea220bb-9ace-4966-8dbe-8238b45bc3a2 tempest-ServerActionsTestOtherA-1552337055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cf4d72f5-eaa3-4eaf-bce5-e63582259844" returned: 0 in 0.256s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:18:32 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0ea220bb-9ace-4966-8dbe-8238b45bc3a2 tempest-ServerActionsTestOtherA-1552337055 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:18:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0ea220bb-9ace-4966-8dbe-8238b45bc3a2 tempest-ServerActionsTestOtherA-1552337055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:18:32 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0ea220bb-9ace-4966-8dbe-8238b45bc3a2 tempest-ServerActionsTestOtherA-1552337055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac784fbf-c3c8-41ad-917d-369e3beac5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf4d72f5-eaa3-4eaf-bce5-e63582259844', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:18:32 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0ea220bb-9ace-4966-8dbe-8238b45bc3a2 tempest-ServerActionsTestOtherA-1552337055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f366e237-2b16-444a-9bf6-7acdf9003666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:18:32 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-0ea220bb-9ace-4966-8dbe-8238b45bc3a2 tempest-ServerActionsTestOtherA-1552337055 None] Volume volume-cf4d72f5-eaa3-4eaf-bce5-e63582259844 (cf4d72f5-eaa3-4eaf-bce5-e63582259844): created successfully Jul 16 23:18:32 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0ea220bb-9ace-4966-8dbe-8238b45bc3a2 tempest-ServerActionsTestOtherA-1552337055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f366e237-2b16-444a-9bf6-7acdf9003666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:18:32 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0ea220bb-9ace-4966-8dbe-8238b45bc3a2 tempest-ServerActionsTestOtherA-1552337055 None] Flow 'volume_create_manager' (3942f0a3-f270-4fdf-9bc7-778f227b96b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:18:32 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-0ea220bb-9ace-4966-8dbe-8238b45bc3a2 tempest-ServerActionsTestOtherA-1552337055 None] Created volume successfully. Jul 16 23:18:39 devstack cinder-volume[87607]: DEBUG oslo_service.periodic_task [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:18:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:18:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:18:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:18:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:18:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:18:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:18:39 devstack sudo[89348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:18:39 devstack sudo[89348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:18:39 devstack sudo[89348]: pam_unix(sudo:session): session closed for user root Jul 16 23:18:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.321s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:18:39 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:18:39 devstack cinder-volume[87607]: DEBUG oslo_service.periodic_task [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running periodic task VolumeManager._thread_info {{(pid=87607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:18:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] thread count: 8 {{(pid=87607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 23:18:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] thread info: [<_MainThread(MainThread, started 139090403627136)>, , , , , , , ] {{(pid=87607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 23:18:42 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:SELECT=24,cinder:INSERT=7,cinder:UPDATE=23,cinder:DELETE=2 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:18:42 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:UPDATE=30,cinder:SELECT=23,cinder:DELETE=3,cinder:INSERT=4 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:19:02 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:SELECT=1 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:19:02 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:UPDATE=1 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:19:12 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-406caa98-b232-4139-9e07-d90a2bb4b71c tempest-ServerRescueNegativeTestJSON-1168936509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:19:12 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-406caa98-b232-4139-9e07-d90a2bb4b71c tempest-ServerRescueNegativeTestJSON-1168936509 None] Flow 'volume_create_manager' (3ca78a84-3b99-41b2-983d-a329dceb2f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:19:12 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-406caa98-b232-4139-9e07-d90a2bb4b71c tempest-ServerRescueNegativeTestJSON-1168936509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3d10052-d818-4b59-902b-38c0e2f2c0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:19:12 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-406caa98-b232-4139-9e07-d90a2bb4b71c tempest-ServerRescueNegativeTestJSON-1168936509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3d10052-d818-4b59-902b-38c0e2f2c0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-535938324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fc9c202-53e7-49c8-a6ba-6d042cb3c6ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f54df9dd537a4fb481debe9d0a0a9742',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:19:12Z,use_quota=True,user_id='d6dd338307b44fdab0e16d33f4e6629d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:19:12 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-406caa98-b232-4139-9e07-d90a2bb4b71c tempest-ServerRescueNegativeTestJSON-1168936509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbcfaeb9-9935-4e7e-9870-a108e7a777d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:19:12 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-406caa98-b232-4139-9e07-d90a2bb4b71c tempest-ServerRescueNegativeTestJSON-1168936509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbcfaeb9-9935-4e7e-9870-a108e7a777d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:19:12 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-406caa98-b232-4139-9e07-d90a2bb4b71c tempest-ServerRescueNegativeTestJSON-1168936509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3defd789-72e0-4599-9c93-78b279515b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:19:12 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-406caa98-b232-4139-9e07-d90a2bb4b71c tempest-ServerRescueNegativeTestJSON-1168936509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3defd789-72e0-4599-9c93-78b279515b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fc9c202-53e7-49c8-a6ba-6d042cb3c6ce', 'volume_name': 'volume-2fc9c202-53e7-49c8-a6ba-6d042cb3c6ce', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:19:12 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-406caa98-b232-4139-9e07-d90a2bb4b71c tempest-ServerRescueNegativeTestJSON-1168936509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d07bf855-04f7-473d-87c2-411470e0a1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:19:12 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-406caa98-b232-4139-9e07-d90a2bb4b71c tempest-ServerRescueNegativeTestJSON-1168936509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d07bf855-04f7-473d-87c2-411470e0a1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:19:12 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-406caa98-b232-4139-9e07-d90a2bb4b71c tempest-ServerRescueNegativeTestJSON-1168936509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe52c1e4-1d96-4edb-959b-7c77522e5ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:19:12 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-406caa98-b232-4139-9e07-d90a2bb4b71c tempest-ServerRescueNegativeTestJSON-1168936509 None] Volume 2fc9c202-53e7-49c8-a6ba-6d042cb3c6ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fc9c202-53e7-49c8-a6ba-6d042cb3c6ce', 'volume_size': 1} Jul 16 23:19:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-406caa98-b232-4139-9e07-d90a2bb4b71c tempest-ServerRescueNegativeTestJSON-1168936509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:19:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-406caa98-b232-4139-9e07-d90a2bb4b71c tempest-ServerRescueNegativeTestJSON-1168936509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:19:12 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-406caa98-b232-4139-9e07-d90a2bb4b71c tempest-ServerRescueNegativeTestJSON-1168936509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-535938324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fc9c202-53e7-49c8-a6ba-6d042cb3c6ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f54df9dd537a4fb481debe9d0a0a9742',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:19:12Z,use_quota=True,user_id='d6dd338307b44fdab0e16d33f4e6629d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:19:12 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-406caa98-b232-4139-9e07-d90a2bb4b71c tempest-ServerRescueNegativeTestJSON-1168936509 None] Creating volume 2fc9c202-53e7-49c8-a6ba-6d042cb3c6ce {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:19:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-406caa98-b232-4139-9e07-d90a2bb4b71c tempest-ServerRescueNegativeTestJSON-1168936509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:19:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-406caa98-b232-4139-9e07-d90a2bb4b71c tempest-ServerRescueNegativeTestJSON-1168936509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:19:12 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-406caa98-b232-4139-9e07-d90a2bb4b71c tempest-ServerRescueNegativeTestJSON-1168936509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:19:12 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-406caa98-b232-4139-9e07-d90a2bb4b71c tempest-ServerRescueNegativeTestJSON-1168936509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:19:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-406caa98-b232-4139-9e07-d90a2bb4b71c tempest-ServerRescueNegativeTestJSON-1168936509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:19:12 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-406caa98-b232-4139-9e07-d90a2bb4b71c tempest-ServerRescueNegativeTestJSON-1168936509 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:19:12 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-406caa98-b232-4139-9e07-d90a2bb4b71c tempest-ServerRescueNegativeTestJSON-1168936509 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:19:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-406caa98-b232-4139-9e07-d90a2bb4b71c tempest-ServerRescueNegativeTestJSON-1168936509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc9c202-53e7-49c8-a6ba-6d042cb3c6ce 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:19:12 devstack sudo[89741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc9c202-53e7-49c8-a6ba-6d042cb3c6ce 1073741824 Jul 16 23:19:12 devstack sudo[89741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:19:13 devstack sudo[89741]: pam_unix(sudo:session): session closed for user root Jul 16 23:19:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-406caa98-b232-4139-9e07-d90a2bb4b71c tempest-ServerRescueNegativeTestJSON-1168936509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc9c202-53e7-49c8-a6ba-6d042cb3c6ce 1073741824" returned: 0 in 0.905s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:19:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-406caa98-b232-4139-9e07-d90a2bb4b71c tempest-ServerRescueNegativeTestJSON-1168936509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc9c202-53e7-49c8-a6ba-6d042cb3c6ce {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:19:13 devstack sudo[89747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc9c202-53e7-49c8-a6ba-6d042cb3c6ce Jul 16 23:19:13 devstack sudo[89747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:19:14 devstack sudo[89747]: pam_unix(sudo:session): session closed for user root Jul 16 23:19:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-406caa98-b232-4139-9e07-d90a2bb4b71c tempest-ServerRescueNegativeTestJSON-1168936509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc9c202-53e7-49c8-a6ba-6d042cb3c6ce" returned: 0 in 0.705s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:19:14 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-406caa98-b232-4139-9e07-d90a2bb4b71c tempest-ServerRescueNegativeTestJSON-1168936509 None] <== create_volume: return (1712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:19:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-406caa98-b232-4139-9e07-d90a2bb4b71c tempest-ServerRescueNegativeTestJSON-1168936509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.717s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:19:14 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-406caa98-b232-4139-9e07-d90a2bb4b71c tempest-ServerRescueNegativeTestJSON-1168936509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe52c1e4-1d96-4edb-959b-7c77522e5ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fc9c202-53e7-49c8-a6ba-6d042cb3c6ce', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:19:14 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-406caa98-b232-4139-9e07-d90a2bb4b71c tempest-ServerRescueNegativeTestJSON-1168936509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abb41025-c94e-4777-8ca2-dff2bb4a156a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:19:14 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-406caa98-b232-4139-9e07-d90a2bb4b71c tempest-ServerRescueNegativeTestJSON-1168936509 None] Volume volume-2fc9c202-53e7-49c8-a6ba-6d042cb3c6ce (2fc9c202-53e7-49c8-a6ba-6d042cb3c6ce): created successfully Jul 16 23:19:14 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-406caa98-b232-4139-9e07-d90a2bb4b71c tempest-ServerRescueNegativeTestJSON-1168936509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abb41025-c94e-4777-8ca2-dff2bb4a156a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:19:14 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-406caa98-b232-4139-9e07-d90a2bb4b71c tempest-ServerRescueNegativeTestJSON-1168936509 None] Flow 'volume_create_manager' (3ca78a84-3b99-41b2-983d-a329dceb2f61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:19:14 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-406caa98-b232-4139-9e07-d90a2bb4b71c tempest-ServerRescueNegativeTestJSON-1168936509 None] Created volume successfully. Jul 16 23:19:24 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:19:24 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:19:30 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6b98aefb-fcc1-42a3-949a-01c3458b3873 tempest-ServerRescueNegativeTestJSON-1168936509 None] Acquiring lock "cinder-2fc9c202-53e7-49c8-a6ba-6d042cb3c6ce-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:19:30 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6b98aefb-fcc1-42a3-949a-01c3458b3873 tempest-ServerRescueNegativeTestJSON-1168936509 None] Lock "cinder-2fc9c202-53e7-49c8-a6ba-6d042cb3c6ce-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:19:30 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6b98aefb-fcc1-42a3-949a-01c3458b3873 tempest-ServerRescueNegativeTestJSON-1168936509 None] Acquiring lock "cinder-quobyte-2fc9c202-53e7-49c8-a6ba-6d042cb3c6ce" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:19:30 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6b98aefb-fcc1-42a3-949a-01c3458b3873 tempest-ServerRescueNegativeTestJSON-1168936509 None] Lock "cinder-quobyte-2fc9c202-53e7-49c8-a6ba-6d042cb3c6ce" acquired by "delete_volume" :: waited 0.044s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:19:30 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a947c5-ead7-45f4-8371-0fc12571c0f4]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:19:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6b98aefb-fcc1-42a3-949a-01c3458b3873 tempest-ServerRescueNegativeTestJSON-1168936509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc9c202-53e7-49c8-a6ba-6d042cb3c6ce {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:19:31 devstack sudo[89920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc9c202-53e7-49c8-a6ba-6d042cb3c6ce Jul 16 23:19:31 devstack sudo[89920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:19:31 devstack sudo[89920]: pam_unix(sudo:session): session closed for user root Jul 16 23:19:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6b98aefb-fcc1-42a3-949a-01c3458b3873 tempest-ServerRescueNegativeTestJSON-1168936509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc9c202-53e7-49c8-a6ba-6d042cb3c6ce" returned: 0 in 0.751s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:19:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6b98aefb-fcc1-42a3-949a-01c3458b3873 tempest-ServerRescueNegativeTestJSON-1168936509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc9c202-53e7-49c8-a6ba-6d042cb3c6ce {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:19:31 devstack sudo[89963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc9c202-53e7-49c8-a6ba-6d042cb3c6ce Jul 16 23:19:31 devstack sudo[89963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:19:32 devstack sudo[89963]: pam_unix(sudo:session): session closed for user root Jul 16 23:19:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6b98aefb-fcc1-42a3-949a-01c3458b3873 tempest-ServerRescueNegativeTestJSON-1168936509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc9c202-53e7-49c8-a6ba-6d042cb3c6ce" returned: 0 in 0.453s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:19:32 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6b98aefb-fcc1-42a3-949a-01c3458b3873 tempest-ServerRescueNegativeTestJSON-1168936509 None] Lock "cinder-quobyte-2fc9c202-53e7-49c8-a6ba-6d042cb3c6ce" released by "delete_volume" :: held 1.294s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:19:32 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-6b98aefb-fcc1-42a3-949a-01c3458b3873 tempest-ServerRescueNegativeTestJSON-1168936509 None] Created reservations ['478647ac-f7e7-4d57-8fab-f990f3b88ecf', '17921e99-c370-4121-826c-b57d5fb7fc9c', 'b184760d-d1ca-4571-9814-f640bae7fd1e', '5d6ff9be-31f8-4b4f-a508-8c0b977de453'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:19:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6b98aefb-fcc1-42a3-949a-01c3458b3873 tempest-ServerRescueNegativeTestJSON-1168936509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:19:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6b98aefb-fcc1-42a3-949a-01c3458b3873 tempest-ServerRescueNegativeTestJSON-1168936509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:19:32 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-6b98aefb-fcc1-42a3-949a-01c3458b3873 tempest-ServerRescueNegativeTestJSON-1168936509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:19:32 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-6b98aefb-fcc1-42a3-949a-01c3458b3873 tempest-ServerRescueNegativeTestJSON-1168936509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:19:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6b98aefb-fcc1-42a3-949a-01c3458b3873 tempest-ServerRescueNegativeTestJSON-1168936509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:19:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6b98aefb-fcc1-42a3-949a-01c3458b3873 tempest-ServerRescueNegativeTestJSON-1168936509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:19:32 devstack sudo[89989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:19:32 devstack sudo[89989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:19:32 devstack sudo[89989]: pam_unix(sudo:session): session closed for user root Jul 16 23:19:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6b98aefb-fcc1-42a3-949a-01c3458b3873 tempest-ServerRescueNegativeTestJSON-1168936509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.381s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:19:32 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-6b98aefb-fcc1-42a3-949a-01c3458b3873 tempest-ServerRescueNegativeTestJSON-1168936509 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:19:32 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-6b98aefb-fcc1-42a3-949a-01c3458b3873 tempest-ServerRescueNegativeTestJSON-1168936509 None] Deleted volume successfully. Jul 16 23:19:32 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6b98aefb-fcc1-42a3-949a-01c3458b3873 tempest-ServerRescueNegativeTestJSON-1168936509 None] Lock "cinder-2fc9c202-53e7-49c8-a6ba-6d042cb3c6ce-delete_volume" released by "delete_volume" :: held 2.089s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:19:39 devstack cinder-volume[87607]: DEBUG oslo_service.periodic_task [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:19:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:19:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:19:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:19:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:19:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:19:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:19:39 devstack sudo[90050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:19:39 devstack sudo[90050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:19:39 devstack sudo[90050]: pam_unix(sudo:session): session closed for user root Jul 16 23:19:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.403s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:19:39 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:19:42 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:UPDATE=10,cinder:SELECT=4,cinder:INSERT=1 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:19:42 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:19:42 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-e76ed609-bc64-4d8c-8886-9c8c62a83b80 tempest-TaggedAttachmentsTest-803724708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:19:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e76ed609-bc64-4d8c-8886-9c8c62a83b80 tempest-TaggedAttachmentsTest-803724708 None] Flow 'volume_create_manager' (287199b8-19dd-4041-9acc-f43067207404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:19:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e76ed609-bc64-4d8c-8886-9c8c62a83b80 tempest-TaggedAttachmentsTest-803724708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9de5ada-465f-47ae-9971-68173142713e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:19:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e76ed609-bc64-4d8c-8886-9c8c62a83b80 tempest-TaggedAttachmentsTest-803724708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9de5ada-465f-47ae-9971-68173142713e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1801733606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5133854c-5f40-453d-81f2-2ef2186ddd77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d07fb78ddf4e424cabd5cb702c56626e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:19:43Z,use_quota=True,user_id='142947f38f614c729851e5d36e5dcf5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:19:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e76ed609-bc64-4d8c-8886-9c8c62a83b80 tempest-TaggedAttachmentsTest-803724708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e66307d-d24e-4bdd-8462-edd342328eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:19:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e76ed609-bc64-4d8c-8886-9c8c62a83b80 tempest-TaggedAttachmentsTest-803724708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e66307d-d24e-4bdd-8462-edd342328eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:19:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e76ed609-bc64-4d8c-8886-9c8c62a83b80 tempest-TaggedAttachmentsTest-803724708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acfd6d5d-d610-43ca-bdd7-622de8fccfb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:19:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e76ed609-bc64-4d8c-8886-9c8c62a83b80 tempest-TaggedAttachmentsTest-803724708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acfd6d5d-d610-43ca-bdd7-622de8fccfb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5133854c-5f40-453d-81f2-2ef2186ddd77', 'volume_name': 'volume-5133854c-5f40-453d-81f2-2ef2186ddd77', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:19:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e76ed609-bc64-4d8c-8886-9c8c62a83b80 tempest-TaggedAttachmentsTest-803724708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b57178e-0026-40f6-ad35-f03d10274488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:19:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e76ed609-bc64-4d8c-8886-9c8c62a83b80 tempest-TaggedAttachmentsTest-803724708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b57178e-0026-40f6-ad35-f03d10274488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:19:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e76ed609-bc64-4d8c-8886-9c8c62a83b80 tempest-TaggedAttachmentsTest-803724708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be396f1a-5487-4241-9444-169a4e0e2971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:19:42 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-e76ed609-bc64-4d8c-8886-9c8c62a83b80 tempest-TaggedAttachmentsTest-803724708 None] Volume 5133854c-5f40-453d-81f2-2ef2186ddd77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5133854c-5f40-453d-81f2-2ef2186ddd77', 'volume_size': 1} Jul 16 23:19:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e76ed609-bc64-4d8c-8886-9c8c62a83b80 tempest-TaggedAttachmentsTest-803724708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:19:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e76ed609-bc64-4d8c-8886-9c8c62a83b80 tempest-TaggedAttachmentsTest-803724708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:19:42 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e76ed609-bc64-4d8c-8886-9c8c62a83b80 tempest-TaggedAttachmentsTest-803724708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1801733606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5133854c-5f40-453d-81f2-2ef2186ddd77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d07fb78ddf4e424cabd5cb702c56626e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:19:43Z,use_quota=True,user_id='142947f38f614c729851e5d36e5dcf5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:19:42 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-e76ed609-bc64-4d8c-8886-9c8c62a83b80 tempest-TaggedAttachmentsTest-803724708 None] Creating volume 5133854c-5f40-453d-81f2-2ef2186ddd77 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:19:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e76ed609-bc64-4d8c-8886-9c8c62a83b80 tempest-TaggedAttachmentsTest-803724708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:19:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e76ed609-bc64-4d8c-8886-9c8c62a83b80 tempest-TaggedAttachmentsTest-803724708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:19:42 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e76ed609-bc64-4d8c-8886-9c8c62a83b80 tempest-TaggedAttachmentsTest-803724708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:19:42 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e76ed609-bc64-4d8c-8886-9c8c62a83b80 tempest-TaggedAttachmentsTest-803724708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:19:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e76ed609-bc64-4d8c-8886-9c8c62a83b80 tempest-TaggedAttachmentsTest-803724708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:19:42 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e76ed609-bc64-4d8c-8886-9c8c62a83b80 tempest-TaggedAttachmentsTest-803724708 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:19:42 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-e76ed609-bc64-4d8c-8886-9c8c62a83b80 tempest-TaggedAttachmentsTest-803724708 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:19:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e76ed609-bc64-4d8c-8886-9c8c62a83b80 tempest-TaggedAttachmentsTest-803724708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5133854c-5f40-453d-81f2-2ef2186ddd77 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:19:42 devstack sudo[90062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5133854c-5f40-453d-81f2-2ef2186ddd77 1073741824 Jul 16 23:19:42 devstack sudo[90062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:19:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-6ede297e-68b4-4889-9cf3-3ec7e88aeaf3 req-f1ec8305-96f4-47ef-ad20-4760608e6f0f tempest-ServerActionsTestOtherA-1552337055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:19:43 devstack sudo[90062]: pam_unix(sudo:session): session closed for user root Jul 16 23:19:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e76ed609-bc64-4d8c-8886-9c8c62a83b80 tempest-TaggedAttachmentsTest-803724708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5133854c-5f40-453d-81f2-2ef2186ddd77 1073741824" returned: 0 in 0.518s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:19:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e76ed609-bc64-4d8c-8886-9c8c62a83b80 tempest-TaggedAttachmentsTest-803724708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5133854c-5f40-453d-81f2-2ef2186ddd77 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:19:43 devstack sudo[90076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5133854c-5f40-453d-81f2-2ef2186ddd77 Jul 16 23:19:43 devstack sudo[90076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:19:43 devstack sudo[90076]: pam_unix(sudo:session): session closed for user root Jul 16 23:19:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e76ed609-bc64-4d8c-8886-9c8c62a83b80 tempest-TaggedAttachmentsTest-803724708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5133854c-5f40-453d-81f2-2ef2186ddd77" returned: 0 in 0.303s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:19:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e76ed609-bc64-4d8c-8886-9c8c62a83b80 tempest-TaggedAttachmentsTest-803724708 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:19:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e76ed609-bc64-4d8c-8886-9c8c62a83b80 tempest-TaggedAttachmentsTest-803724708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:19:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-6ede297e-68b4-4889-9cf3-3ec7e88aeaf3 req-f1ec8305-96f4-47ef-ad20-4760608e6f0f tempest-ServerActionsTestOtherA-1552337055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.386s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:19:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-6ede297e-68b4-4889-9cf3-3ec7e88aeaf3 req-f1ec8305-96f4-47ef-ad20-4760608e6f0f tempest-ServerActionsTestOtherA-1552337055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:19:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e76ed609-bc64-4d8c-8886-9c8c62a83b80 tempest-TaggedAttachmentsTest-803724708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be396f1a-5487-4241-9444-169a4e0e2971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5133854c-5f40-453d-81f2-2ef2186ddd77', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:19:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e76ed609-bc64-4d8c-8886-9c8c62a83b80 tempest-TaggedAttachmentsTest-803724708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82285b05-4918-43f1-b23a-0342f03ab484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:19:43 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-e76ed609-bc64-4d8c-8886-9c8c62a83b80 tempest-TaggedAttachmentsTest-803724708 None] Volume volume-5133854c-5f40-453d-81f2-2ef2186ddd77 (5133854c-5f40-453d-81f2-2ef2186ddd77): created successfully Jul 16 23:19:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e76ed609-bc64-4d8c-8886-9c8c62a83b80 tempest-TaggedAttachmentsTest-803724708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82285b05-4918-43f1-b23a-0342f03ab484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:19:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e76ed609-bc64-4d8c-8886-9c8c62a83b80 tempest-TaggedAttachmentsTest-803724708 None] Flow 'volume_create_manager' (287199b8-19dd-4041-9acc-f43067207404) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:19:43 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-e76ed609-bc64-4d8c-8886-9c8c62a83b80 tempest-TaggedAttachmentsTest-803724708 None] Created volume successfully. Jul 16 23:19:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-6ede297e-68b4-4889-9cf3-3ec7e88aeaf3 req-f1ec8305-96f4-47ef-ad20-4760608e6f0f tempest-ServerActionsTestOtherA-1552337055 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72', 'name': 'volume-cf4d72f5-eaa3-4eaf-bce5-e63582259844', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '75c24c2c-4899-43fe-bdfe-1e57603881b4', 'enforce_multipath': True} {{(pid=87607) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 23:19:43 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-6ede297e-68b4-4889-9cf3-3ec7e88aeaf3 req-f1ec8305-96f4-47ef-ad20-4760608e6f0f tempest-ServerActionsTestOtherA-1552337055 None] attachment_update completed successfully. Jul 16 23:19:47 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-d78cddf8-750f-42db-a64e-b3ad67204fab req-b406b4be-e843-4a05-8e06-76ad02d226d3 tempest-ServerActionsTestOtherA-1552337055 None] Terminate volume connection completed successfully. Jul 16 23:19:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-d78cddf8-750f-42db-a64e-b3ad67204fab req-b406b4be-e843-4a05-8e06-76ad02d226d3 tempest-ServerActionsTestOtherA-1552337055 None] Deleting attachment 75c24c2c-4899-43fe-bdfe-1e57603881b4. {{(pid=87607) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 23:19:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-d78cddf8-750f-42db-a64e-b3ad67204fab req-ff80b73a-356d-4c8e-bcf6-8aaa22d81803 tempest-ServerActionsTestOtherA-1552337055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:19:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-d78cddf8-750f-42db-a64e-b3ad67204fab req-ff80b73a-356d-4c8e-bcf6-8aaa22d81803 tempest-ServerActionsTestOtherA-1552337055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:19:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-d78cddf8-750f-42db-a64e-b3ad67204fab req-ff80b73a-356d-4c8e-bcf6-8aaa22d81803 tempest-ServerActionsTestOtherA-1552337055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:19:48 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-d78cddf8-750f-42db-a64e-b3ad67204fab req-ff80b73a-356d-4c8e-bcf6-8aaa22d81803 tempest-ServerActionsTestOtherA-1552337055 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72', 'name': 'volume-cf4d72f5-eaa3-4eaf-bce5-e63582259844', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'de25f604-b424-4d80-9e3e-22eb151f0ac8', 'enforce_multipath': True} {{(pid=87607) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 23:19:48 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-d78cddf8-750f-42db-a64e-b3ad67204fab req-ff80b73a-356d-4c8e-bcf6-8aaa22d81803 tempest-ServerActionsTestOtherA-1552337055 None] attachment_update completed successfully. Jul 16 23:19:52 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-40db36d4-5459-4010-bdf5-ded6c70093ca tempest-AttachVolumeShelveTestJSON-180929086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:19:53 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-40db36d4-5459-4010-bdf5-ded6c70093ca tempest-AttachVolumeShelveTestJSON-180929086 None] Flow 'volume_create_manager' (8f75d363-e4b0-45d4-b087-860b49fac7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:19:53 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-40db36d4-5459-4010-bdf5-ded6c70093ca tempest-AttachVolumeShelveTestJSON-180929086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de698593-d3ae-42ca-94c8-8c1ca95de4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:19:53 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-40db36d4-5459-4010-bdf5-ded6c70093ca tempest-AttachVolumeShelveTestJSON-180929086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de698593-d3ae-42ca-94c8-8c1ca95de4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2013431268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e9637b4-d3f3-4ffd-b3e3-e3dd26d240c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19ad9056d69a43918fa965be0e58b3c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:19:53Z,use_quota=True,user_id='980d25a587974530a7ec72b95763cc63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:19:53 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-40db36d4-5459-4010-bdf5-ded6c70093ca tempest-AttachVolumeShelveTestJSON-180929086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (678c46ff-df92-4e13-b847-23a7cb68b037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:19:53 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-40db36d4-5459-4010-bdf5-ded6c70093ca tempest-AttachVolumeShelveTestJSON-180929086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (678c46ff-df92-4e13-b847-23a7cb68b037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:19:53 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-40db36d4-5459-4010-bdf5-ded6c70093ca tempest-AttachVolumeShelveTestJSON-180929086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e3406fa-ec78-4713-849a-ed82218cc935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:19:53 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-40db36d4-5459-4010-bdf5-ded6c70093ca tempest-AttachVolumeShelveTestJSON-180929086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e3406fa-ec78-4713-849a-ed82218cc935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e9637b4-d3f3-4ffd-b3e3-e3dd26d240c8', 'volume_name': 'volume-3e9637b4-d3f3-4ffd-b3e3-e3dd26d240c8', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:19:53 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-40db36d4-5459-4010-bdf5-ded6c70093ca tempest-AttachVolumeShelveTestJSON-180929086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8162d25-1b39-4671-be73-b8fb4be21c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:19:53 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-40db36d4-5459-4010-bdf5-ded6c70093ca tempest-AttachVolumeShelveTestJSON-180929086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8162d25-1b39-4671-be73-b8fb4be21c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:19:53 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-40db36d4-5459-4010-bdf5-ded6c70093ca tempest-AttachVolumeShelveTestJSON-180929086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75193285-5c92-458f-85f4-36756a1315b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:19:53 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-40db36d4-5459-4010-bdf5-ded6c70093ca tempest-AttachVolumeShelveTestJSON-180929086 None] Volume 3e9637b4-d3f3-4ffd-b3e3-e3dd26d240c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e9637b4-d3f3-4ffd-b3e3-e3dd26d240c8', 'volume_size': 1} Jul 16 23:19:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-40db36d4-5459-4010-bdf5-ded6c70093ca tempest-AttachVolumeShelveTestJSON-180929086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:19:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-40db36d4-5459-4010-bdf5-ded6c70093ca tempest-AttachVolumeShelveTestJSON-180929086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:19:53 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-40db36d4-5459-4010-bdf5-ded6c70093ca tempest-AttachVolumeShelveTestJSON-180929086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2013431268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e9637b4-d3f3-4ffd-b3e3-e3dd26d240c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19ad9056d69a43918fa965be0e58b3c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:19:53Z,use_quota=True,user_id='980d25a587974530a7ec72b95763cc63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:19:53 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-40db36d4-5459-4010-bdf5-ded6c70093ca tempest-AttachVolumeShelveTestJSON-180929086 None] Creating volume 3e9637b4-d3f3-4ffd-b3e3-e3dd26d240c8 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:19:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-40db36d4-5459-4010-bdf5-ded6c70093ca tempest-AttachVolumeShelveTestJSON-180929086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:19:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-40db36d4-5459-4010-bdf5-ded6c70093ca tempest-AttachVolumeShelveTestJSON-180929086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:19:53 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-40db36d4-5459-4010-bdf5-ded6c70093ca tempest-AttachVolumeShelveTestJSON-180929086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:19:53 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-40db36d4-5459-4010-bdf5-ded6c70093ca tempest-AttachVolumeShelveTestJSON-180929086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:19:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-40db36d4-5459-4010-bdf5-ded6c70093ca tempest-AttachVolumeShelveTestJSON-180929086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:19:53 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-40db36d4-5459-4010-bdf5-ded6c70093ca tempest-AttachVolumeShelveTestJSON-180929086 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:19:53 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-40db36d4-5459-4010-bdf5-ded6c70093ca tempest-AttachVolumeShelveTestJSON-180929086 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:19:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-40db36d4-5459-4010-bdf5-ded6c70093ca tempest-AttachVolumeShelveTestJSON-180929086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e9637b4-d3f3-4ffd-b3e3-e3dd26d240c8 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:19:53 devstack sudo[91015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e9637b4-d3f3-4ffd-b3e3-e3dd26d240c8 1073741824 Jul 16 23:19:53 devstack sudo[91015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:19:53 devstack sudo[91015]: pam_unix(sudo:session): session closed for user root Jul 16 23:19:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-40db36d4-5459-4010-bdf5-ded6c70093ca tempest-AttachVolumeShelveTestJSON-180929086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e9637b4-d3f3-4ffd-b3e3-e3dd26d240c8 1073741824" returned: 0 in 0.609s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:19:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-40db36d4-5459-4010-bdf5-ded6c70093ca tempest-AttachVolumeShelveTestJSON-180929086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e9637b4-d3f3-4ffd-b3e3-e3dd26d240c8 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:19:53 devstack sudo[91021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e9637b4-d3f3-4ffd-b3e3-e3dd26d240c8 Jul 16 23:19:53 devstack sudo[91021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:19:54 devstack sudo[91021]: pam_unix(sudo:session): session closed for user root Jul 16 23:19:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-40db36d4-5459-4010-bdf5-ded6c70093ca tempest-AttachVolumeShelveTestJSON-180929086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e9637b4-d3f3-4ffd-b3e3-e3dd26d240c8" returned: 0 in 0.300s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:19:54 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-40db36d4-5459-4010-bdf5-ded6c70093ca tempest-AttachVolumeShelveTestJSON-180929086 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:19:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-40db36d4-5459-4010-bdf5-ded6c70093ca tempest-AttachVolumeShelveTestJSON-180929086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:19:54 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-40db36d4-5459-4010-bdf5-ded6c70093ca tempest-AttachVolumeShelveTestJSON-180929086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75193285-5c92-458f-85f4-36756a1315b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e9637b4-d3f3-4ffd-b3e3-e3dd26d240c8', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:19:54 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-40db36d4-5459-4010-bdf5-ded6c70093ca tempest-AttachVolumeShelveTestJSON-180929086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50bbac26-e89a-48d5-a627-6af6a5e91f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:19:54 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-40db36d4-5459-4010-bdf5-ded6c70093ca tempest-AttachVolumeShelveTestJSON-180929086 None] Volume volume-3e9637b4-d3f3-4ffd-b3e3-e3dd26d240c8 (3e9637b4-d3f3-4ffd-b3e3-e3dd26d240c8): created successfully Jul 16 23:19:54 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-40db36d4-5459-4010-bdf5-ded6c70093ca tempest-AttachVolumeShelveTestJSON-180929086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50bbac26-e89a-48d5-a627-6af6a5e91f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:19:54 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-40db36d4-5459-4010-bdf5-ded6c70093ca tempest-AttachVolumeShelveTestJSON-180929086 None] Flow 'volume_create_manager' (8f75d363-e4b0-45d4-b087-860b49fac7ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:19:54 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-40db36d4-5459-4010-bdf5-ded6c70093ca tempest-AttachVolumeShelveTestJSON-180929086 None] Created volume successfully. Jul 16 23:20:04 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:SELECT=18,cinder:UPDATE=7,cinder:INSERT=1 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:20:04 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:SELECT=18,cinder:UPDATE=11,cinder:INSERT=1,cinder:DELETE=2 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:20:10 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-d0dd0289-c261-4268-a7a2-11014d34561b req-e541c5f6-7666-4078-91e1-196ffaf55254 tempest-AttachVolumeShelveTestJSON-180929086 None] No connector for attachment d6ae9a02-fae7-44f6-a4b7-64caebc3d6d5; skipping storage backend terminate_connection call. {{(pid=87607) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 16 23:20:10 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-d0dd0289-c261-4268-a7a2-11014d34561b req-e541c5f6-7666-4078-91e1-196ffaf55254 tempest-AttachVolumeShelveTestJSON-180929086 None] Deleting attachment d6ae9a02-fae7-44f6-a4b7-64caebc3d6d5. {{(pid=87607) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 23:20:20 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:SELECT=2 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:20:20 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-ba5455cf-55ce-4654-b171-ae7b3e43370a req-7a30bb5c-c2f8-4391-9d37-dd93b2df29d6 tempest-ServerActionsTestOtherA-1552337055 None] Terminate volume connection completed successfully. Jul 16 23:20:20 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-ba5455cf-55ce-4654-b171-ae7b3e43370a req-7a30bb5c-c2f8-4391-9d37-dd93b2df29d6 tempest-ServerActionsTestOtherA-1552337055 None] Deleting attachment de25f604-b424-4d80-9e3e-22eb151f0ac8. {{(pid=87607) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 23:20:30 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:SELECT=2 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:20:32 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-5f5d04c6-29cd-48cb-8038-70d750e1d920 tempest-ServerActionsTestOtherA-1552337055 None] Acquiring lock "cinder-cf4d72f5-eaa3-4eaf-bce5-e63582259844-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:20:32 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-5f5d04c6-29cd-48cb-8038-70d750e1d920 tempest-ServerActionsTestOtherA-1552337055 None] Lock "cinder-cf4d72f5-eaa3-4eaf-bce5-e63582259844-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:20:32 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-5f5d04c6-29cd-48cb-8038-70d750e1d920 tempest-ServerActionsTestOtherA-1552337055 None] Acquiring lock "cinder-quobyte-cf4d72f5-eaa3-4eaf-bce5-e63582259844" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:20:32 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-5f5d04c6-29cd-48cb-8038-70d750e1d920 tempest-ServerActionsTestOtherA-1552337055 None] Lock "cinder-quobyte-cf4d72f5-eaa3-4eaf-bce5-e63582259844" acquired by "delete_volume" :: waited 0.023s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:20:32 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf33da8-5cd1-48c4-8de1-261e0bc8ad90]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:20:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5f5d04c6-29cd-48cb-8038-70d750e1d920 tempest-ServerActionsTestOtherA-1552337055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cf4d72f5-eaa3-4eaf-bce5-e63582259844 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:20:32 devstack sudo[91596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cf4d72f5-eaa3-4eaf-bce5-e63582259844 Jul 16 23:20:32 devstack sudo[91596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:20:32 devstack sudo[91596]: pam_unix(sudo:session): session closed for user root Jul 16 23:20:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5f5d04c6-29cd-48cb-8038-70d750e1d920 tempest-ServerActionsTestOtherA-1552337055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cf4d72f5-eaa3-4eaf-bce5-e63582259844" returned: 0 in 0.440s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:20:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5f5d04c6-29cd-48cb-8038-70d750e1d920 tempest-ServerActionsTestOtherA-1552337055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cf4d72f5-eaa3-4eaf-bce5-e63582259844 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:20:32 devstack sudo[91601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cf4d72f5-eaa3-4eaf-bce5-e63582259844 Jul 16 23:20:32 devstack sudo[91601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:20:33 devstack sudo[91601]: pam_unix(sudo:session): session closed for user root Jul 16 23:20:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5f5d04c6-29cd-48cb-8038-70d750e1d920 tempest-ServerActionsTestOtherA-1552337055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cf4d72f5-eaa3-4eaf-bce5-e63582259844" returned: 0 in 0.441s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:20:33 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-5f5d04c6-29cd-48cb-8038-70d750e1d920 tempest-ServerActionsTestOtherA-1552337055 None] Lock "cinder-quobyte-cf4d72f5-eaa3-4eaf-bce5-e63582259844" released by "delete_volume" :: held 0.960s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:20:33 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-5f5d04c6-29cd-48cb-8038-70d750e1d920 tempest-ServerActionsTestOtherA-1552337055 None] Created reservations ['2c89dcd8-9148-4c6f-90ad-0ab636ea2544', '3fd7afc1-5786-44bf-afac-e4343512cb63', '6566b2c5-634f-4486-9fa4-2aae2ddff39d', '4f9971dc-07da-4dd8-9a5f-c1d0550f19c0'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:20:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5f5d04c6-29cd-48cb-8038-70d750e1d920 tempest-ServerActionsTestOtherA-1552337055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:20:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5f5d04c6-29cd-48cb-8038-70d750e1d920 tempest-ServerActionsTestOtherA-1552337055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:20:33 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-5f5d04c6-29cd-48cb-8038-70d750e1d920 tempest-ServerActionsTestOtherA-1552337055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:20:33 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-5f5d04c6-29cd-48cb-8038-70d750e1d920 tempest-ServerActionsTestOtherA-1552337055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:20:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5f5d04c6-29cd-48cb-8038-70d750e1d920 tempest-ServerActionsTestOtherA-1552337055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:20:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5f5d04c6-29cd-48cb-8038-70d750e1d920 tempest-ServerActionsTestOtherA-1552337055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:20:33 devstack sudo[91607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:20:33 devstack sudo[91607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:20:33 devstack sudo[91607]: pam_unix(sudo:session): session closed for user root Jul 16 23:20:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5f5d04c6-29cd-48cb-8038-70d750e1d920 tempest-ServerActionsTestOtherA-1552337055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.598s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:20:33 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-5f5d04c6-29cd-48cb-8038-70d750e1d920 tempest-ServerActionsTestOtherA-1552337055 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:20:34 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-5f5d04c6-29cd-48cb-8038-70d750e1d920 tempest-ServerActionsTestOtherA-1552337055 None] Deleted volume successfully. Jul 16 23:20:34 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-5f5d04c6-29cd-48cb-8038-70d750e1d920 tempest-ServerActionsTestOtherA-1552337055 None] Lock "cinder-cf4d72f5-eaa3-4eaf-bce5-e63582259844-delete_volume" released by "delete_volume" :: held 1.931s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:20:39 devstack cinder-volume[87607]: DEBUG oslo_service.periodic_task [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:20:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:20:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:20:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:20:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:20:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:20:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:20:39 devstack sudo[91716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:20:39 devstack sudo[91716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:20:40 devstack sudo[91716]: pam_unix(sudo:session): session closed for user root Jul 16 23:20:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.955s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:20:40 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:20:40 devstack cinder-volume[87607]: DEBUG oslo_service.periodic_task [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running periodic task VolumeManager._thread_info {{(pid=87607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:20:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] thread count: 8 {{(pid=87607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 23:20:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] thread info: [<_MainThread(MainThread, started 139090403627136)>, , , , , , , ] {{(pid=87607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 23:20:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-6fa3621a-7c9b-4b67-82d1-567b17dbea80 req-9d729518-4e8f-4f8f-b174-23a4ed71f5cf tempest-TaggedAttachmentsTest-803724708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:20:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-6fa3621a-7c9b-4b67-82d1-567b17dbea80 req-9d729518-4e8f-4f8f-b174-23a4ed71f5cf tempest-TaggedAttachmentsTest-803724708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:20:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-6fa3621a-7c9b-4b67-82d1-567b17dbea80 req-9d729518-4e8f-4f8f-b174-23a4ed71f5cf tempest-TaggedAttachmentsTest-803724708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:20:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-6fa3621a-7c9b-4b67-82d1-567b17dbea80 req-9d729518-4e8f-4f8f-b174-23a4ed71f5cf tempest-TaggedAttachmentsTest-803724708 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72', 'name': 'volume-5133854c-5f40-453d-81f2-2ef2186ddd77', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a08a2430-f742-42cc-950e-fbd6ed22fa1d', 'enforce_multipath': True} {{(pid=87607) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 23:20:40 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-6fa3621a-7c9b-4b67-82d1-567b17dbea80 req-9d729518-4e8f-4f8f-b174-23a4ed71f5cf tempest-TaggedAttachmentsTest-803724708 None] attachment_update completed successfully. Jul 16 23:20:42 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-08520fd3-26ea-43f7-a17b-dbd43a3f6f62 tempest-ServersNegativeTestJSON-255941449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:20:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-08520fd3-26ea-43f7-a17b-dbd43a3f6f62 tempest-ServersNegativeTestJSON-255941449 None] Flow 'volume_create_manager' (bc6ecb4f-629d-4444-9293-5d329f3d622d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:20:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-08520fd3-26ea-43f7-a17b-dbd43a3f6f62 tempest-ServersNegativeTestJSON-255941449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (304ca9c8-e1e1-45de-b145-b8d9d3174826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:20:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-08520fd3-26ea-43f7-a17b-dbd43a3f6f62 tempest-ServersNegativeTestJSON-255941449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (304ca9c8-e1e1-45de-b145-b8d9d3174826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-838392289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=457dc5f0-7cd0-4f73-9893-6c6c4f4f4d77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e5235f885444eacbb4e4b2af2ff417c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:20:43Z,use_quota=True,user_id='2f7a76ac7bcc46cfa0e8a4e850e0cc75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:20:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-08520fd3-26ea-43f7-a17b-dbd43a3f6f62 tempest-ServersNegativeTestJSON-255941449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4d8a5e4-0677-4cd9-baf2-c4131de93441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:20:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-08520fd3-26ea-43f7-a17b-dbd43a3f6f62 tempest-ServersNegativeTestJSON-255941449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4d8a5e4-0677-4cd9-baf2-c4131de93441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:20:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-08520fd3-26ea-43f7-a17b-dbd43a3f6f62 tempest-ServersNegativeTestJSON-255941449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd58e3ec-2663-4fb0-a4a2-c0a06b8e84ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:20:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-08520fd3-26ea-43f7-a17b-dbd43a3f6f62 tempest-ServersNegativeTestJSON-255941449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd58e3ec-2663-4fb0-a4a2-c0a06b8e84ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '457dc5f0-7cd0-4f73-9893-6c6c4f4f4d77', 'volume_name': 'volume-457dc5f0-7cd0-4f73-9893-6c6c4f4f4d77', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:20:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-08520fd3-26ea-43f7-a17b-dbd43a3f6f62 tempest-ServersNegativeTestJSON-255941449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32868854-936a-4ca5-83d2-f07172cfc176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:20:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-08520fd3-26ea-43f7-a17b-dbd43a3f6f62 tempest-ServersNegativeTestJSON-255941449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32868854-936a-4ca5-83d2-f07172cfc176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:20:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-08520fd3-26ea-43f7-a17b-dbd43a3f6f62 tempest-ServersNegativeTestJSON-255941449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (043443a5-47cf-4bbc-84dc-85f84ea7f199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:20:43 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-08520fd3-26ea-43f7-a17b-dbd43a3f6f62 tempest-ServersNegativeTestJSON-255941449 None] Volume 457dc5f0-7cd0-4f73-9893-6c6c4f4f4d77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-457dc5f0-7cd0-4f73-9893-6c6c4f4f4d77', 'volume_size': 1} Jul 16 23:20:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-08520fd3-26ea-43f7-a17b-dbd43a3f6f62 tempest-ServersNegativeTestJSON-255941449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:20:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-08520fd3-26ea-43f7-a17b-dbd43a3f6f62 tempest-ServersNegativeTestJSON-255941449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:20:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-08520fd3-26ea-43f7-a17b-dbd43a3f6f62 tempest-ServersNegativeTestJSON-255941449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-838392289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=457dc5f0-7cd0-4f73-9893-6c6c4f4f4d77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e5235f885444eacbb4e4b2af2ff417c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:20:43Z,use_quota=True,user_id='2f7a76ac7bcc46cfa0e8a4e850e0cc75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:20:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-08520fd3-26ea-43f7-a17b-dbd43a3f6f62 tempest-ServersNegativeTestJSON-255941449 None] Creating volume 457dc5f0-7cd0-4f73-9893-6c6c4f4f4d77 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:20:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-08520fd3-26ea-43f7-a17b-dbd43a3f6f62 tempest-ServersNegativeTestJSON-255941449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:20:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-08520fd3-26ea-43f7-a17b-dbd43a3f6f62 tempest-ServersNegativeTestJSON-255941449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:20:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-08520fd3-26ea-43f7-a17b-dbd43a3f6f62 tempest-ServersNegativeTestJSON-255941449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:20:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-08520fd3-26ea-43f7-a17b-dbd43a3f6f62 tempest-ServersNegativeTestJSON-255941449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:20:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-08520fd3-26ea-43f7-a17b-dbd43a3f6f62 tempest-ServersNegativeTestJSON-255941449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:20:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-08520fd3-26ea-43f7-a17b-dbd43a3f6f62 tempest-ServersNegativeTestJSON-255941449 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:20:43 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-08520fd3-26ea-43f7-a17b-dbd43a3f6f62 tempest-ServersNegativeTestJSON-255941449 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:20:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-08520fd3-26ea-43f7-a17b-dbd43a3f6f62 tempest-ServersNegativeTestJSON-255941449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-457dc5f0-7cd0-4f73-9893-6c6c4f4f4d77 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:20:43 devstack sudo[92118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-457dc5f0-7cd0-4f73-9893-6c6c4f4f4d77 1073741824 Jul 16 23:20:43 devstack sudo[92118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:20:43 devstack sudo[92118]: pam_unix(sudo:session): session closed for user root Jul 16 23:20:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-08520fd3-26ea-43f7-a17b-dbd43a3f6f62 tempest-ServersNegativeTestJSON-255941449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-457dc5f0-7cd0-4f73-9893-6c6c4f4f4d77 1073741824" returned: 0 in 0.575s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:20:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-08520fd3-26ea-43f7-a17b-dbd43a3f6f62 tempest-ServersNegativeTestJSON-255941449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-457dc5f0-7cd0-4f73-9893-6c6c4f4f4d77 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:20:43 devstack sudo[92126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-457dc5f0-7cd0-4f73-9893-6c6c4f4f4d77 Jul 16 23:20:43 devstack sudo[92126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:20:43 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-d318cde5-af8f-4877-83da-a85703a1f3b8 req-82af1be9-6116-49e1-a5c8-99a8c5a8ad25 tempest-TaggedAttachmentsTest-803724708 None] Terminate volume connection completed successfully. Jul 16 23:20:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-d318cde5-af8f-4877-83da-a85703a1f3b8 req-82af1be9-6116-49e1-a5c8-99a8c5a8ad25 tempest-TaggedAttachmentsTest-803724708 None] Deleting attachment a08a2430-f742-42cc-950e-fbd6ed22fa1d. {{(pid=87607) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 23:20:43 devstack sudo[92126]: pam_unix(sudo:session): session closed for user root Jul 16 23:20:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-08520fd3-26ea-43f7-a17b-dbd43a3f6f62 tempest-ServersNegativeTestJSON-255941449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-457dc5f0-7cd0-4f73-9893-6c6c4f4f4d77" returned: 0 in 0.298s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:20:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-08520fd3-26ea-43f7-a17b-dbd43a3f6f62 tempest-ServersNegativeTestJSON-255941449 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:20:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-08520fd3-26ea-43f7-a17b-dbd43a3f6f62 tempest-ServersNegativeTestJSON-255941449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:20:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-08520fd3-26ea-43f7-a17b-dbd43a3f6f62 tempest-ServersNegativeTestJSON-255941449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (043443a5-47cf-4bbc-84dc-85f84ea7f199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-457dc5f0-7cd0-4f73-9893-6c6c4f4f4d77', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:20:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-08520fd3-26ea-43f7-a17b-dbd43a3f6f62 tempest-ServersNegativeTestJSON-255941449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ba811ab-876e-44a6-82e6-c37611977d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:20:43 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-08520fd3-26ea-43f7-a17b-dbd43a3f6f62 tempest-ServersNegativeTestJSON-255941449 None] Volume volume-457dc5f0-7cd0-4f73-9893-6c6c4f4f4d77 (457dc5f0-7cd0-4f73-9893-6c6c4f4f4d77): created successfully Jul 16 23:20:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-08520fd3-26ea-43f7-a17b-dbd43a3f6f62 tempest-ServersNegativeTestJSON-255941449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ba811ab-876e-44a6-82e6-c37611977d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:20:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-08520fd3-26ea-43f7-a17b-dbd43a3f6f62 tempest-ServersNegativeTestJSON-255941449 None] Flow 'volume_create_manager' (bc6ecb4f-629d-4444-9293-5d329f3d622d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:20:44 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-08520fd3-26ea-43f7-a17b-dbd43a3f6f62 tempest-ServersNegativeTestJSON-255941449 None] Created volume successfully. Jul 16 23:20:47 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a890b49-bc0e-4bfe-ac4f-bdb72a39ad2e tempest-ServersNegativeTestJSON-255941449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:20:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4a890b49-bc0e-4bfe-ac4f-bdb72a39ad2e tempest-ServersNegativeTestJSON-255941449 None] Flow 'volume_create_manager' (b61b0be2-a13d-4cf7-8af3-6e2774c24527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:20:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4a890b49-bc0e-4bfe-ac4f-bdb72a39ad2e tempest-ServersNegativeTestJSON-255941449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32c3544a-259c-41ef-9132-0bc770c1308d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:20:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4a890b49-bc0e-4bfe-ac4f-bdb72a39ad2e tempest-ServersNegativeTestJSON-255941449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32c3544a-259c-41ef-9132-0bc770c1308d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1097191323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de5f345e-4ed6-4a51-b35b-e4d7795b66d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e5235f885444eacbb4e4b2af2ff417c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:20:47Z,use_quota=True,user_id='2f7a76ac7bcc46cfa0e8a4e850e0cc75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:20:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4a890b49-bc0e-4bfe-ac4f-bdb72a39ad2e tempest-ServersNegativeTestJSON-255941449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (333779af-22a7-43b4-90ce-f4ef2e4fbc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:20:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4a890b49-bc0e-4bfe-ac4f-bdb72a39ad2e tempest-ServersNegativeTestJSON-255941449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (333779af-22a7-43b4-90ce-f4ef2e4fbc8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:20:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4a890b49-bc0e-4bfe-ac4f-bdb72a39ad2e tempest-ServersNegativeTestJSON-255941449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6faf485-482d-4405-abe6-458d62f9e7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:20:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4a890b49-bc0e-4bfe-ac4f-bdb72a39ad2e tempest-ServersNegativeTestJSON-255941449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6faf485-482d-4405-abe6-458d62f9e7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de5f345e-4ed6-4a51-b35b-e4d7795b66d4', 'volume_name': 'volume-de5f345e-4ed6-4a51-b35b-e4d7795b66d4', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:20:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4a890b49-bc0e-4bfe-ac4f-bdb72a39ad2e tempest-ServersNegativeTestJSON-255941449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac12721b-4f9f-45e9-b113-3161edf952e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:20:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4a890b49-bc0e-4bfe-ac4f-bdb72a39ad2e tempest-ServersNegativeTestJSON-255941449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac12721b-4f9f-45e9-b113-3161edf952e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:20:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4a890b49-bc0e-4bfe-ac4f-bdb72a39ad2e tempest-ServersNegativeTestJSON-255941449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f81d87a-c446-4a22-99dd-de507019f21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:20:47 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-4a890b49-bc0e-4bfe-ac4f-bdb72a39ad2e tempest-ServersNegativeTestJSON-255941449 None] Volume de5f345e-4ed6-4a51-b35b-e4d7795b66d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de5f345e-4ed6-4a51-b35b-e4d7795b66d4', 'volume_size': 1} Jul 16 23:20:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4a890b49-bc0e-4bfe-ac4f-bdb72a39ad2e tempest-ServersNegativeTestJSON-255941449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:20:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4a890b49-bc0e-4bfe-ac4f-bdb72a39ad2e tempest-ServersNegativeTestJSON-255941449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:20:47 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4a890b49-bc0e-4bfe-ac4f-bdb72a39ad2e tempest-ServersNegativeTestJSON-255941449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1097191323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de5f345e-4ed6-4a51-b35b-e4d7795b66d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e5235f885444eacbb4e4b2af2ff417c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:20:47Z,use_quota=True,user_id='2f7a76ac7bcc46cfa0e8a4e850e0cc75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:20:47 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-4a890b49-bc0e-4bfe-ac4f-bdb72a39ad2e tempest-ServersNegativeTestJSON-255941449 None] Creating volume de5f345e-4ed6-4a51-b35b-e4d7795b66d4 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:20:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4a890b49-bc0e-4bfe-ac4f-bdb72a39ad2e tempest-ServersNegativeTestJSON-255941449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:20:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4a890b49-bc0e-4bfe-ac4f-bdb72a39ad2e tempest-ServersNegativeTestJSON-255941449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:20:47 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4a890b49-bc0e-4bfe-ac4f-bdb72a39ad2e tempest-ServersNegativeTestJSON-255941449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:20:47 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4a890b49-bc0e-4bfe-ac4f-bdb72a39ad2e tempest-ServersNegativeTestJSON-255941449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:20:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4a890b49-bc0e-4bfe-ac4f-bdb72a39ad2e tempest-ServersNegativeTestJSON-255941449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:20:47 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4a890b49-bc0e-4bfe-ac4f-bdb72a39ad2e tempest-ServersNegativeTestJSON-255941449 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:20:47 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-4a890b49-bc0e-4bfe-ac4f-bdb72a39ad2e tempest-ServersNegativeTestJSON-255941449 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:20:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4a890b49-bc0e-4bfe-ac4f-bdb72a39ad2e tempest-ServersNegativeTestJSON-255941449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-de5f345e-4ed6-4a51-b35b-e4d7795b66d4 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:20:47 devstack sudo[92180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-de5f345e-4ed6-4a51-b35b-e4d7795b66d4 1073741824 Jul 16 23:20:47 devstack sudo[92180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:20:47 devstack sudo[92180]: pam_unix(sudo:session): session closed for user root Jul 16 23:20:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4a890b49-bc0e-4bfe-ac4f-bdb72a39ad2e tempest-ServersNegativeTestJSON-255941449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-de5f345e-4ed6-4a51-b35b-e4d7795b66d4 1073741824" returned: 0 in 0.522s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:20:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4a890b49-bc0e-4bfe-ac4f-bdb72a39ad2e tempest-ServersNegativeTestJSON-255941449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-de5f345e-4ed6-4a51-b35b-e4d7795b66d4 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:20:47 devstack sudo[92186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-de5f345e-4ed6-4a51-b35b-e4d7795b66d4 Jul 16 23:20:47 devstack sudo[92186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:20:48 devstack sudo[92186]: pam_unix(sudo:session): session closed for user root Jul 16 23:20:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4a890b49-bc0e-4bfe-ac4f-bdb72a39ad2e tempest-ServersNegativeTestJSON-255941449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-de5f345e-4ed6-4a51-b35b-e4d7795b66d4" returned: 0 in 0.363s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:20:48 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4a890b49-bc0e-4bfe-ac4f-bdb72a39ad2e tempest-ServersNegativeTestJSON-255941449 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:20:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4a890b49-bc0e-4bfe-ac4f-bdb72a39ad2e tempest-ServersNegativeTestJSON-255941449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:20:48 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4a890b49-bc0e-4bfe-ac4f-bdb72a39ad2e tempest-ServersNegativeTestJSON-255941449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f81d87a-c446-4a22-99dd-de507019f21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de5f345e-4ed6-4a51-b35b-e4d7795b66d4', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:20:48 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4a890b49-bc0e-4bfe-ac4f-bdb72a39ad2e tempest-ServersNegativeTestJSON-255941449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7517e33f-7bcc-4db5-9f8c-289504cc0a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:20:48 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-4a890b49-bc0e-4bfe-ac4f-bdb72a39ad2e tempest-ServersNegativeTestJSON-255941449 None] Volume volume-de5f345e-4ed6-4a51-b35b-e4d7795b66d4 (de5f345e-4ed6-4a51-b35b-e4d7795b66d4): created successfully Jul 16 23:20:48 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4a890b49-bc0e-4bfe-ac4f-bdb72a39ad2e tempest-ServersNegativeTestJSON-255941449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7517e33f-7bcc-4db5-9f8c-289504cc0a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:20:48 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4a890b49-bc0e-4bfe-ac4f-bdb72a39ad2e tempest-ServersNegativeTestJSON-255941449 None] Flow 'volume_create_manager' (b61b0be2-a13d-4cf7-8af3-6e2774c24527) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:20:48 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-4a890b49-bc0e-4bfe-ac4f-bdb72a39ad2e tempest-ServersNegativeTestJSON-255941449 None] Created volume successfully. Jul 16 23:20:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-da8fae2e-55c1-472d-a359-baec6836c378 tempest-ServersNegativeTestJSON-255941449 None] Acquiring lock "cinder-de5f345e-4ed6-4a51-b35b-e4d7795b66d4-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:20:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-da8fae2e-55c1-472d-a359-baec6836c378 tempest-ServersNegativeTestJSON-255941449 None] Lock "cinder-de5f345e-4ed6-4a51-b35b-e4d7795b66d4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:20:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-da8fae2e-55c1-472d-a359-baec6836c378 tempest-ServersNegativeTestJSON-255941449 None] Acquiring lock "cinder-quobyte-de5f345e-4ed6-4a51-b35b-e4d7795b66d4" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:20:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-da8fae2e-55c1-472d-a359-baec6836c378 tempest-ServersNegativeTestJSON-255941449 None] Lock "cinder-quobyte-de5f345e-4ed6-4a51-b35b-e4d7795b66d4" acquired by "delete_volume" :: waited 0.018s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:20:50 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[01efe8ba-e706-4c16-b600-1c705b3918d4]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:20:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-da8fae2e-55c1-472d-a359-baec6836c378 tempest-ServersNegativeTestJSON-255941449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-de5f345e-4ed6-4a51-b35b-e4d7795b66d4 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:20:50 devstack sudo[92236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-de5f345e-4ed6-4a51-b35b-e4d7795b66d4 Jul 16 23:20:50 devstack sudo[92236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:20:51 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [req-577fef24-687f-4330-8a32-8235b7947335 req-356f4167-7fd8-41be-8a0c-7efd9e7165d7 tempest-VolumesSnapshotsTestJSON-78760422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:20:51 devstack sudo[92236]: pam_unix(sudo:session): session closed for user root Jul 16 23:20:51 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-577fef24-687f-4330-8a32-8235b7947335 req-356f4167-7fd8-41be-8a0c-7efd9e7165d7 tempest-VolumesSnapshotsTestJSON-78760422 None] Flow 'volume_create_manager' (2b576ec3-390d-411e-b16b-3e32fa4918ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:20:51 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-577fef24-687f-4330-8a32-8235b7947335 req-356f4167-7fd8-41be-8a0c-7efd9e7165d7 tempest-VolumesSnapshotsTestJSON-78760422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a24be56-dc07-41c1-85ba-d1de194dabc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:20:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-da8fae2e-55c1-472d-a359-baec6836c378 tempest-ServersNegativeTestJSON-255941449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-de5f345e-4ed6-4a51-b35b-e4d7795b66d4" returned: 0 in 0.568s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:20:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-da8fae2e-55c1-472d-a359-baec6836c378 tempest-ServersNegativeTestJSON-255941449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-de5f345e-4ed6-4a51-b35b-e4d7795b66d4 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:20:51 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-577fef24-687f-4330-8a32-8235b7947335 req-356f4167-7fd8-41be-8a0c-7efd9e7165d7 tempest-VolumesSnapshotsTestJSON-78760422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a24be56-dc07-41c1-85ba-d1de194dabc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1298077702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30fadcc5-0010-413a-9afc-81a3f44e2f84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='939ac3e14a024f5684360a78c448bd69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:20:51Z,use_quota=True,user_id='ca399e2b7bd5444d8e351bbd0b9629c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:20:51 devstack sudo[92243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-de5f345e-4ed6-4a51-b35b-e4d7795b66d4 Jul 16 23:20:51 devstack sudo[92243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:20:51 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-577fef24-687f-4330-8a32-8235b7947335 req-356f4167-7fd8-41be-8a0c-7efd9e7165d7 tempest-VolumesSnapshotsTestJSON-78760422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74804d50-3cc7-4f26-979b-03a218554e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:20:51 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-577fef24-687f-4330-8a32-8235b7947335 req-356f4167-7fd8-41be-8a0c-7efd9e7165d7 tempest-VolumesSnapshotsTestJSON-78760422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74804d50-3cc7-4f26-979b-03a218554e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:20:51 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-577fef24-687f-4330-8a32-8235b7947335 req-356f4167-7fd8-41be-8a0c-7efd9e7165d7 tempest-VolumesSnapshotsTestJSON-78760422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (919dfcae-cca3-4d72-bf96-214ec4ff91d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:20:51 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-577fef24-687f-4330-8a32-8235b7947335 req-356f4167-7fd8-41be-8a0c-7efd9e7165d7 tempest-VolumesSnapshotsTestJSON-78760422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (919dfcae-cca3-4d72-bf96-214ec4ff91d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30fadcc5-0010-413a-9afc-81a3f44e2f84', 'volume_name': 'volume-30fadcc5-0010-413a-9afc-81a3f44e2f84', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:20:51 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-577fef24-687f-4330-8a32-8235b7947335 req-356f4167-7fd8-41be-8a0c-7efd9e7165d7 tempest-VolumesSnapshotsTestJSON-78760422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c0e0106-6375-4ddc-97ff-e03d7a6e36f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:20:51 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-577fef24-687f-4330-8a32-8235b7947335 req-356f4167-7fd8-41be-8a0c-7efd9e7165d7 tempest-VolumesSnapshotsTestJSON-78760422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c0e0106-6375-4ddc-97ff-e03d7a6e36f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:20:51 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-577fef24-687f-4330-8a32-8235b7947335 req-356f4167-7fd8-41be-8a0c-7efd9e7165d7 tempest-VolumesSnapshotsTestJSON-78760422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62de5337-58b2-421a-83b0-ab8331390528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:20:51 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [req-577fef24-687f-4330-8a32-8235b7947335 req-356f4167-7fd8-41be-8a0c-7efd9e7165d7 tempest-VolumesSnapshotsTestJSON-78760422 None] Volume 30fadcc5-0010-413a-9afc-81a3f44e2f84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30fadcc5-0010-413a-9afc-81a3f44e2f84', 'volume_size': 1} Jul 16 23:20:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-577fef24-687f-4330-8a32-8235b7947335 req-356f4167-7fd8-41be-8a0c-7efd9e7165d7 tempest-VolumesSnapshotsTestJSON-78760422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:20:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-577fef24-687f-4330-8a32-8235b7947335 req-356f4167-7fd8-41be-8a0c-7efd9e7165d7 tempest-VolumesSnapshotsTestJSON-78760422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:20:51 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [req-577fef24-687f-4330-8a32-8235b7947335 req-356f4167-7fd8-41be-8a0c-7efd9e7165d7 tempest-VolumesSnapshotsTestJSON-78760422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1298077702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30fadcc5-0010-413a-9afc-81a3f44e2f84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='939ac3e14a024f5684360a78c448bd69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:20:51Z,use_quota=True,user_id='ca399e2b7bd5444d8e351bbd0b9629c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:20:51 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [req-577fef24-687f-4330-8a32-8235b7947335 req-356f4167-7fd8-41be-8a0c-7efd9e7165d7 tempest-VolumesSnapshotsTestJSON-78760422 None] Creating volume 30fadcc5-0010-413a-9afc-81a3f44e2f84 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:20:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-577fef24-687f-4330-8a32-8235b7947335 req-356f4167-7fd8-41be-8a0c-7efd9e7165d7 tempest-VolumesSnapshotsTestJSON-78760422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:20:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-577fef24-687f-4330-8a32-8235b7947335 req-356f4167-7fd8-41be-8a0c-7efd9e7165d7 tempest-VolumesSnapshotsTestJSON-78760422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:20:51 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [req-577fef24-687f-4330-8a32-8235b7947335 req-356f4167-7fd8-41be-8a0c-7efd9e7165d7 tempest-VolumesSnapshotsTestJSON-78760422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:20:51 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [req-577fef24-687f-4330-8a32-8235b7947335 req-356f4167-7fd8-41be-8a0c-7efd9e7165d7 tempest-VolumesSnapshotsTestJSON-78760422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:20:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-577fef24-687f-4330-8a32-8235b7947335 req-356f4167-7fd8-41be-8a0c-7efd9e7165d7 tempest-VolumesSnapshotsTestJSON-78760422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:20:51 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [req-577fef24-687f-4330-8a32-8235b7947335 req-356f4167-7fd8-41be-8a0c-7efd9e7165d7 tempest-VolumesSnapshotsTestJSON-78760422 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:20:51 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [req-577fef24-687f-4330-8a32-8235b7947335 req-356f4167-7fd8-41be-8a0c-7efd9e7165d7 tempest-VolumesSnapshotsTestJSON-78760422 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:20:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-577fef24-687f-4330-8a32-8235b7947335 req-356f4167-7fd8-41be-8a0c-7efd9e7165d7 tempest-VolumesSnapshotsTestJSON-78760422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:20:51 devstack sudo[92245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84 1073741824 Jul 16 23:20:51 devstack sudo[92245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:20:51 devstack sudo[92243]: pam_unix(sudo:session): session closed for user root Jul 16 23:20:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-da8fae2e-55c1-472d-a359-baec6836c378 tempest-ServersNegativeTestJSON-255941449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-de5f345e-4ed6-4a51-b35b-e4d7795b66d4" returned: 0 in 0.281s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:20:51 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-da8fae2e-55c1-472d-a359-baec6836c378 tempest-ServersNegativeTestJSON-255941449 None] Lock "cinder-quobyte-de5f345e-4ed6-4a51-b35b-e4d7795b66d4" released by "delete_volume" :: held 0.906s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:20:51 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-da8fae2e-55c1-472d-a359-baec6836c378 tempest-ServersNegativeTestJSON-255941449 None] Created reservations ['6c18d093-ee3f-4795-b648-2507ec94b2ea', '6e1f10ff-ccdd-46d5-abe6-485d9472b1a2', 'e3d817bf-9dc0-46ba-b981-1c62eba9b87a', '3995ccd5-d11c-4491-b62c-11fd3e9aab0b'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:20:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-da8fae2e-55c1-472d-a359-baec6836c378 tempest-ServersNegativeTestJSON-255941449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:20:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-da8fae2e-55c1-472d-a359-baec6836c378 tempest-ServersNegativeTestJSON-255941449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:20:51 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-da8fae2e-55c1-472d-a359-baec6836c378 tempest-ServersNegativeTestJSON-255941449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:20:51 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-da8fae2e-55c1-472d-a359-baec6836c378 tempest-ServersNegativeTestJSON-255941449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:20:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-da8fae2e-55c1-472d-a359-baec6836c378 tempest-ServersNegativeTestJSON-255941449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:20:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-da8fae2e-55c1-472d-a359-baec6836c378 tempest-ServersNegativeTestJSON-255941449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:20:51 devstack sudo[92252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:20:51 devstack sudo[92252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:20:51 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-dc600bdd-23cd-4c33-88fa-261e1df62503 tempest-ServersNegativeTestJSON-255941449 None] Acquiring lock "cinder-457dc5f0-7cd0-4f73-9893-6c6c4f4f4d77-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:20:51 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-dc600bdd-23cd-4c33-88fa-261e1df62503 tempest-ServersNegativeTestJSON-255941449 None] Lock "cinder-457dc5f0-7cd0-4f73-9893-6c6c4f4f4d77-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:20:51 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-dc600bdd-23cd-4c33-88fa-261e1df62503 tempest-ServersNegativeTestJSON-255941449 None] Acquiring lock "cinder-quobyte-457dc5f0-7cd0-4f73-9893-6c6c4f4f4d77" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:20:51 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-dc600bdd-23cd-4c33-88fa-261e1df62503 tempest-ServersNegativeTestJSON-255941449 None] Lock "cinder-quobyte-457dc5f0-7cd0-4f73-9893-6c6c4f4f4d77" acquired by "delete_volume" :: waited 0.015s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:20:51 devstack sudo[92245]: pam_unix(sudo:session): session closed for user root Jul 16 23:20:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-577fef24-687f-4330-8a32-8235b7947335 req-356f4167-7fd8-41be-8a0c-7efd9e7165d7 tempest-VolumesSnapshotsTestJSON-78760422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84 1073741824" returned: 0 in 0.560s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:20:51 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8ded3a-c275-4d0d-a8ab-2beb8af2c1b9]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:20:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-dc600bdd-23cd-4c33-88fa-261e1df62503 tempest-ServersNegativeTestJSON-255941449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-457dc5f0-7cd0-4f73-9893-6c6c4f4f4d77 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:20:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-577fef24-687f-4330-8a32-8235b7947335 req-356f4167-7fd8-41be-8a0c-7efd9e7165d7 tempest-VolumesSnapshotsTestJSON-78760422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:20:51 devstack sudo[92256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84 Jul 16 23:20:51 devstack sudo[92256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:20:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-da8fae2e-55c1-472d-a359-baec6836c378 tempest-ServersNegativeTestJSON-255941449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.281s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:20:51 devstack sudo[92252]: pam_unix(sudo:session): session closed for user root Jul 16 23:20:51 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-da8fae2e-55c1-472d-a359-baec6836c378 tempest-ServersNegativeTestJSON-255941449 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:20:51 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-da8fae2e-55c1-472d-a359-baec6836c378 tempest-ServersNegativeTestJSON-255941449 None] Deleted volume successfully. Jul 16 23:20:51 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-da8fae2e-55c1-472d-a359-baec6836c378 tempest-ServersNegativeTestJSON-255941449 None] Lock "cinder-de5f345e-4ed6-4a51-b35b-e4d7795b66d4-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:20:51 devstack sudo[92254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-457dc5f0-7cd0-4f73-9893-6c6c4f4f4d77 Jul 16 23:20:51 devstack sudo[92254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:20:52 devstack sudo[92256]: pam_unix(sudo:session): session closed for user root Jul 16 23:20:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-577fef24-687f-4330-8a32-8235b7947335 req-356f4167-7fd8-41be-8a0c-7efd9e7165d7 tempest-VolumesSnapshotsTestJSON-78760422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84" returned: 0 in 0.324s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:20:52 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [req-577fef24-687f-4330-8a32-8235b7947335 req-356f4167-7fd8-41be-8a0c-7efd9e7165d7 tempest-VolumesSnapshotsTestJSON-78760422 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:20:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-577fef24-687f-4330-8a32-8235b7947335 req-356f4167-7fd8-41be-8a0c-7efd9e7165d7 tempest-VolumesSnapshotsTestJSON-78760422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:20:52 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-577fef24-687f-4330-8a32-8235b7947335 req-356f4167-7fd8-41be-8a0c-7efd9e7165d7 tempest-VolumesSnapshotsTestJSON-78760422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62de5337-58b2-421a-83b0-ab8331390528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30fadcc5-0010-413a-9afc-81a3f44e2f84', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:20:52 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-577fef24-687f-4330-8a32-8235b7947335 req-356f4167-7fd8-41be-8a0c-7efd9e7165d7 tempest-VolumesSnapshotsTestJSON-78760422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (102a6a82-ae23-4e99-94c7-49f6f58b8b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:20:52 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [req-577fef24-687f-4330-8a32-8235b7947335 req-356f4167-7fd8-41be-8a0c-7efd9e7165d7 tempest-VolumesSnapshotsTestJSON-78760422 None] Volume volume-30fadcc5-0010-413a-9afc-81a3f44e2f84 (30fadcc5-0010-413a-9afc-81a3f44e2f84): created successfully Jul 16 23:20:52 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-577fef24-687f-4330-8a32-8235b7947335 req-356f4167-7fd8-41be-8a0c-7efd9e7165d7 tempest-VolumesSnapshotsTestJSON-78760422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (102a6a82-ae23-4e99-94c7-49f6f58b8b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:20:52 devstack sudo[92254]: pam_unix(sudo:session): session closed for user root Jul 16 23:20:52 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-577fef24-687f-4330-8a32-8235b7947335 req-356f4167-7fd8-41be-8a0c-7efd9e7165d7 tempest-VolumesSnapshotsTestJSON-78760422 None] Flow 'volume_create_manager' (2b576ec3-390d-411e-b16b-3e32fa4918ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:20:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-dc600bdd-23cd-4c33-88fa-261e1df62503 tempest-ServersNegativeTestJSON-255941449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-457dc5f0-7cd0-4f73-9893-6c6c4f4f4d77" returned: 0 in 0.430s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:20:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-dc600bdd-23cd-4c33-88fa-261e1df62503 tempest-ServersNegativeTestJSON-255941449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-457dc5f0-7cd0-4f73-9893-6c6c4f4f4d77 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:20:52 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-577fef24-687f-4330-8a32-8235b7947335 req-356f4167-7fd8-41be-8a0c-7efd9e7165d7 tempest-VolumesSnapshotsTestJSON-78760422 None] Created volume successfully. Jul 16 23:20:52 devstack sudo[92265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-457dc5f0-7cd0-4f73-9893-6c6c4f4f4d77 Jul 16 23:20:52 devstack sudo[92265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:20:52 devstack sudo[92265]: pam_unix(sudo:session): session closed for user root Jul 16 23:20:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-dc600bdd-23cd-4c33-88fa-261e1df62503 tempest-ServersNegativeTestJSON-255941449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-457dc5f0-7cd0-4f73-9893-6c6c4f4f4d77" returned: 0 in 0.279s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:20:52 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-dc600bdd-23cd-4c33-88fa-261e1df62503 tempest-ServersNegativeTestJSON-255941449 None] Lock "cinder-quobyte-457dc5f0-7cd0-4f73-9893-6c6c4f4f4d77" released by "delete_volume" :: held 0.756s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:20:52 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-dc600bdd-23cd-4c33-88fa-261e1df62503 tempest-ServersNegativeTestJSON-255941449 None] Created reservations ['8cc29c0e-233f-49eb-abb4-dc1088e22298', 'b6efd8a9-4e31-4b2a-92d8-0cfdb5e1a8fe', '966aca4b-1731-4e01-ae9a-c5f047c6fa13', '12cd4bfc-713a-43bc-a14a-ada18b035d81'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:20:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-dc600bdd-23cd-4c33-88fa-261e1df62503 tempest-ServersNegativeTestJSON-255941449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:20:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-dc600bdd-23cd-4c33-88fa-261e1df62503 tempest-ServersNegativeTestJSON-255941449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:20:52 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-dc600bdd-23cd-4c33-88fa-261e1df62503 tempest-ServersNegativeTestJSON-255941449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:20:52 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-dc600bdd-23cd-4c33-88fa-261e1df62503 tempest-ServersNegativeTestJSON-255941449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:20:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-dc600bdd-23cd-4c33-88fa-261e1df62503 tempest-ServersNegativeTestJSON-255941449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:20:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-dc600bdd-23cd-4c33-88fa-261e1df62503 tempest-ServersNegativeTestJSON-255941449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:20:52 devstack sudo[92268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:20:52 devstack sudo[92268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:20:53 devstack sudo[92268]: pam_unix(sudo:session): session closed for user root Jul 16 23:20:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-dc600bdd-23cd-4c33-88fa-261e1df62503 tempest-ServersNegativeTestJSON-255941449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.408s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:20:53 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-dc600bdd-23cd-4c33-88fa-261e1df62503 tempest-ServersNegativeTestJSON-255941449 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:20:53 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-dc600bdd-23cd-4c33-88fa-261e1df62503 tempest-ServersNegativeTestJSON-255941449 None] Deleted volume successfully. Jul 16 23:20:53 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-dc600bdd-23cd-4c33-88fa-261e1df62503 tempest-ServersNegativeTestJSON-255941449 None] Lock "cinder-457dc5f0-7cd0-4f73-9893-6c6c4f4f4d77-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:20:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-a2316e8e-4cd3-462a-b8b7-8d2bf004809f req-c5de75f7-05a3-492b-bc00-d0c19eb5af30 tempest-VolumesSnapshotsTestJSON-78760422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:20:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-a2316e8e-4cd3-462a-b8b7-8d2bf004809f req-c5de75f7-05a3-492b-bc00-d0c19eb5af30 tempest-VolumesSnapshotsTestJSON-78760422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:20:54 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [req-a2316e8e-4cd3-462a-b8b7-8d2bf004809f req-c5de75f7-05a3-492b-bc00-d0c19eb5af30 tempest-VolumesSnapshotsTestJSON-78760422 None] Creating offline snapshot c4fb6084-07d8-4f55-854f-da01d63c65e1 of volume 30fadcc5-0010-413a-9afc-81a3f44e2f84 {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:20:54 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[c527ec26-3658-43a9-a476-9d08fbc4ad8e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:20:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-a2316e8e-4cd3-462a-b8b7-8d2bf004809f req-c5de75f7-05a3-492b-bc00-d0c19eb5af30 tempest-VolumesSnapshotsTestJSON-78760422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:20:54 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-15b1b95b-958d-4162-ba92-66973c73503a tempest-TaggedAttachmentsTest-803724708 None] Acquiring lock "cinder-5133854c-5f40-453d-81f2-2ef2186ddd77-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:20:54 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-15b1b95b-958d-4162-ba92-66973c73503a tempest-TaggedAttachmentsTest-803724708 None] Lock "cinder-5133854c-5f40-453d-81f2-2ef2186ddd77-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:20:54 devstack sudo[92313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84 Jul 16 23:20:54 devstack sudo[92313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:20:54 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-15b1b95b-958d-4162-ba92-66973c73503a tempest-TaggedAttachmentsTest-803724708 None] Acquiring lock "cinder-quobyte-5133854c-5f40-453d-81f2-2ef2186ddd77" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:20:54 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-15b1b95b-958d-4162-ba92-66973c73503a tempest-TaggedAttachmentsTest-803724708 None] Lock "cinder-quobyte-5133854c-5f40-453d-81f2-2ef2186ddd77" acquired by "delete_volume" :: waited 0.037s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:20:54 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbea58dc-6d6b-4664-b4ca-8309cd8fbab5]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:20:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-15b1b95b-958d-4162-ba92-66973c73503a tempest-TaggedAttachmentsTest-803724708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5133854c-5f40-453d-81f2-2ef2186ddd77 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:20:54 devstack sudo[92313]: pam_unix(sudo:session): session closed for user root Jul 16 23:20:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-a2316e8e-4cd3-462a-b8b7-8d2bf004809f req-c5de75f7-05a3-492b-bc00-d0c19eb5af30 tempest-VolumesSnapshotsTestJSON-78760422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84" returned: 0 in 0.569s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:20:54 devstack sudo[92315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5133854c-5f40-453d-81f2-2ef2186ddd77 Jul 16 23:20:54 devstack sudo[92315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:20:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-a2316e8e-4cd3-462a-b8b7-8d2bf004809f req-c5de75f7-05a3-492b-bc00-d0c19eb5af30 tempest-VolumesSnapshotsTestJSON-78760422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84.c4fb6084-07d8-4f55-854f-da01d63c65e1 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:20:54 devstack sudo[92320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84.c4fb6084-07d8-4f55-854f-da01d63c65e1 1G Jul 16 23:20:54 devstack sudo[92320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:20:55 devstack sudo[92315]: pam_unix(sudo:session): session closed for user root Jul 16 23:20:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-15b1b95b-958d-4162-ba92-66973c73503a tempest-TaggedAttachmentsTest-803724708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5133854c-5f40-453d-81f2-2ef2186ddd77" returned: 0 in 0.639s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:20:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-15b1b95b-958d-4162-ba92-66973c73503a tempest-TaggedAttachmentsTest-803724708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5133854c-5f40-453d-81f2-2ef2186ddd77 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:20:55 devstack sudo[92331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5133854c-5f40-453d-81f2-2ef2186ddd77 Jul 16 23:20:55 devstack sudo[92331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:20:55 devstack sudo[92320]: pam_unix(sudo:session): session closed for user root Jul 16 23:20:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-a2316e8e-4cd3-462a-b8b7-8d2bf004809f req-c5de75f7-05a3-492b-bc00-d0c19eb5af30 tempest-VolumesSnapshotsTestJSON-78760422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84.c4fb6084-07d8-4f55-854f-da01d63c65e1 1G" returned: 0 in 0.717s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:20:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-a2316e8e-4cd3-462a-b8b7-8d2bf004809f req-c5de75f7-05a3-492b-bc00-d0c19eb5af30 tempest-VolumesSnapshotsTestJSON-78760422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30fadcc5-0010-413a-9afc-81a3f44e2f84 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84.c4fb6084-07d8-4f55-854f-da01d63c65e1 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:20:55 devstack sudo[92338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30fadcc5-0010-413a-9afc-81a3f44e2f84 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84.c4fb6084-07d8-4f55-854f-da01d63c65e1 Jul 16 23:20:55 devstack sudo[92338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:20:55 devstack sudo[92331]: pam_unix(sudo:session): session closed for user root Jul 16 23:20:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-15b1b95b-958d-4162-ba92-66973c73503a tempest-TaggedAttachmentsTest-803724708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5133854c-5f40-453d-81f2-2ef2186ddd77" returned: 0 in 0.449s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:20:55 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-15b1b95b-958d-4162-ba92-66973c73503a tempest-TaggedAttachmentsTest-803724708 None] Lock "cinder-quobyte-5133854c-5f40-453d-81f2-2ef2186ddd77" released by "delete_volume" :: held 1.148s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:20:55 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-15b1b95b-958d-4162-ba92-66973c73503a tempest-TaggedAttachmentsTest-803724708 None] Created reservations ['1ed63ce4-0191-4941-a366-ba8c1ce6f88c', '2fe5672c-1610-4c85-9669-8bb15da3c3a7', '6d91d2f1-f98c-42b3-941d-42be137a0dac', 'fe3e22b1-4672-41b4-bf4b-d78779c7fc58'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:20:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-15b1b95b-958d-4162-ba92-66973c73503a tempest-TaggedAttachmentsTest-803724708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:20:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-15b1b95b-958d-4162-ba92-66973c73503a tempest-TaggedAttachmentsTest-803724708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:20:55 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-15b1b95b-958d-4162-ba92-66973c73503a tempest-TaggedAttachmentsTest-803724708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:20:55 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-15b1b95b-958d-4162-ba92-66973c73503a tempest-TaggedAttachmentsTest-803724708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:20:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-15b1b95b-958d-4162-ba92-66973c73503a tempest-TaggedAttachmentsTest-803724708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:20:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-15b1b95b-958d-4162-ba92-66973c73503a tempest-TaggedAttachmentsTest-803724708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:20:55 devstack sudo[92345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:20:55 devstack sudo[92345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:20:55 devstack sudo[92338]: pam_unix(sudo:session): session closed for user root Jul 16 23:20:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-a2316e8e-4cd3-462a-b8b7-8d2bf004809f req-c5de75f7-05a3-492b-bc00-d0c19eb5af30 tempest-VolumesSnapshotsTestJSON-78760422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30fadcc5-0010-413a-9afc-81a3f44e2f84 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84.c4fb6084-07d8-4f55-854f-da01d63c65e1" returned: 0 in 0.442s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:20:55 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [req-a2316e8e-4cd3-462a-b8b7-8d2bf004809f req-c5de75f7-05a3-492b-bc00-d0c19eb5af30 tempest-VolumesSnapshotsTestJSON-78760422 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84.c4fb6084-07d8-4f55-854f-da01d63c65e1 is being set with open permissions: ugo+rw Jul 16 23:20:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-a2316e8e-4cd3-462a-b8b7-8d2bf004809f req-c5de75f7-05a3-492b-bc00-d0c19eb5af30 tempest-VolumesSnapshotsTestJSON-78760422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84.c4fb6084-07d8-4f55-854f-da01d63c65e1 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:20:55 devstack sudo[92347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84.c4fb6084-07d8-4f55-854f-da01d63c65e1 Jul 16 23:20:55 devstack sudo[92347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:20:56 devstack sudo[92345]: pam_unix(sudo:session): session closed for user root Jul 16 23:20:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-15b1b95b-958d-4162-ba92-66973c73503a tempest-TaggedAttachmentsTest-803724708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.299s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:20:56 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-15b1b95b-958d-4162-ba92-66973c73503a tempest-TaggedAttachmentsTest-803724708 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:20:56 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-15b1b95b-958d-4162-ba92-66973c73503a tempest-TaggedAttachmentsTest-803724708 None] Deleted volume successfully. Jul 16 23:20:56 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-15b1b95b-958d-4162-ba92-66973c73503a tempest-TaggedAttachmentsTest-803724708 None] Lock "cinder-5133854c-5f40-453d-81f2-2ef2186ddd77-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:20:56 devstack sudo[92347]: pam_unix(sudo:session): session closed for user root Jul 16 23:20:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-a2316e8e-4cd3-462a-b8b7-8d2bf004809f req-c5de75f7-05a3-492b-bc00-d0c19eb5af30 tempest-VolumesSnapshotsTestJSON-78760422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84.c4fb6084-07d8-4f55-854f-da01d63c65e1" returned: 0 in 0.297s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:20:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-a2316e8e-4cd3-462a-b8b7-8d2bf004809f req-c5de75f7-05a3-492b-bc00-d0c19eb5af30 tempest-VolumesSnapshotsTestJSON-78760422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:20:56 devstack sudo[92352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84.info Jul 16 23:20:56 devstack sudo[92352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:20:56 devstack sudo[92352]: pam_unix(sudo:session): session closed for user root Jul 16 23:20:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-a2316e8e-4cd3-462a-b8b7-8d2bf004809f req-c5de75f7-05a3-492b-bc00-d0c19eb5af30 tempest-VolumesSnapshotsTestJSON-78760422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84.info" returned: 0 in 0.298s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:20:56 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [req-a2316e8e-4cd3-462a-b8b7-8d2bf004809f req-c5de75f7-05a3-492b-bc00-d0c19eb5af30 tempest-VolumesSnapshotsTestJSON-78760422 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84.info is being set with open permissions: ugo+rw Jul 16 23:20:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-a2316e8e-4cd3-462a-b8b7-8d2bf004809f req-c5de75f7-05a3-492b-bc00-d0c19eb5af30 tempest-VolumesSnapshotsTestJSON-78760422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:20:56 devstack sudo[92355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84.info Jul 16 23:20:56 devstack sudo[92355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:20:56 devstack sudo[92355]: pam_unix(sudo:session): session closed for user root Jul 16 23:20:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-a2316e8e-4cd3-462a-b8b7-8d2bf004809f req-c5de75f7-05a3-492b-bc00-d0c19eb5af30 tempest-VolumesSnapshotsTestJSON-78760422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84.info" returned: 0 in 0.299s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:20:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-a2316e8e-4cd3-462a-b8b7-8d2bf004809f req-c5de75f7-05a3-492b-bc00-d0c19eb5af30 tempest-VolumesSnapshotsTestJSON-78760422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.762s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:20:56 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-a2316e8e-4cd3-462a-b8b7-8d2bf004809f req-c5de75f7-05a3-492b-bc00-d0c19eb5af30 tempest-VolumesSnapshotsTestJSON-78760422 None] Create snapshot completed successfully Jul 16 23:20:57 devstack cinder-volume[87607]: DEBUG cinder.coordination [req-1061dd94-a507-4053-8e05-d903ccbc4b02 req-c97fc30d-f3d8-4e8b-b320-6cf269df9d7c tempest-VolumesSnapshotsTestJSON-78760422 None] Acquiring lock "cinder-c4fb6084-07d8-4f55-854f-da01d63c65e1-delete_snapshot" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:20:57 devstack cinder-volume[87607]: DEBUG cinder.coordination [req-1061dd94-a507-4053-8e05-d903ccbc4b02 req-c97fc30d-f3d8-4e8b-b320-6cf269df9d7c tempest-VolumesSnapshotsTestJSON-78760422 None] Lock "cinder-c4fb6084-07d8-4f55-854f-da01d63c65e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:20:57 devstack cinder-volume[87607]: DEBUG cinder.coordination [req-1061dd94-a507-4053-8e05-d903ccbc4b02 req-c97fc30d-f3d8-4e8b-b320-6cf269df9d7c tempest-VolumesSnapshotsTestJSON-78760422 None] Acquiring lock "cinder-quobyte-30fadcc5-0010-413a-9afc-81a3f44e2f84" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:20:57 devstack cinder-volume[87607]: DEBUG cinder.coordination [req-1061dd94-a507-4053-8e05-d903ccbc4b02 req-c97fc30d-f3d8-4e8b-b320-6cf269df9d7c tempest-VolumesSnapshotsTestJSON-78760422 None] Lock "cinder-quobyte-30fadcc5-0010-413a-9afc-81a3f44e2f84" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:20:57 devstack cinder-volume[87607]: DEBUG cinder.coordination [req-1061dd94-a507-4053-8e05-d903ccbc4b02 req-c97fc30d-f3d8-4e8b-b320-6cf269df9d7c tempest-VolumesSnapshotsTestJSON-78760422 None] Acquiring lock "cinder-quobyte-c4fb6084-07d8-4f55-854f-da01d63c65e1" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:20:57 devstack cinder-volume[87607]: DEBUG cinder.coordination [req-1061dd94-a507-4053-8e05-d903ccbc4b02 req-c97fc30d-f3d8-4e8b-b320-6cf269df9d7c tempest-VolumesSnapshotsTestJSON-78760422 None] Lock "cinder-quobyte-c4fb6084-07d8-4f55-854f-da01d63c65e1" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:20:57 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [req-1061dd94-a507-4053-8e05-d903ccbc4b02 req-c97fc30d-f3d8-4e8b-b320-6cf269df9d7c tempest-VolumesSnapshotsTestJSON-78760422 None] Deleting offline snapshot c4fb6084-07d8-4f55-854f-da01d63c65e1 of volume 30fadcc5-0010-413a-9afc-81a3f44e2f84 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:20:57 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [req-1061dd94-a507-4053-8e05-d903ccbc4b02 req-c97fc30d-f3d8-4e8b-b320-6cf269df9d7c tempest-VolumesSnapshotsTestJSON-78760422 None] snapshot_file for this snap is: volume-30fadcc5-0010-413a-9afc-81a3f44e2f84.c4fb6084-07d8-4f55-854f-da01d63c65e1 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:20:57 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[46393eb1-c6d0-44af-aaa0-08e5a5d3ae0a]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:20:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-1061dd94-a507-4053-8e05-d903ccbc4b02 req-c97fc30d-f3d8-4e8b-b320-6cf269df9d7c tempest-VolumesSnapshotsTestJSON-78760422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84.c4fb6084-07d8-4f55-854f-da01d63c65e1 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:20:58 devstack sudo[92358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84.c4fb6084-07d8-4f55-854f-da01d63c65e1 Jul 16 23:20:58 devstack sudo[92358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:20:58 devstack sudo[92358]: pam_unix(sudo:session): session closed for user root Jul 16 23:20:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-1061dd94-a507-4053-8e05-d903ccbc4b02 req-c97fc30d-f3d8-4e8b-b320-6cf269df9d7c tempest-VolumesSnapshotsTestJSON-78760422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84.c4fb6084-07d8-4f55-854f-da01d63c65e1" returned: 0 in 0.454s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:20:58 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [req-1061dd94-a507-4053-8e05-d903ccbc4b02 req-c97fc30d-f3d8-4e8b-b320-6cf269df9d7c tempest-VolumesSnapshotsTestJSON-78760422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30fadcc5-0010-413a-9afc-81a3f44e2f84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:20:58 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae76e40-aea6-4fc4-b2c4-f40b57918df3]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:20:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-1061dd94-a507-4053-8e05-d903ccbc4b02 req-c97fc30d-f3d8-4e8b-b320-6cf269df9d7c tempest-VolumesSnapshotsTestJSON-78760422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:20:58 devstack sudo[92366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84 Jul 16 23:20:58 devstack sudo[92366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:20:58 devstack sudo[92366]: pam_unix(sudo:session): session closed for user root Jul 16 23:20:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-1061dd94-a507-4053-8e05-d903ccbc4b02 req-c97fc30d-f3d8-4e8b-b320-6cf269df9d7c tempest-VolumesSnapshotsTestJSON-78760422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84" returned: 0 in 0.420s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:20:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-1061dd94-a507-4053-8e05-d903ccbc4b02 req-c97fc30d-f3d8-4e8b-b320-6cf269df9d7c tempest-VolumesSnapshotsTestJSON-78760422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84.c4fb6084-07d8-4f55-854f-da01d63c65e1 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:20:58 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-9f2aab48-1bd3-426f-83af-8145efdae8a1 tempest-AttachVolumeShelveTestJSON-180929086 None] Acquiring lock "cinder-3e9637b4-d3f3-4ffd-b3e3-e3dd26d240c8-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:20:58 devstack sudo[92371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84.c4fb6084-07d8-4f55-854f-da01d63c65e1 Jul 16 23:20:58 devstack sudo[92371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:20:58 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-9f2aab48-1bd3-426f-83af-8145efdae8a1 tempest-AttachVolumeShelveTestJSON-180929086 None] Lock "cinder-3e9637b4-d3f3-4ffd-b3e3-e3dd26d240c8-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:20:59 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-9f2aab48-1bd3-426f-83af-8145efdae8a1 tempest-AttachVolumeShelveTestJSON-180929086 None] Acquiring lock "cinder-quobyte-3e9637b4-d3f3-4ffd-b3e3-e3dd26d240c8" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:20:59 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-9f2aab48-1bd3-426f-83af-8145efdae8a1 tempest-AttachVolumeShelveTestJSON-180929086 None] Lock "cinder-quobyte-3e9637b4-d3f3-4ffd-b3e3-e3dd26d240c8" acquired by "delete_volume" :: waited 0.017s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:20:59 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[190ac850-88b2-4930-ae67-ed3d854542ff]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:20:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-9f2aab48-1bd3-426f-83af-8145efdae8a1 tempest-AttachVolumeShelveTestJSON-180929086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e9637b4-d3f3-4ffd-b3e3-e3dd26d240c8 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:20:59 devstack sudo[92373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e9637b4-d3f3-4ffd-b3e3-e3dd26d240c8 Jul 16 23:20:59 devstack sudo[92373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:20:59 devstack sudo[92371]: pam_unix(sudo:session): session closed for user root Jul 16 23:20:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-1061dd94-a507-4053-8e05-d903ccbc4b02 req-c97fc30d-f3d8-4e8b-b320-6cf269df9d7c tempest-VolumesSnapshotsTestJSON-78760422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84.c4fb6084-07d8-4f55-854f-da01d63c65e1" returned: 0 in 0.524s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:20:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-1061dd94-a507-4053-8e05-d903ccbc4b02 req-c97fc30d-f3d8-4e8b-b320-6cf269df9d7c tempest-VolumesSnapshotsTestJSON-78760422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84.c4fb6084-07d8-4f55-854f-da01d63c65e1 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:20:59 devstack sudo[92378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84.c4fb6084-07d8-4f55-854f-da01d63c65e1 Jul 16 23:20:59 devstack sudo[92378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:20:59 devstack sudo[92373]: pam_unix(sudo:session): session closed for user root Jul 16 23:20:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-9f2aab48-1bd3-426f-83af-8145efdae8a1 tempest-AttachVolumeShelveTestJSON-180929086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e9637b4-d3f3-4ffd-b3e3-e3dd26d240c8" returned: 0 in 0.466s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:20:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-9f2aab48-1bd3-426f-83af-8145efdae8a1 tempest-AttachVolumeShelveTestJSON-180929086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e9637b4-d3f3-4ffd-b3e3-e3dd26d240c8 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:20:59 devstack sudo[92383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e9637b4-d3f3-4ffd-b3e3-e3dd26d240c8 Jul 16 23:20:59 devstack sudo[92383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:20:59 devstack sudo[92378]: pam_unix(sudo:session): session closed for user root Jul 16 23:20:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-1061dd94-a507-4053-8e05-d903ccbc4b02 req-c97fc30d-f3d8-4e8b-b320-6cf269df9d7c tempest-VolumesSnapshotsTestJSON-78760422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84.c4fb6084-07d8-4f55-854f-da01d63c65e1" returned: 0 in 0.384s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:20:59 devstack cinder-volume[87607]: DEBUG cinder.coordination [req-1061dd94-a507-4053-8e05-d903ccbc4b02 req-c97fc30d-f3d8-4e8b-b320-6cf269df9d7c tempest-VolumesSnapshotsTestJSON-78760422 None] Lock "cinder-quobyte-c4fb6084-07d8-4f55-854f-da01d63c65e1" released by "_delete_snapshot" :: held 1.924s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:20:59 devstack cinder-volume[87607]: DEBUG cinder.coordination [req-1061dd94-a507-4053-8e05-d903ccbc4b02 req-c97fc30d-f3d8-4e8b-b320-6cf269df9d7c tempest-VolumesSnapshotsTestJSON-78760422 None] Lock "cinder-quobyte-30fadcc5-0010-413a-9afc-81a3f44e2f84" released by "delete_snapshot" :: held 1.954s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:20:59 devstack cinder-volume[87607]: WARNING cinder.quota [req-1061dd94-a507-4053-8e05-d903ccbc4b02 req-c97fc30d-f3d8-4e8b-b320-6cf269df9d7c tempest-VolumesSnapshotsTestJSON-78760422 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 16 23:20:59 devstack sudo[92383]: pam_unix(sudo:session): session closed for user root Jul 16 23:20:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-9f2aab48-1bd3-426f-83af-8145efdae8a1 tempest-AttachVolumeShelveTestJSON-180929086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e9637b4-d3f3-4ffd-b3e3-e3dd26d240c8" returned: 0 in 0.365s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:20:59 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-9f2aab48-1bd3-426f-83af-8145efdae8a1 tempest-AttachVolumeShelveTestJSON-180929086 None] Lock "cinder-quobyte-3e9637b4-d3f3-4ffd-b3e3-e3dd26d240c8" released by "delete_volume" :: held 0.888s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:20:59 devstack cinder-volume[87607]: DEBUG cinder.quota [req-1061dd94-a507-4053-8e05-d903ccbc4b02 req-c97fc30d-f3d8-4e8b-b320-6cf269df9d7c tempest-VolumesSnapshotsTestJSON-78760422 None] Created reservations ['ed1e254b-db50-4954-94b2-842aaabb1497', 'b0fb9192-bdb9-4dd1-bdf2-b8b243cf6855', '630afbf7-416b-47fe-9029-5f26b82b5732', 'd33b9468-107e-464c-a9a0-198e67e0a24e'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:21:00 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-9f2aab48-1bd3-426f-83af-8145efdae8a1 tempest-AttachVolumeShelveTestJSON-180929086 None] Created reservations ['e14eb672-44b5-4064-ac03-a8abe2eb0b81', 'dcaf5e7e-b551-4f79-99ee-e991f69f36bc', '0316633f-37b0-4df9-8037-62f785fdcbd0', 'd6f13115-a2c4-49d1-be57-6574918c08a9'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:21:00 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-1061dd94-a507-4053-8e05-d903ccbc4b02 req-c97fc30d-f3d8-4e8b-b320-6cf269df9d7c tempest-VolumesSnapshotsTestJSON-78760422 None] Delete snapshot completed successfully. Jul 16 23:21:00 devstack cinder-volume[87607]: DEBUG cinder.coordination [req-1061dd94-a507-4053-8e05-d903ccbc4b02 req-c97fc30d-f3d8-4e8b-b320-6cf269df9d7c tempest-VolumesSnapshotsTestJSON-78760422 None] Lock "cinder-c4fb6084-07d8-4f55-854f-da01d63c65e1-delete_snapshot" released by "delete_snapshot" :: held 2.281s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:21:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-9f2aab48-1bd3-426f-83af-8145efdae8a1 tempest-AttachVolumeShelveTestJSON-180929086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:21:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-9f2aab48-1bd3-426f-83af-8145efdae8a1 tempest-AttachVolumeShelveTestJSON-180929086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:21:00 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-9f2aab48-1bd3-426f-83af-8145efdae8a1 tempest-AttachVolumeShelveTestJSON-180929086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:21:00 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-9f2aab48-1bd3-426f-83af-8145efdae8a1 tempest-AttachVolumeShelveTestJSON-180929086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:21:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-9f2aab48-1bd3-426f-83af-8145efdae8a1 tempest-AttachVolumeShelveTestJSON-180929086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:21:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-9f2aab48-1bd3-426f-83af-8145efdae8a1 tempest-AttachVolumeShelveTestJSON-180929086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:00 devstack sudo[92387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:21:00 devstack sudo[92387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:00 devstack cinder-volume[87607]: DEBUG cinder.coordination [req-80925769-e471-4efb-8819-dadfd09aa88a req-885548f8-9558-4f0d-a8bf-fe3f66d5d0e9 tempest-VolumesSnapshotsTestJSON-78760422 None] Acquiring lock "cinder-30fadcc5-0010-413a-9afc-81a3f44e2f84-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:21:00 devstack cinder-volume[87607]: DEBUG cinder.coordination [req-80925769-e471-4efb-8819-dadfd09aa88a req-885548f8-9558-4f0d-a8bf-fe3f66d5d0e9 tempest-VolumesSnapshotsTestJSON-78760422 None] Lock "cinder-30fadcc5-0010-413a-9afc-81a3f44e2f84-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:21:00 devstack cinder-volume[87607]: DEBUG cinder.coordination [req-80925769-e471-4efb-8819-dadfd09aa88a req-885548f8-9558-4f0d-a8bf-fe3f66d5d0e9 tempest-VolumesSnapshotsTestJSON-78760422 None] Acquiring lock "cinder-quobyte-30fadcc5-0010-413a-9afc-81a3f44e2f84" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:21:00 devstack cinder-volume[87607]: DEBUG cinder.coordination [req-80925769-e471-4efb-8819-dadfd09aa88a req-885548f8-9558-4f0d-a8bf-fe3f66d5d0e9 tempest-VolumesSnapshotsTestJSON-78760422 None] Lock "cinder-quobyte-30fadcc5-0010-413a-9afc-81a3f44e2f84" acquired by "delete_volume" :: waited 0.030s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:21:00 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5042a6-cf8f-4c28-a3c0-b9aeac025fd6]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:21:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-80925769-e471-4efb-8819-dadfd09aa88a req-885548f8-9558-4f0d-a8bf-fe3f66d5d0e9 tempest-VolumesSnapshotsTestJSON-78760422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:00 devstack sudo[92387]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-9f2aab48-1bd3-426f-83af-8145efdae8a1 tempest-AttachVolumeShelveTestJSON-180929086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.368s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:00 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-9f2aab48-1bd3-426f-83af-8145efdae8a1 tempest-AttachVolumeShelveTestJSON-180929086 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:21:00 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-9f2aab48-1bd3-426f-83af-8145efdae8a1 tempest-AttachVolumeShelveTestJSON-180929086 None] Deleted volume successfully. Jul 16 23:21:00 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-9f2aab48-1bd3-426f-83af-8145efdae8a1 tempest-AttachVolumeShelveTestJSON-180929086 None] Lock "cinder-3e9637b4-d3f3-4ffd-b3e3-e3dd26d240c8-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:21:00 devstack sudo[92390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84 Jul 16 23:21:00 devstack sudo[92390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:00 devstack sudo[92390]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-80925769-e471-4efb-8819-dadfd09aa88a req-885548f8-9558-4f0d-a8bf-fe3f66d5d0e9 tempest-VolumesSnapshotsTestJSON-78760422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84" returned: 0 in 0.465s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-80925769-e471-4efb-8819-dadfd09aa88a req-885548f8-9558-4f0d-a8bf-fe3f66d5d0e9 tempest-VolumesSnapshotsTestJSON-78760422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:00 devstack sudo[92396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84 Jul 16 23:21:00 devstack sudo[92396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:01 devstack sudo[92396]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-80925769-e471-4efb-8819-dadfd09aa88a req-885548f8-9558-4f0d-a8bf-fe3f66d5d0e9 tempest-VolumesSnapshotsTestJSON-78760422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-30fadcc5-0010-413a-9afc-81a3f44e2f84" returned: 0 in 0.290s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:01 devstack cinder-volume[87607]: DEBUG cinder.coordination [req-80925769-e471-4efb-8819-dadfd09aa88a req-885548f8-9558-4f0d-a8bf-fe3f66d5d0e9 tempest-VolumesSnapshotsTestJSON-78760422 None] Lock "cinder-quobyte-30fadcc5-0010-413a-9afc-81a3f44e2f84" released by "delete_volume" :: held 0.860s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:21:01 devstack cinder-volume[87607]: DEBUG cinder.quota [req-80925769-e471-4efb-8819-dadfd09aa88a req-885548f8-9558-4f0d-a8bf-fe3f66d5d0e9 tempest-VolumesSnapshotsTestJSON-78760422 None] Created reservations ['e2fed665-545a-418a-978b-d854ccb34818', 'b92067a0-a710-47b8-9f31-2cbe41450235', '3da8dfc4-f98c-4cc5-afe3-0336c10b3f34', '735a1609-3f86-4e69-9b3d-d0c37a0d06f2'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:21:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-80925769-e471-4efb-8819-dadfd09aa88a req-885548f8-9558-4f0d-a8bf-fe3f66d5d0e9 tempest-VolumesSnapshotsTestJSON-78760422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:21:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-80925769-e471-4efb-8819-dadfd09aa88a req-885548f8-9558-4f0d-a8bf-fe3f66d5d0e9 tempest-VolumesSnapshotsTestJSON-78760422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:21:01 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [req-80925769-e471-4efb-8819-dadfd09aa88a req-885548f8-9558-4f0d-a8bf-fe3f66d5d0e9 tempest-VolumesSnapshotsTestJSON-78760422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:21:01 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [req-80925769-e471-4efb-8819-dadfd09aa88a req-885548f8-9558-4f0d-a8bf-fe3f66d5d0e9 tempest-VolumesSnapshotsTestJSON-78760422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:21:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-80925769-e471-4efb-8819-dadfd09aa88a req-885548f8-9558-4f0d-a8bf-fe3f66d5d0e9 tempest-VolumesSnapshotsTestJSON-78760422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:21:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-80925769-e471-4efb-8819-dadfd09aa88a req-885548f8-9558-4f0d-a8bf-fe3f66d5d0e9 tempest-VolumesSnapshotsTestJSON-78760422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:01 devstack sudo[92399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:21:01 devstack sudo[92399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:01 devstack sudo[92399]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-80925769-e471-4efb-8819-dadfd09aa88a req-885548f8-9558-4f0d-a8bf-fe3f66d5d0e9 tempest-VolumesSnapshotsTestJSON-78760422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.318s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:01 devstack cinder-volume[87607]: DEBUG cinder.manager [req-80925769-e471-4efb-8819-dadfd09aa88a req-885548f8-9558-4f0d-a8bf-fe3f66d5d0e9 tempest-VolumesSnapshotsTestJSON-78760422 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:21:01 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-80925769-e471-4efb-8819-dadfd09aa88a req-885548f8-9558-4f0d-a8bf-fe3f66d5d0e9 tempest-VolumesSnapshotsTestJSON-78760422 None] Deleted volume successfully. Jul 16 23:21:01 devstack cinder-volume[87607]: DEBUG cinder.coordination [req-80925769-e471-4efb-8819-dadfd09aa88a req-885548f8-9558-4f0d-a8bf-fe3f66d5d0e9 tempest-VolumesSnapshotsTestJSON-78760422 None] Lock "cinder-30fadcc5-0010-413a-9afc-81a3f44e2f84-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:21:06 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-460ea193-1abb-4f4a-a734-ef35fc8ff277 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:21:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-460ea193-1abb-4f4a-a734-ef35fc8ff277 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Flow 'volume_create_manager' (6b86ef2d-53e3-46d9-9ee8-936ef8cd570d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:21:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-460ea193-1abb-4f4a-a734-ef35fc8ff277 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40f9adc2-7cb8-421e-8a5d-aad0ec83885c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-460ea193-1abb-4f4a-a734-ef35fc8ff277 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40f9adc2-7cb8-421e-8a5d-aad0ec83885c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-541234888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84fac046-ca2c-478d-8c6e-b02b20cb7596,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd0a3fc35d274315b865ff75970940aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:21:06Z,use_quota=True,user_id='f4ccd6bb1ee0487aa35715352272e3ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ca5030c-2af4-40ce-8ce8-d461e4e7f663),volume_type_id=6ca5030c-2af4-40ce-8ce8-d461e4e7f663)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-460ea193-1abb-4f4a-a734-ef35fc8ff277 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9323b944-156e-445b-b155-d735a706f96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-460ea193-1abb-4f4a-a734-ef35fc8ff277 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9323b944-156e-445b-b155-d735a706f96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-460ea193-1abb-4f4a-a734-ef35fc8ff277 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af324248-71d4-44a3-88e8-72f646cdc3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-460ea193-1abb-4f4a-a734-ef35fc8ff277 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af324248-71d4-44a3-88e8-72f646cdc3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84fac046-ca2c-478d-8c6e-b02b20cb7596', 'volume_name': 'volume-84fac046-ca2c-478d-8c6e-b02b20cb7596', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-460ea193-1abb-4f4a-a734-ef35fc8ff277 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69a17cef-29e4-4816-a7f2-55e7e6edcde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-460ea193-1abb-4f4a-a734-ef35fc8ff277 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69a17cef-29e4-4816-a7f2-55e7e6edcde8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-460ea193-1abb-4f4a-a734-ef35fc8ff277 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86d396f3-b75c-44dc-83d9-c1ea1a2a1089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:06 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-460ea193-1abb-4f4a-a734-ef35fc8ff277 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Volume 84fac046-ca2c-478d-8c6e-b02b20cb7596: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84fac046-ca2c-478d-8c6e-b02b20cb7596', 'volume_size': 1} Jul 16 23:21:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-460ea193-1abb-4f4a-a734-ef35fc8ff277 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:21:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-460ea193-1abb-4f4a-a734-ef35fc8ff277 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:21:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-460ea193-1abb-4f4a-a734-ef35fc8ff277 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-541234888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84fac046-ca2c-478d-8c6e-b02b20cb7596,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd0a3fc35d274315b865ff75970940aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:21:06Z,use_quota=True,user_id='f4ccd6bb1ee0487aa35715352272e3ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ca5030c-2af4-40ce-8ce8-d461e4e7f663),volume_type_id=6ca5030c-2af4-40ce-8ce8-d461e4e7f663)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:21:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-460ea193-1abb-4f4a-a734-ef35fc8ff277 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Creating volume 84fac046-ca2c-478d-8c6e-b02b20cb7596 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:21:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-460ea193-1abb-4f4a-a734-ef35fc8ff277 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:21:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-460ea193-1abb-4f4a-a734-ef35fc8ff277 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:21:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-460ea193-1abb-4f4a-a734-ef35fc8ff277 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:21:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-460ea193-1abb-4f4a-a734-ef35fc8ff277 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:21:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-460ea193-1abb-4f4a-a734-ef35fc8ff277 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:21:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-460ea193-1abb-4f4a-a734-ef35fc8ff277 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:21:06 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-460ea193-1abb-4f4a-a734-ef35fc8ff277 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:21:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-460ea193-1abb-4f4a-a734-ef35fc8ff277 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-84fac046-ca2c-478d-8c6e-b02b20cb7596 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:06 devstack sudo[92407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-84fac046-ca2c-478d-8c6e-b02b20cb7596 1073741824 Jul 16 23:21:06 devstack sudo[92407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:06 devstack sudo[92407]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-460ea193-1abb-4f4a-a734-ef35fc8ff277 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-84fac046-ca2c-478d-8c6e-b02b20cb7596 1073741824" returned: 0 in 0.541s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-460ea193-1abb-4f4a-a734-ef35fc8ff277 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-84fac046-ca2c-478d-8c6e-b02b20cb7596 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:06 devstack sudo[92414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-84fac046-ca2c-478d-8c6e-b02b20cb7596 Jul 16 23:21:06 devstack sudo[92414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:07 devstack sudo[92414]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-460ea193-1abb-4f4a-a734-ef35fc8ff277 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-84fac046-ca2c-478d-8c6e-b02b20cb7596" returned: 0 in 0.289s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:07 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-460ea193-1abb-4f4a-a734-ef35fc8ff277 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:21:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-460ea193-1abb-4f4a-a734-ef35fc8ff277 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:21:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-460ea193-1abb-4f4a-a734-ef35fc8ff277 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86d396f3-b75c-44dc-83d9-c1ea1a2a1089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84fac046-ca2c-478d-8c6e-b02b20cb7596', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-460ea193-1abb-4f4a-a734-ef35fc8ff277 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e390190b-f867-4a6e-b942-f4f7a27f9b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:07 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-460ea193-1abb-4f4a-a734-ef35fc8ff277 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Volume volume-84fac046-ca2c-478d-8c6e-b02b20cb7596 (84fac046-ca2c-478d-8c6e-b02b20cb7596): created successfully Jul 16 23:21:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-460ea193-1abb-4f4a-a734-ef35fc8ff277 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e390190b-f867-4a6e-b942-f4f7a27f9b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-460ea193-1abb-4f4a-a734-ef35fc8ff277 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Flow 'volume_create_manager' (6b86ef2d-53e3-46d9-9ee8-936ef8cd570d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:21:07 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-460ea193-1abb-4f4a-a734-ef35fc8ff277 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Created volume successfully. Jul 16 23:21:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0206f9ff-0e9d-43d5-abbe-cc9c18f03cb9 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:21:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0206f9ff-0e9d-43d5-abbe-cc9c18f03cb9 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:21:08 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0206f9ff-0e9d-43d5-abbe-cc9c18f03cb9 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:21:08 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0206f9ff-0e9d-43d5-abbe-cc9c18f03cb9 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:21:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0206f9ff-0e9d-43d5-abbe-cc9c18f03cb9 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:21:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0206f9ff-0e9d-43d5-abbe-cc9c18f03cb9 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:08 devstack sudo[92419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:21:08 devstack sudo[92419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:09 devstack sudo[92419]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0206f9ff-0e9d-43d5-abbe-cc9c18f03cb9 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.288s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:09 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-0206f9ff-0e9d-43d5-abbe-cc9c18f03cb9 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:21:09 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-0206f9ff-0e9d-43d5-abbe-cc9c18f03cb9 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Retype volume completed successfully. Jul 16 23:21:09 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-800c6d1b-5a6f-46ae-84a9-de99ea39fde6 tempest-VolumesTestJSON-1359421791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:21:09 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-800c6d1b-5a6f-46ae-84a9-de99ea39fde6 tempest-VolumesTestJSON-1359421791 None] Flow 'volume_create_manager' (6d092374-480b-4fbc-96c9-d6db1a172327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:21:09 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-800c6d1b-5a6f-46ae-84a9-de99ea39fde6 tempest-VolumesTestJSON-1359421791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7164603a-a983-4a68-a5e4-71423b50f8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:09 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-800c6d1b-5a6f-46ae-84a9-de99ea39fde6 tempest-VolumesTestJSON-1359421791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7164603a-a983-4a68-a5e4-71423b50f8e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1554063797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ea78659-07eb-4a4d-9d79-f0e6141ddcbc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c987833fcdc14532943c3a2baf9b97ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:21:09Z,use_quota=True,user_id='d9ea060c3fff43a6ae5c540ab8c2b982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:09 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-800c6d1b-5a6f-46ae-84a9-de99ea39fde6 tempest-VolumesTestJSON-1359421791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46799e0-f89f-49c0-8d86-e86df055d87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:09 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-800c6d1b-5a6f-46ae-84a9-de99ea39fde6 tempest-VolumesTestJSON-1359421791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46799e0-f89f-49c0-8d86-e86df055d87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:09 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-800c6d1b-5a6f-46ae-84a9-de99ea39fde6 tempest-VolumesTestJSON-1359421791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b1245a-a63e-4dea-b29c-3fa3b4284ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:09 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-800c6d1b-5a6f-46ae-84a9-de99ea39fde6 tempest-VolumesTestJSON-1359421791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b1245a-a63e-4dea-b29c-3fa3b4284ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ea78659-07eb-4a4d-9d79-f0e6141ddcbc', 'volume_name': 'volume-4ea78659-07eb-4a4d-9d79-f0e6141ddcbc', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:09 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-800c6d1b-5a6f-46ae-84a9-de99ea39fde6 tempest-VolumesTestJSON-1359421791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2300d4cb-057a-4cf2-8c50-a2b1813d64db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:09 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-800c6d1b-5a6f-46ae-84a9-de99ea39fde6 tempest-VolumesTestJSON-1359421791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2300d4cb-057a-4cf2-8c50-a2b1813d64db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:09 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-800c6d1b-5a6f-46ae-84a9-de99ea39fde6 tempest-VolumesTestJSON-1359421791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f57594-133d-42c7-aae6-7d7dbeb5f14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:09 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-800c6d1b-5a6f-46ae-84a9-de99ea39fde6 tempest-VolumesTestJSON-1359421791 None] Volume 4ea78659-07eb-4a4d-9d79-f0e6141ddcbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ea78659-07eb-4a4d-9d79-f0e6141ddcbc', 'volume_size': 1} Jul 16 23:21:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-800c6d1b-5a6f-46ae-84a9-de99ea39fde6 tempest-VolumesTestJSON-1359421791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:21:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-800c6d1b-5a6f-46ae-84a9-de99ea39fde6 tempest-VolumesTestJSON-1359421791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:21:09 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-800c6d1b-5a6f-46ae-84a9-de99ea39fde6 tempest-VolumesTestJSON-1359421791 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1554063797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ea78659-07eb-4a4d-9d79-f0e6141ddcbc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c987833fcdc14532943c3a2baf9b97ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:21:09Z,use_quota=True,user_id='d9ea060c3fff43a6ae5c540ab8c2b982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:21:09 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-800c6d1b-5a6f-46ae-84a9-de99ea39fde6 tempest-VolumesTestJSON-1359421791 None] Creating volume 4ea78659-07eb-4a4d-9d79-f0e6141ddcbc {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:21:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-800c6d1b-5a6f-46ae-84a9-de99ea39fde6 tempest-VolumesTestJSON-1359421791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:21:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-800c6d1b-5a6f-46ae-84a9-de99ea39fde6 tempest-VolumesTestJSON-1359421791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:21:09 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-800c6d1b-5a6f-46ae-84a9-de99ea39fde6 tempest-VolumesTestJSON-1359421791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:21:09 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-800c6d1b-5a6f-46ae-84a9-de99ea39fde6 tempest-VolumesTestJSON-1359421791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:21:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-800c6d1b-5a6f-46ae-84a9-de99ea39fde6 tempest-VolumesTestJSON-1359421791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:21:09 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-800c6d1b-5a6f-46ae-84a9-de99ea39fde6 tempest-VolumesTestJSON-1359421791 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:21:09 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-800c6d1b-5a6f-46ae-84a9-de99ea39fde6 tempest-VolumesTestJSON-1359421791 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:21:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-800c6d1b-5a6f-46ae-84a9-de99ea39fde6 tempest-VolumesTestJSON-1359421791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4ea78659-07eb-4a4d-9d79-f0e6141ddcbc 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:09 devstack sudo[92422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4ea78659-07eb-4a4d-9d79-f0e6141ddcbc 1073741824 Jul 16 23:21:09 devstack sudo[92422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:10 devstack sudo[92422]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:10 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-423e6033-4431-47ce-a400-662b92a41d63 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Acquiring lock "cinder-84fac046-ca2c-478d-8c6e-b02b20cb7596-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:21:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-800c6d1b-5a6f-46ae-84a9-de99ea39fde6 tempest-VolumesTestJSON-1359421791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4ea78659-07eb-4a4d-9d79-f0e6141ddcbc 1073741824" returned: 0 in 0.574s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:10 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-423e6033-4431-47ce-a400-662b92a41d63 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Lock "cinder-84fac046-ca2c-478d-8c6e-b02b20cb7596-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:21:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-800c6d1b-5a6f-46ae-84a9-de99ea39fde6 tempest-VolumesTestJSON-1359421791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4ea78659-07eb-4a4d-9d79-f0e6141ddcbc {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:10 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-423e6033-4431-47ce-a400-662b92a41d63 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Acquiring lock "cinder-quobyte-84fac046-ca2c-478d-8c6e-b02b20cb7596" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:21:10 devstack sudo[92428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4ea78659-07eb-4a4d-9d79-f0e6141ddcbc Jul 16 23:21:10 devstack sudo[92428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:10 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-423e6033-4431-47ce-a400-662b92a41d63 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Lock "cinder-quobyte-84fac046-ca2c-478d-8c6e-b02b20cb7596" acquired by "delete_volume" :: waited 0.036s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:21:10 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19666cf-7767-4a3c-aaaa-bfc29561bf1d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:21:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-423e6033-4431-47ce-a400-662b92a41d63 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-84fac046-ca2c-478d-8c6e-b02b20cb7596 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:10 devstack sudo[92430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-84fac046-ca2c-478d-8c6e-b02b20cb7596 Jul 16 23:21:10 devstack sudo[92430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:10 devstack sudo[92428]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-800c6d1b-5a6f-46ae-84a9-de99ea39fde6 tempest-VolumesTestJSON-1359421791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4ea78659-07eb-4a4d-9d79-f0e6141ddcbc" returned: 0 in 0.332s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:10 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-800c6d1b-5a6f-46ae-84a9-de99ea39fde6 tempest-VolumesTestJSON-1359421791 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:21:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-800c6d1b-5a6f-46ae-84a9-de99ea39fde6 tempest-VolumesTestJSON-1359421791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:21:10 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-800c6d1b-5a6f-46ae-84a9-de99ea39fde6 tempest-VolumesTestJSON-1359421791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f57594-133d-42c7-aae6-7d7dbeb5f14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ea78659-07eb-4a4d-9d79-f0e6141ddcbc', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:10 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-800c6d1b-5a6f-46ae-84a9-de99ea39fde6 tempest-VolumesTestJSON-1359421791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1c7ba24-4073-469a-9dd4-be10edf0af11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:10 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-800c6d1b-5a6f-46ae-84a9-de99ea39fde6 tempest-VolumesTestJSON-1359421791 None] Volume volume-4ea78659-07eb-4a4d-9d79-f0e6141ddcbc (4ea78659-07eb-4a4d-9d79-f0e6141ddcbc): created successfully Jul 16 23:21:10 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-800c6d1b-5a6f-46ae-84a9-de99ea39fde6 tempest-VolumesTestJSON-1359421791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1c7ba24-4073-469a-9dd4-be10edf0af11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:10 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-800c6d1b-5a6f-46ae-84a9-de99ea39fde6 tempest-VolumesTestJSON-1359421791 None] Flow 'volume_create_manager' (6d092374-480b-4fbc-96c9-d6db1a172327) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:21:10 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-800c6d1b-5a6f-46ae-84a9-de99ea39fde6 tempest-VolumesTestJSON-1359421791 None] Created volume successfully. Jul 16 23:21:10 devstack sudo[92430]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-423e6033-4431-47ce-a400-662b92a41d63 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-84fac046-ca2c-478d-8c6e-b02b20cb7596" returned: 0 in 0.473s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-423e6033-4431-47ce-a400-662b92a41d63 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-84fac046-ca2c-478d-8c6e-b02b20cb7596 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:10 devstack sudo[92437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-84fac046-ca2c-478d-8c6e-b02b20cb7596 Jul 16 23:21:10 devstack sudo[92437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:11 devstack sudo[92437]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-423e6033-4431-47ce-a400-662b92a41d63 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-84fac046-ca2c-478d-8c6e-b02b20cb7596" returned: 0 in 0.292s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:11 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-423e6033-4431-47ce-a400-662b92a41d63 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Lock "cinder-quobyte-84fac046-ca2c-478d-8c6e-b02b20cb7596" released by "delete_volume" :: held 0.837s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:21:11 devstack cinder-volume[87607]: WARNING cinder.quota [None req-423e6033-4431-47ce-a400-662b92a41d63 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 16 23:21:11 devstack cinder-volume[87607]: WARNING cinder.quota [None req-423e6033-4431-47ce-a400-662b92a41d63 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 16 23:21:11 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-423e6033-4431-47ce-a400-662b92a41d63 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Created reservations ['108ea07a-54e5-44ab-a222-9f8131c5e322', '1a72b656-50d1-4501-863c-f8c3c6bc852b', 'bff58fe0-8af0-4215-bd83-4bbccd13e164', '10b92175-d2c5-4641-987f-6c3c34078e6e'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:21:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-423e6033-4431-47ce-a400-662b92a41d63 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:21:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-423e6033-4431-47ce-a400-662b92a41d63 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:21:11 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-423e6033-4431-47ce-a400-662b92a41d63 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:21:11 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-423e6033-4431-47ce-a400-662b92a41d63 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:21:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-423e6033-4431-47ce-a400-662b92a41d63 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:21:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-423e6033-4431-47ce-a400-662b92a41d63 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:11 devstack sudo[92440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:21:11 devstack sudo[92440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:11 devstack sudo[92440]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-423e6033-4431-47ce-a400-662b92a41d63 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.384s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:11 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-423e6033-4431-47ce-a400-662b92a41d63 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:21:11 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-423e6033-4431-47ce-a400-662b92a41d63 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Deleted volume successfully. Jul 16 23:21:11 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-423e6033-4431-47ce-a400-662b92a41d63 tempest-VolumeRetypeWithoutMigrationTest-1550121764 None] Lock "cinder-84fac046-ca2c-478d-8c6e-b02b20cb7596-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:21:12 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-7582411a-2730-45c1-91ed-d13e64fc3e30 tempest-VolumesTestJSON-1359421791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:21:12 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7582411a-2730-45c1-91ed-d13e64fc3e30 tempest-VolumesTestJSON-1359421791 None] Flow 'volume_create_manager' (082787fc-fdfd-4c50-9d75-201f288309ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:21:12 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7582411a-2730-45c1-91ed-d13e64fc3e30 tempest-VolumesTestJSON-1359421791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b326187-30b2-487b-aeb1-5092553d94dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:12 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7582411a-2730-45c1-91ed-d13e64fc3e30 tempest-VolumesTestJSON-1359421791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b326187-30b2-487b-aeb1-5092553d94dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1363301738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2e5b671-b857-40cc-b887-a0528d7fc6c4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c987833fcdc14532943c3a2baf9b97ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:21:12Z,use_quota=True,user_id='d9ea060c3fff43a6ae5c540ab8c2b982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:12 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7582411a-2730-45c1-91ed-d13e64fc3e30 tempest-VolumesTestJSON-1359421791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (926dad7f-ed33-4062-97d0-04d79598198f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:12 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7582411a-2730-45c1-91ed-d13e64fc3e30 tempest-VolumesTestJSON-1359421791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (926dad7f-ed33-4062-97d0-04d79598198f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:12 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7582411a-2730-45c1-91ed-d13e64fc3e30 tempest-VolumesTestJSON-1359421791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9083d71e-e43a-49dd-95e2-b8ce3d54bc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:12 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7582411a-2730-45c1-91ed-d13e64fc3e30 tempest-VolumesTestJSON-1359421791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9083d71e-e43a-49dd-95e2-b8ce3d54bc2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2e5b671-b857-40cc-b887-a0528d7fc6c4', 'volume_name': 'volume-d2e5b671-b857-40cc-b887-a0528d7fc6c4', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:12 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7582411a-2730-45c1-91ed-d13e64fc3e30 tempest-VolumesTestJSON-1359421791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be9ff89f-504b-4607-8513-6d2b45d9f807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:12 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7582411a-2730-45c1-91ed-d13e64fc3e30 tempest-VolumesTestJSON-1359421791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be9ff89f-504b-4607-8513-6d2b45d9f807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:12 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7582411a-2730-45c1-91ed-d13e64fc3e30 tempest-VolumesTestJSON-1359421791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e58fe38-217c-4228-8ea5-5a558a2f268f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:12 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-7582411a-2730-45c1-91ed-d13e64fc3e30 tempest-VolumesTestJSON-1359421791 None] Volume d2e5b671-b857-40cc-b887-a0528d7fc6c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2e5b671-b857-40cc-b887-a0528d7fc6c4', 'volume_size': 1} Jul 16 23:21:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7582411a-2730-45c1-91ed-d13e64fc3e30 tempest-VolumesTestJSON-1359421791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:21:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7582411a-2730-45c1-91ed-d13e64fc3e30 tempest-VolumesTestJSON-1359421791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:21:12 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-7582411a-2730-45c1-91ed-d13e64fc3e30 tempest-VolumesTestJSON-1359421791 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1363301738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2e5b671-b857-40cc-b887-a0528d7fc6c4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c987833fcdc14532943c3a2baf9b97ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:21:12Z,use_quota=True,user_id='d9ea060c3fff43a6ae5c540ab8c2b982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:21:12 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-7582411a-2730-45c1-91ed-d13e64fc3e30 tempest-VolumesTestJSON-1359421791 None] Creating volume d2e5b671-b857-40cc-b887-a0528d7fc6c4 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:21:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7582411a-2730-45c1-91ed-d13e64fc3e30 tempest-VolumesTestJSON-1359421791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:21:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7582411a-2730-45c1-91ed-d13e64fc3e30 tempest-VolumesTestJSON-1359421791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:21:12 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-7582411a-2730-45c1-91ed-d13e64fc3e30 tempest-VolumesTestJSON-1359421791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:21:12 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-7582411a-2730-45c1-91ed-d13e64fc3e30 tempest-VolumesTestJSON-1359421791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:21:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7582411a-2730-45c1-91ed-d13e64fc3e30 tempest-VolumesTestJSON-1359421791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:21:12 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-7582411a-2730-45c1-91ed-d13e64fc3e30 tempest-VolumesTestJSON-1359421791 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:21:12 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-7582411a-2730-45c1-91ed-d13e64fc3e30 tempest-VolumesTestJSON-1359421791 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:21:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7582411a-2730-45c1-91ed-d13e64fc3e30 tempest-VolumesTestJSON-1359421791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2e5b671-b857-40cc-b887-a0528d7fc6c4 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:12 devstack sudo[92443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2e5b671-b857-40cc-b887-a0528d7fc6c4 1073741824 Jul 16 23:21:12 devstack sudo[92443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:13 devstack sudo[92443]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7582411a-2730-45c1-91ed-d13e64fc3e30 tempest-VolumesTestJSON-1359421791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2e5b671-b857-40cc-b887-a0528d7fc6c4 1073741824" returned: 0 in 0.531s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7582411a-2730-45c1-91ed-d13e64fc3e30 tempest-VolumesTestJSON-1359421791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2e5b671-b857-40cc-b887-a0528d7fc6c4 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:13 devstack sudo[92449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2e5b671-b857-40cc-b887-a0528d7fc6c4 Jul 16 23:21:13 devstack sudo[92449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:13 devstack sudo[92449]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7582411a-2730-45c1-91ed-d13e64fc3e30 tempest-VolumesTestJSON-1359421791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2e5b671-b857-40cc-b887-a0528d7fc6c4" returned: 0 in 0.399s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:13 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-7582411a-2730-45c1-91ed-d13e64fc3e30 tempest-VolumesTestJSON-1359421791 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:21:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7582411a-2730-45c1-91ed-d13e64fc3e30 tempest-VolumesTestJSON-1359421791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:21:13 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7582411a-2730-45c1-91ed-d13e64fc3e30 tempest-VolumesTestJSON-1359421791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e58fe38-217c-4228-8ea5-5a558a2f268f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2e5b671-b857-40cc-b887-a0528d7fc6c4', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:13 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7582411a-2730-45c1-91ed-d13e64fc3e30 tempest-VolumesTestJSON-1359421791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (165cf4f1-3efd-4280-8c32-ce4c3b801e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:13 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-7582411a-2730-45c1-91ed-d13e64fc3e30 tempest-VolumesTestJSON-1359421791 None] Volume volume-d2e5b671-b857-40cc-b887-a0528d7fc6c4 (d2e5b671-b857-40cc-b887-a0528d7fc6c4): created successfully Jul 16 23:21:13 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7582411a-2730-45c1-91ed-d13e64fc3e30 tempest-VolumesTestJSON-1359421791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (165cf4f1-3efd-4280-8c32-ce4c3b801e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:13 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7582411a-2730-45c1-91ed-d13e64fc3e30 tempest-VolumesTestJSON-1359421791 None] Flow 'volume_create_manager' (082787fc-fdfd-4c50-9d75-201f288309ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:21:13 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-7582411a-2730-45c1-91ed-d13e64fc3e30 tempest-VolumesTestJSON-1359421791 None] Created volume successfully. Jul 16 23:21:15 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fcb5789-32c1-4e72-b279-282d4c6f3dbe tempest-VolumesTestJSON-1359421791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:21:15 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5fcb5789-32c1-4e72-b279-282d4c6f3dbe tempest-VolumesTestJSON-1359421791 None] Flow 'volume_create_manager' (f2c08fc1-f535-4e87-9f8a-228600707b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:21:15 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5fcb5789-32c1-4e72-b279-282d4c6f3dbe tempest-VolumesTestJSON-1359421791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad575103-f5d8-45cd-b308-b8c09589480b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:15 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5fcb5789-32c1-4e72-b279-282d4c6f3dbe tempest-VolumesTestJSON-1359421791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad575103-f5d8-45cd-b308-b8c09589480b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-12822136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72d156bd-95f4-4662-993c-89f289f185f1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c987833fcdc14532943c3a2baf9b97ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:21:15Z,use_quota=True,user_id='d9ea060c3fff43a6ae5c540ab8c2b982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:15 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5fcb5789-32c1-4e72-b279-282d4c6f3dbe tempest-VolumesTestJSON-1359421791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98658f14-d619-4116-8609-2fcffb5a8e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:15 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5fcb5789-32c1-4e72-b279-282d4c6f3dbe tempest-VolumesTestJSON-1359421791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98658f14-d619-4116-8609-2fcffb5a8e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:15 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5fcb5789-32c1-4e72-b279-282d4c6f3dbe tempest-VolumesTestJSON-1359421791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7ef49a1-3736-4bc5-b475-35bbf0bf3bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:15 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5fcb5789-32c1-4e72-b279-282d4c6f3dbe tempest-VolumesTestJSON-1359421791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7ef49a1-3736-4bc5-b475-35bbf0bf3bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72d156bd-95f4-4662-993c-89f289f185f1', 'volume_name': 'volume-72d156bd-95f4-4662-993c-89f289f185f1', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:15 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5fcb5789-32c1-4e72-b279-282d4c6f3dbe tempest-VolumesTestJSON-1359421791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4d87428-14e7-4398-ba15-9380250f15f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:15 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5fcb5789-32c1-4e72-b279-282d4c6f3dbe tempest-VolumesTestJSON-1359421791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4d87428-14e7-4398-ba15-9380250f15f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:15 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5fcb5789-32c1-4e72-b279-282d4c6f3dbe tempest-VolumesTestJSON-1359421791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e9e9439-a656-4893-984d-773ddc4e36b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:15 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-5fcb5789-32c1-4e72-b279-282d4c6f3dbe tempest-VolumesTestJSON-1359421791 None] Volume 72d156bd-95f4-4662-993c-89f289f185f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72d156bd-95f4-4662-993c-89f289f185f1', 'volume_size': 1} Jul 16 23:21:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5fcb5789-32c1-4e72-b279-282d4c6f3dbe tempest-VolumesTestJSON-1359421791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:21:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5fcb5789-32c1-4e72-b279-282d4c6f3dbe tempest-VolumesTestJSON-1359421791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:21:15 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-5fcb5789-32c1-4e72-b279-282d4c6f3dbe tempest-VolumesTestJSON-1359421791 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-12822136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72d156bd-95f4-4662-993c-89f289f185f1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c987833fcdc14532943c3a2baf9b97ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:21:15Z,use_quota=True,user_id='d9ea060c3fff43a6ae5c540ab8c2b982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:21:15 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-5fcb5789-32c1-4e72-b279-282d4c6f3dbe tempest-VolumesTestJSON-1359421791 None] Creating volume 72d156bd-95f4-4662-993c-89f289f185f1 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:21:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5fcb5789-32c1-4e72-b279-282d4c6f3dbe tempest-VolumesTestJSON-1359421791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:21:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5fcb5789-32c1-4e72-b279-282d4c6f3dbe tempest-VolumesTestJSON-1359421791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:21:15 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-5fcb5789-32c1-4e72-b279-282d4c6f3dbe tempest-VolumesTestJSON-1359421791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:21:15 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-5fcb5789-32c1-4e72-b279-282d4c6f3dbe tempest-VolumesTestJSON-1359421791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:21:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5fcb5789-32c1-4e72-b279-282d4c6f3dbe tempest-VolumesTestJSON-1359421791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:21:15 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-5fcb5789-32c1-4e72-b279-282d4c6f3dbe tempest-VolumesTestJSON-1359421791 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:21:15 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-5fcb5789-32c1-4e72-b279-282d4c6f3dbe tempest-VolumesTestJSON-1359421791 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:21:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5fcb5789-32c1-4e72-b279-282d4c6f3dbe tempest-VolumesTestJSON-1359421791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72d156bd-95f4-4662-993c-89f289f185f1 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:15 devstack sudo[92453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72d156bd-95f4-4662-993c-89f289f185f1 1073741824 Jul 16 23:21:15 devstack sudo[92453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:15 devstack sudo[92453]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5fcb5789-32c1-4e72-b279-282d4c6f3dbe tempest-VolumesTestJSON-1359421791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72d156bd-95f4-4662-993c-89f289f185f1 1073741824" returned: 0 in 0.650s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5fcb5789-32c1-4e72-b279-282d4c6f3dbe tempest-VolumesTestJSON-1359421791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72d156bd-95f4-4662-993c-89f289f185f1 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:16 devstack sudo[92459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72d156bd-95f4-4662-993c-89f289f185f1 Jul 16 23:21:16 devstack sudo[92459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:16 devstack sudo[92459]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5fcb5789-32c1-4e72-b279-282d4c6f3dbe tempest-VolumesTestJSON-1359421791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72d156bd-95f4-4662-993c-89f289f185f1" returned: 0 in 0.291s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:16 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-5fcb5789-32c1-4e72-b279-282d4c6f3dbe tempest-VolumesTestJSON-1359421791 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:21:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5fcb5789-32c1-4e72-b279-282d4c6f3dbe tempest-VolumesTestJSON-1359421791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:21:16 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5fcb5789-32c1-4e72-b279-282d4c6f3dbe tempest-VolumesTestJSON-1359421791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e9e9439-a656-4893-984d-773ddc4e36b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72d156bd-95f4-4662-993c-89f289f185f1', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:16 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5fcb5789-32c1-4e72-b279-282d4c6f3dbe tempest-VolumesTestJSON-1359421791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b533fa07-eeca-4698-8abb-f980c8705bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:16 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-5fcb5789-32c1-4e72-b279-282d4c6f3dbe tempest-VolumesTestJSON-1359421791 None] Volume volume-72d156bd-95f4-4662-993c-89f289f185f1 (72d156bd-95f4-4662-993c-89f289f185f1): created successfully Jul 16 23:21:16 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5fcb5789-32c1-4e72-b279-282d4c6f3dbe tempest-VolumesTestJSON-1359421791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b533fa07-eeca-4698-8abb-f980c8705bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:16 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5fcb5789-32c1-4e72-b279-282d4c6f3dbe tempest-VolumesTestJSON-1359421791 None] Flow 'volume_create_manager' (f2c08fc1-f535-4e87-9f8a-228600707b5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:21:16 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-5fcb5789-32c1-4e72-b279-282d4c6f3dbe tempest-VolumesTestJSON-1359421791 None] Created volume successfully. Jul 16 23:21:19 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-bce1c25e-9ef9-4db4-ac8d-657b05179681 tempest-VolumesServicesTestJSON-870100840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:21:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bce1c25e-9ef9-4db4-ac8d-657b05179681 tempest-VolumesServicesTestJSON-870100840 None] Flow 'volume_create_manager' (98fb9dd9-899a-4495-ab4e-653e9d9e3a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:21:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bce1c25e-9ef9-4db4-ac8d-657b05179681 tempest-VolumesServicesTestJSON-870100840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47113d8e-6f89-49b1-8c5b-7759b6f0745d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:19 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-a772e76d-7151-455f-8990-5cb7097686e6 tempest-VolumesTestJSON-1359421791 None] Acquiring lock "cinder-72d156bd-95f4-4662-993c-89f289f185f1-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:21:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bce1c25e-9ef9-4db4-ac8d-657b05179681 tempest-VolumesServicesTestJSON-870100840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47113d8e-6f89-49b1-8c5b-7759b6f0745d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1853146796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d763829-7c8e-4157-8c8f-8483e8f0c353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3887c63f15cd49b39112357e17e9c9aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:21:19Z,use_quota=True,user_id='d745529e11ee452a9a135dbb0269ad8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bce1c25e-9ef9-4db4-ac8d-657b05179681 tempest-VolumesServicesTestJSON-870100840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fd16673-9c3f-4bf4-926b-ef4e3b630ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bce1c25e-9ef9-4db4-ac8d-657b05179681 tempest-VolumesServicesTestJSON-870100840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fd16673-9c3f-4bf4-926b-ef4e3b630ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bce1c25e-9ef9-4db4-ac8d-657b05179681 tempest-VolumesServicesTestJSON-870100840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (999d5204-90e2-4aab-a72a-e4670c27fb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bce1c25e-9ef9-4db4-ac8d-657b05179681 tempest-VolumesServicesTestJSON-870100840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (999d5204-90e2-4aab-a72a-e4670c27fb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d763829-7c8e-4157-8c8f-8483e8f0c353', 'volume_name': 'volume-1d763829-7c8e-4157-8c8f-8483e8f0c353', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bce1c25e-9ef9-4db4-ac8d-657b05179681 tempest-VolumesServicesTestJSON-870100840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4afc7c7-48c8-45c7-98a1-de8ccc9643c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bce1c25e-9ef9-4db4-ac8d-657b05179681 tempest-VolumesServicesTestJSON-870100840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4afc7c7-48c8-45c7-98a1-de8ccc9643c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bce1c25e-9ef9-4db4-ac8d-657b05179681 tempest-VolumesServicesTestJSON-870100840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e39907d1-44c6-4cb8-b354-09da9b3b254c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:19 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-bce1c25e-9ef9-4db4-ac8d-657b05179681 tempest-VolumesServicesTestJSON-870100840 None] Volume 1d763829-7c8e-4157-8c8f-8483e8f0c353: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d763829-7c8e-4157-8c8f-8483e8f0c353', 'volume_size': 1} Jul 16 23:21:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bce1c25e-9ef9-4db4-ac8d-657b05179681 tempest-VolumesServicesTestJSON-870100840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:21:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bce1c25e-9ef9-4db4-ac8d-657b05179681 tempest-VolumesServicesTestJSON-870100840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:21:19 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-bce1c25e-9ef9-4db4-ac8d-657b05179681 tempest-VolumesServicesTestJSON-870100840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1853146796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d763829-7c8e-4157-8c8f-8483e8f0c353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3887c63f15cd49b39112357e17e9c9aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:21:19Z,use_quota=True,user_id='d745529e11ee452a9a135dbb0269ad8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:21:19 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-bce1c25e-9ef9-4db4-ac8d-657b05179681 tempest-VolumesServicesTestJSON-870100840 None] Creating volume 1d763829-7c8e-4157-8c8f-8483e8f0c353 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:21:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bce1c25e-9ef9-4db4-ac8d-657b05179681 tempest-VolumesServicesTestJSON-870100840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:21:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bce1c25e-9ef9-4db4-ac8d-657b05179681 tempest-VolumesServicesTestJSON-870100840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:21:19 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-bce1c25e-9ef9-4db4-ac8d-657b05179681 tempest-VolumesServicesTestJSON-870100840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:21:19 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-bce1c25e-9ef9-4db4-ac8d-657b05179681 tempest-VolumesServicesTestJSON-870100840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:21:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bce1c25e-9ef9-4db4-ac8d-657b05179681 tempest-VolumesServicesTestJSON-870100840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:21:19 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-bce1c25e-9ef9-4db4-ac8d-657b05179681 tempest-VolumesServicesTestJSON-870100840 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:21:19 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-bce1c25e-9ef9-4db4-ac8d-657b05179681 tempest-VolumesServicesTestJSON-870100840 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:21:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bce1c25e-9ef9-4db4-ac8d-657b05179681 tempest-VolumesServicesTestJSON-870100840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1d763829-7c8e-4157-8c8f-8483e8f0c353 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:19 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-a772e76d-7151-455f-8990-5cb7097686e6 tempest-VolumesTestJSON-1359421791 None] Lock "cinder-72d156bd-95f4-4662-993c-89f289f185f1-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:21:19 devstack sudo[92463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1d763829-7c8e-4157-8c8f-8483e8f0c353 1073741824 Jul 16 23:21:19 devstack sudo[92463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:19 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-a772e76d-7151-455f-8990-5cb7097686e6 tempest-VolumesTestJSON-1359421791 None] Acquiring lock "cinder-quobyte-72d156bd-95f4-4662-993c-89f289f185f1" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:21:19 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-a772e76d-7151-455f-8990-5cb7097686e6 tempest-VolumesTestJSON-1359421791 None] Lock "cinder-quobyte-72d156bd-95f4-4662-993c-89f289f185f1" acquired by "delete_volume" :: waited 0.022s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:21:19 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[0797f381-7dca-4552-b730-a2a27f72d249]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:21:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a772e76d-7151-455f-8990-5cb7097686e6 tempest-VolumesTestJSON-1359421791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72d156bd-95f4-4662-993c-89f289f185f1 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:19 devstack sudo[92465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72d156bd-95f4-4662-993c-89f289f185f1 Jul 16 23:21:19 devstack sudo[92465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:19 devstack sudo[92463]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bce1c25e-9ef9-4db4-ac8d-657b05179681 tempest-VolumesServicesTestJSON-870100840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1d763829-7c8e-4157-8c8f-8483e8f0c353 1073741824" returned: 0 in 0.511s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bce1c25e-9ef9-4db4-ac8d-657b05179681 tempest-VolumesServicesTestJSON-870100840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1d763829-7c8e-4157-8c8f-8483e8f0c353 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:19 devstack sudo[92465]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a772e76d-7151-455f-8990-5cb7097686e6 tempest-VolumesTestJSON-1359421791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72d156bd-95f4-4662-993c-89f289f185f1" returned: 0 in 0.483s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a772e76d-7151-455f-8990-5cb7097686e6 tempest-VolumesTestJSON-1359421791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72d156bd-95f4-4662-993c-89f289f185f1 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:19 devstack sudo[92474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1d763829-7c8e-4157-8c8f-8483e8f0c353 Jul 16 23:21:19 devstack sudo[92474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:19 devstack sudo[92476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72d156bd-95f4-4662-993c-89f289f185f1 Jul 16 23:21:19 devstack sudo[92476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:20 devstack sudo[92476]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a772e76d-7151-455f-8990-5cb7097686e6 tempest-VolumesTestJSON-1359421791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72d156bd-95f4-4662-993c-89f289f185f1" returned: 0 in 0.343s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:20 devstack sudo[92474]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:20 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-a772e76d-7151-455f-8990-5cb7097686e6 tempest-VolumesTestJSON-1359421791 None] Lock "cinder-quobyte-72d156bd-95f4-4662-993c-89f289f185f1" released by "delete_volume" :: held 0.878s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:21:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bce1c25e-9ef9-4db4-ac8d-657b05179681 tempest-VolumesServicesTestJSON-870100840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1d763829-7c8e-4157-8c8f-8483e8f0c353" returned: 0 in 0.397s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:20 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-bce1c25e-9ef9-4db4-ac8d-657b05179681 tempest-VolumesServicesTestJSON-870100840 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:21:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bce1c25e-9ef9-4db4-ac8d-657b05179681 tempest-VolumesServicesTestJSON-870100840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:21:20 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bce1c25e-9ef9-4db4-ac8d-657b05179681 tempest-VolumesServicesTestJSON-870100840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e39907d1-44c6-4cb8-b354-09da9b3b254c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d763829-7c8e-4157-8c8f-8483e8f0c353', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:20 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bce1c25e-9ef9-4db4-ac8d-657b05179681 tempest-VolumesServicesTestJSON-870100840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c06230-5469-431f-94bf-371c20a369fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:20 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-bce1c25e-9ef9-4db4-ac8d-657b05179681 tempest-VolumesServicesTestJSON-870100840 None] Volume volume-1d763829-7c8e-4157-8c8f-8483e8f0c353 (1d763829-7c8e-4157-8c8f-8483e8f0c353): created successfully Jul 16 23:21:20 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bce1c25e-9ef9-4db4-ac8d-657b05179681 tempest-VolumesServicesTestJSON-870100840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c06230-5469-431f-94bf-371c20a369fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:20 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bce1c25e-9ef9-4db4-ac8d-657b05179681 tempest-VolumesServicesTestJSON-870100840 None] Flow 'volume_create_manager' (98fb9dd9-899a-4495-ab4e-653e9d9e3a7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:21:20 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-bce1c25e-9ef9-4db4-ac8d-657b05179681 tempest-VolumesServicesTestJSON-870100840 None] Created volume successfully. Jul 16 23:21:20 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-a772e76d-7151-455f-8990-5cb7097686e6 tempest-VolumesTestJSON-1359421791 None] Created reservations ['8a29e381-f74f-4b48-b098-65df297ff402', '24aaa62f-9749-4003-87b1-34b45e7ad31f', '68a6959e-27e1-4a96-9232-772f23dea799', '3985714b-22b7-4d87-b9fb-b158eec62af1'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:21:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a772e76d-7151-455f-8990-5cb7097686e6 tempest-VolumesTestJSON-1359421791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:21:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a772e76d-7151-455f-8990-5cb7097686e6 tempest-VolumesTestJSON-1359421791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:21:20 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a772e76d-7151-455f-8990-5cb7097686e6 tempest-VolumesTestJSON-1359421791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:21:20 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a772e76d-7151-455f-8990-5cb7097686e6 tempest-VolumesTestJSON-1359421791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:21:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a772e76d-7151-455f-8990-5cb7097686e6 tempest-VolumesTestJSON-1359421791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:21:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a772e76d-7151-455f-8990-5cb7097686e6 tempest-VolumesTestJSON-1359421791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:20 devstack sudo[92480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:21:20 devstack sudo[92480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:20 devstack sudo[92480]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a772e76d-7151-455f-8990-5cb7097686e6 tempest-VolumesTestJSON-1359421791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.276s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:20 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-a772e76d-7151-455f-8990-5cb7097686e6 tempest-VolumesTestJSON-1359421791 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:21:20 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-a772e76d-7151-455f-8990-5cb7097686e6 tempest-VolumesTestJSON-1359421791 None] Deleted volume successfully. Jul 16 23:21:20 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-a772e76d-7151-455f-8990-5cb7097686e6 tempest-VolumesTestJSON-1359421791 None] Lock "cinder-72d156bd-95f4-4662-993c-89f289f185f1-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:21:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6824eda3-f3dd-4bcf-9a9c-abe3d3f7a9f5 tempest-VolumesTestJSON-1359421791 None] Acquiring lock "cinder-d2e5b671-b857-40cc-b887-a0528d7fc6c4-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:21:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6824eda3-f3dd-4bcf-9a9c-abe3d3f7a9f5 tempest-VolumesTestJSON-1359421791 None] Lock "cinder-d2e5b671-b857-40cc-b887-a0528d7fc6c4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:21:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6824eda3-f3dd-4bcf-9a9c-abe3d3f7a9f5 tempest-VolumesTestJSON-1359421791 None] Acquiring lock "cinder-quobyte-d2e5b671-b857-40cc-b887-a0528d7fc6c4" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:21:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-3158ff56-e6e4-429e-9216-2eeb401d2284 tempest-VolumesServicesTestJSON-870100840 None] Acquiring lock "cinder-1d763829-7c8e-4157-8c8f-8483e8f0c353-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:21:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-3158ff56-e6e4-429e-9216-2eeb401d2284 tempest-VolumesServicesTestJSON-870100840 None] Lock "cinder-1d763829-7c8e-4157-8c8f-8483e8f0c353-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:21:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6824eda3-f3dd-4bcf-9a9c-abe3d3f7a9f5 tempest-VolumesTestJSON-1359421791 None] Lock "cinder-quobyte-d2e5b671-b857-40cc-b887-a0528d7fc6c4" acquired by "delete_volume" :: waited 0.070s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:21:21 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ad49c0-5140-4f2a-b6e7-7706746833a2]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:21:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6824eda3-f3dd-4bcf-9a9c-abe3d3f7a9f5 tempest-VolumesTestJSON-1359421791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2e5b671-b857-40cc-b887-a0528d7fc6c4 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-3158ff56-e6e4-429e-9216-2eeb401d2284 tempest-VolumesServicesTestJSON-870100840 None] Acquiring lock "cinder-quobyte-1d763829-7c8e-4157-8c8f-8483e8f0c353" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:21:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-3158ff56-e6e4-429e-9216-2eeb401d2284 tempest-VolumesServicesTestJSON-870100840 None] Lock "cinder-quobyte-1d763829-7c8e-4157-8c8f-8483e8f0c353" acquired by "delete_volume" :: waited 0.036s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:21:21 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78b63d7-72c1-4480-a19a-a514856ae63d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:21:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3158ff56-e6e4-429e-9216-2eeb401d2284 tempest-VolumesServicesTestJSON-870100840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1d763829-7c8e-4157-8c8f-8483e8f0c353 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:21 devstack sudo[92483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2e5b671-b857-40cc-b887-a0528d7fc6c4 Jul 16 23:21:21 devstack sudo[92483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:21 devstack sudo[92484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1d763829-7c8e-4157-8c8f-8483e8f0c353 Jul 16 23:21:21 devstack sudo[92484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:22 devstack sudo[92484]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3158ff56-e6e4-429e-9216-2eeb401d2284 tempest-VolumesServicesTestJSON-870100840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1d763829-7c8e-4157-8c8f-8483e8f0c353" returned: 0 in 0.498s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:22 devstack sudo[92483]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3158ff56-e6e4-429e-9216-2eeb401d2284 tempest-VolumesServicesTestJSON-870100840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1d763829-7c8e-4157-8c8f-8483e8f0c353 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6824eda3-f3dd-4bcf-9a9c-abe3d3f7a9f5 tempest-VolumesTestJSON-1359421791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2e5b671-b857-40cc-b887-a0528d7fc6c4" returned: 0 in 0.648s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6824eda3-f3dd-4bcf-9a9c-abe3d3f7a9f5 tempest-VolumesTestJSON-1359421791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2e5b671-b857-40cc-b887-a0528d7fc6c4 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:22 devstack sudo[92493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1d763829-7c8e-4157-8c8f-8483e8f0c353 Jul 16 23:21:22 devstack sudo[92493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:22 devstack sudo[92494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2e5b671-b857-40cc-b887-a0528d7fc6c4 Jul 16 23:21:22 devstack sudo[92494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:22 devstack sudo[92494]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6824eda3-f3dd-4bcf-9a9c-abe3d3f7a9f5 tempest-VolumesTestJSON-1359421791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2e5b671-b857-40cc-b887-a0528d7fc6c4" returned: 0 in 0.341s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:22 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6824eda3-f3dd-4bcf-9a9c-abe3d3f7a9f5 tempest-VolumesTestJSON-1359421791 None] Lock "cinder-quobyte-d2e5b671-b857-40cc-b887-a0528d7fc6c4" released by "delete_volume" :: held 1.060s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:21:22 devstack sudo[92493]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3158ff56-e6e4-429e-9216-2eeb401d2284 tempest-VolumesServicesTestJSON-870100840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1d763829-7c8e-4157-8c8f-8483e8f0c353" returned: 0 in 0.473s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:22 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-6824eda3-f3dd-4bcf-9a9c-abe3d3f7a9f5 tempest-VolumesTestJSON-1359421791 None] Created reservations ['94f9da91-2921-406a-a5e0-eaaa017cc6d1', '0940d380-77d1-487d-85ce-6f62c207aca1', '85047179-3bf9-4fad-aaf0-5f4be516cf95', '4987b2d5-2713-46fd-9e2a-ce8490335c7f'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:21:22 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-3158ff56-e6e4-429e-9216-2eeb401d2284 tempest-VolumesServicesTestJSON-870100840 None] Lock "cinder-quobyte-1d763829-7c8e-4157-8c8f-8483e8f0c353" released by "delete_volume" :: held 1.038s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:21:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6824eda3-f3dd-4bcf-9a9c-abe3d3f7a9f5 tempest-VolumesTestJSON-1359421791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:21:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6824eda3-f3dd-4bcf-9a9c-abe3d3f7a9f5 tempest-VolumesTestJSON-1359421791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:21:22 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-6824eda3-f3dd-4bcf-9a9c-abe3d3f7a9f5 tempest-VolumesTestJSON-1359421791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:21:22 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-6824eda3-f3dd-4bcf-9a9c-abe3d3f7a9f5 tempest-VolumesTestJSON-1359421791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:21:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6824eda3-f3dd-4bcf-9a9c-abe3d3f7a9f5 tempest-VolumesTestJSON-1359421791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:21:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6824eda3-f3dd-4bcf-9a9c-abe3d3f7a9f5 tempest-VolumesTestJSON-1359421791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:22 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-3158ff56-e6e4-429e-9216-2eeb401d2284 tempest-VolumesServicesTestJSON-870100840 None] Created reservations ['452a8822-432f-43cc-b93b-d461137901cc', '7b556821-08fa-48cf-9a27-2fcf7f554414', '9bba32b2-1f62-42a2-92d2-e4994108c1b3', 'b405b022-37ee-4cd0-8c93-8bc9ad62a0ee'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:21:22 devstack sudo[92499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:21:22 devstack sudo[92499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3158ff56-e6e4-429e-9216-2eeb401d2284 tempest-VolumesServicesTestJSON-870100840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:21:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3158ff56-e6e4-429e-9216-2eeb401d2284 tempest-VolumesServicesTestJSON-870100840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:21:22 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3158ff56-e6e4-429e-9216-2eeb401d2284 tempest-VolumesServicesTestJSON-870100840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:21:22 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3158ff56-e6e4-429e-9216-2eeb401d2284 tempest-VolumesServicesTestJSON-870100840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:21:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3158ff56-e6e4-429e-9216-2eeb401d2284 tempest-VolumesServicesTestJSON-870100840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:21:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3158ff56-e6e4-429e-9216-2eeb401d2284 tempest-VolumesServicesTestJSON-870100840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:22 devstack sudo[92501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:21:22 devstack sudo[92501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:23 devstack sudo[92499]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6824eda3-f3dd-4bcf-9a9c-abe3d3f7a9f5 tempest-VolumesTestJSON-1359421791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.298s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:23 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-6824eda3-f3dd-4bcf-9a9c-abe3d3f7a9f5 tempest-VolumesTestJSON-1359421791 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:21:23 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-6824eda3-f3dd-4bcf-9a9c-abe3d3f7a9f5 tempest-VolumesTestJSON-1359421791 None] Deleted volume successfully. Jul 16 23:21:23 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6824eda3-f3dd-4bcf-9a9c-abe3d3f7a9f5 tempest-VolumesTestJSON-1359421791 None] Lock "cinder-d2e5b671-b857-40cc-b887-a0528d7fc6c4-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:21:23 devstack sudo[92501]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3158ff56-e6e4-429e-9216-2eeb401d2284 tempest-VolumesServicesTestJSON-870100840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.364s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:23 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-3158ff56-e6e4-429e-9216-2eeb401d2284 tempest-VolumesServicesTestJSON-870100840 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:21:23 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-3158ff56-e6e4-429e-9216-2eeb401d2284 tempest-VolumesServicesTestJSON-870100840 None] Deleted volume successfully. Jul 16 23:21:23 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-3158ff56-e6e4-429e-9216-2eeb401d2284 tempest-VolumesServicesTestJSON-870100840 None] Lock "cinder-1d763829-7c8e-4157-8c8f-8483e8f0c353-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:21:23 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-05c7cf05-884d-42a5-92cb-12b82475323b tempest-VolumesTestJSON-1359421791 None] Acquiring lock "cinder-4ea78659-07eb-4a4d-9d79-f0e6141ddcbc-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:21:23 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-05c7cf05-884d-42a5-92cb-12b82475323b tempest-VolumesTestJSON-1359421791 None] Lock "cinder-4ea78659-07eb-4a4d-9d79-f0e6141ddcbc-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:21:23 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-05c7cf05-884d-42a5-92cb-12b82475323b tempest-VolumesTestJSON-1359421791 None] Acquiring lock "cinder-quobyte-4ea78659-07eb-4a4d-9d79-f0e6141ddcbc" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:21:23 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-05c7cf05-884d-42a5-92cb-12b82475323b tempest-VolumesTestJSON-1359421791 None] Lock "cinder-quobyte-4ea78659-07eb-4a4d-9d79-f0e6141ddcbc" acquired by "delete_volume" :: waited 0.021s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:21:23 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cbaaa7-dc33-4794-b957-4782a3858d3e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:21:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-05c7cf05-884d-42a5-92cb-12b82475323b tempest-VolumesTestJSON-1359421791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4ea78659-07eb-4a4d-9d79-f0e6141ddcbc {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:24 devstack sudo[92505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4ea78659-07eb-4a4d-9d79-f0e6141ddcbc Jul 16 23:21:24 devstack sudo[92505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:24 devstack sudo[92505]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-05c7cf05-884d-42a5-92cb-12b82475323b tempest-VolumesTestJSON-1359421791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4ea78659-07eb-4a4d-9d79-f0e6141ddcbc" returned: 0 in 0.481s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-05c7cf05-884d-42a5-92cb-12b82475323b tempest-VolumesTestJSON-1359421791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4ea78659-07eb-4a4d-9d79-f0e6141ddcbc {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:24 devstack sudo[92510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4ea78659-07eb-4a4d-9d79-f0e6141ddcbc Jul 16 23:21:24 devstack sudo[92510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:24 devstack sudo[92510]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-05c7cf05-884d-42a5-92cb-12b82475323b tempest-VolumesTestJSON-1359421791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4ea78659-07eb-4a4d-9d79-f0e6141ddcbc" returned: 0 in 0.313s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:24 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-05c7cf05-884d-42a5-92cb-12b82475323b tempest-VolumesTestJSON-1359421791 None] Lock "cinder-quobyte-4ea78659-07eb-4a4d-9d79-f0e6141ddcbc" released by "delete_volume" :: held 0.855s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:21:24 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-05c7cf05-884d-42a5-92cb-12b82475323b tempest-VolumesTestJSON-1359421791 None] Created reservations ['c6e24434-2351-4d4b-bd10-a771d6fbcef0', '39744bdb-baa8-4e60-b267-4a8fbc43e17f', 'e83186b5-97b5-418c-865a-b01db5511db3', '329cd4e4-0545-493a-932c-f1160cbdf3e8'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:21:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-05c7cf05-884d-42a5-92cb-12b82475323b tempest-VolumesTestJSON-1359421791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:21:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-05c7cf05-884d-42a5-92cb-12b82475323b tempest-VolumesTestJSON-1359421791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:21:24 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-05c7cf05-884d-42a5-92cb-12b82475323b tempest-VolumesTestJSON-1359421791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:21:24 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-05c7cf05-884d-42a5-92cb-12b82475323b tempest-VolumesTestJSON-1359421791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:21:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-05c7cf05-884d-42a5-92cb-12b82475323b tempest-VolumesTestJSON-1359421791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:21:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-05c7cf05-884d-42a5-92cb-12b82475323b tempest-VolumesTestJSON-1359421791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:24 devstack sudo[92513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:21:24 devstack sudo[92513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:25 devstack sudo[92513]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-05c7cf05-884d-42a5-92cb-12b82475323b tempest-VolumesTestJSON-1359421791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.430s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:25 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-05c7cf05-884d-42a5-92cb-12b82475323b tempest-VolumesTestJSON-1359421791 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:21:25 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-05c7cf05-884d-42a5-92cb-12b82475323b tempest-VolumesTestJSON-1359421791 None] Deleted volume successfully. Jul 16 23:21:25 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-05c7cf05-884d-42a5-92cb-12b82475323b tempest-VolumesTestJSON-1359421791 None] Lock "cinder-4ea78659-07eb-4a4d-9d79-f0e6141ddcbc-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:21:31 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-56f0a891-1613-4d4e-addd-05af34498bd1 tempest-BackendsCapabilitiesAdminTestsJSON-2030409062 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87607) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 16 23:21:31 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-28abef8b-59f6-456c-a015-4db6cf036256 tempest-BackendsCapabilitiesAdminTestsJSON-2030409062 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87607) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 16 23:21:34 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:SELECT=95,cinder:UPDATE=125,cinder:DELETE=9,cinder:INSERT=25 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:21:35 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:UPDATE=126,cinder:SELECT=95,cinder:INSERT=32,cinder:DELETE=11 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:21:39 devstack cinder-volume[87607]: DEBUG oslo_service.periodic_task [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:21:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:21:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:21:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:21:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:21:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:21:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:39 devstack sudo[92650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:21:39 devstack sudo[92650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:39 devstack sudo[92650]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.311s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:39 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:21:39 devstack cinder-volume[87607]: DEBUG oslo_service.periodic_task [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running periodic task VolumeManager._thread_info {{(pid=87607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:21:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] thread count: 8 {{(pid=87607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 23:21:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] thread info: [<_MainThread(MainThread, started 139090403627136)>, , , , , , , ] {{(pid=87607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 23:21:40 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-b97d38e3-b26e-4ffc-a12a-06f34759570e tempest-VolumeQuotasNegativeTestJSON-114642080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:21:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b97d38e3-b26e-4ffc-a12a-06f34759570e tempest-VolumeQuotasNegativeTestJSON-114642080 None] Flow 'volume_create_manager' (b01a8b34-f3a8-4b4e-8757-ce3f29789ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:21:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b97d38e3-b26e-4ffc-a12a-06f34759570e tempest-VolumeQuotasNegativeTestJSON-114642080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (211316ce-ca33-42f3-9ef4-182a1fefe415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b97d38e3-b26e-4ffc-a12a-06f34759570e tempest-VolumeQuotasNegativeTestJSON-114642080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (211316ce-ca33-42f3-9ef4-182a1fefe415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1109914376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9275210-193d-465e-9173-4d8e55d430e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d485a1314fb743e6b3ee72a0dda2aeb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:21:41Z,use_quota=True,user_id='fbe90769ed2a42bab952834a3bb55011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b97d38e3-b26e-4ffc-a12a-06f34759570e tempest-VolumeQuotasNegativeTestJSON-114642080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25ee024d-f041-48fa-baa9-8b10fbf97d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b97d38e3-b26e-4ffc-a12a-06f34759570e tempest-VolumeQuotasNegativeTestJSON-114642080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25ee024d-f041-48fa-baa9-8b10fbf97d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b97d38e3-b26e-4ffc-a12a-06f34759570e tempest-VolumeQuotasNegativeTestJSON-114642080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (010c679a-4773-44f2-836b-4dd78791c4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b97d38e3-b26e-4ffc-a12a-06f34759570e tempest-VolumeQuotasNegativeTestJSON-114642080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (010c679a-4773-44f2-836b-4dd78791c4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9275210-193d-465e-9173-4d8e55d430e8', 'volume_name': 'volume-b9275210-193d-465e-9173-4d8e55d430e8', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b97d38e3-b26e-4ffc-a12a-06f34759570e tempest-VolumeQuotasNegativeTestJSON-114642080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9576c83-38ef-4548-9034-7114a4b0eda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b97d38e3-b26e-4ffc-a12a-06f34759570e tempest-VolumeQuotasNegativeTestJSON-114642080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9576c83-38ef-4548-9034-7114a4b0eda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b97d38e3-b26e-4ffc-a12a-06f34759570e tempest-VolumeQuotasNegativeTestJSON-114642080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61543738-ce60-4bc5-8ff2-b788157ec58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:40 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-b97d38e3-b26e-4ffc-a12a-06f34759570e tempest-VolumeQuotasNegativeTestJSON-114642080 None] Volume b9275210-193d-465e-9173-4d8e55d430e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9275210-193d-465e-9173-4d8e55d430e8', 'volume_size': 1} Jul 16 23:21:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b97d38e3-b26e-4ffc-a12a-06f34759570e tempest-VolumeQuotasNegativeTestJSON-114642080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:21:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b97d38e3-b26e-4ffc-a12a-06f34759570e tempest-VolumeQuotasNegativeTestJSON-114642080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:21:40 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-b97d38e3-b26e-4ffc-a12a-06f34759570e tempest-VolumeQuotasNegativeTestJSON-114642080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1109914376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9275210-193d-465e-9173-4d8e55d430e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d485a1314fb743e6b3ee72a0dda2aeb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:21:41Z,use_quota=True,user_id='fbe90769ed2a42bab952834a3bb55011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:21:40 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-b97d38e3-b26e-4ffc-a12a-06f34759570e tempest-VolumeQuotasNegativeTestJSON-114642080 None] Creating volume b9275210-193d-465e-9173-4d8e55d430e8 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:21:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b97d38e3-b26e-4ffc-a12a-06f34759570e tempest-VolumeQuotasNegativeTestJSON-114642080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:21:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b97d38e3-b26e-4ffc-a12a-06f34759570e tempest-VolumeQuotasNegativeTestJSON-114642080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:21:40 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-b97d38e3-b26e-4ffc-a12a-06f34759570e tempest-VolumeQuotasNegativeTestJSON-114642080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:21:40 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-b97d38e3-b26e-4ffc-a12a-06f34759570e tempest-VolumeQuotasNegativeTestJSON-114642080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:21:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b97d38e3-b26e-4ffc-a12a-06f34759570e tempest-VolumeQuotasNegativeTestJSON-114642080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:21:40 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-b97d38e3-b26e-4ffc-a12a-06f34759570e tempest-VolumeQuotasNegativeTestJSON-114642080 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:21:40 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-b97d38e3-b26e-4ffc-a12a-06f34759570e tempest-VolumeQuotasNegativeTestJSON-114642080 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:21:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b97d38e3-b26e-4ffc-a12a-06f34759570e tempest-VolumeQuotasNegativeTestJSON-114642080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b9275210-193d-465e-9173-4d8e55d430e8 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:40 devstack sudo[92653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b9275210-193d-465e-9173-4d8e55d430e8 1073741824 Jul 16 23:21:40 devstack sudo[92653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:41 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-055549b4-c422-4aa4-af65-ca723a89a33a tempest-GroupSnapshotsTest-1525757492 None] Group tempest-GroupSnapshotsTest-Group-1287832528: creating Jul 16 23:21:41 devstack sudo[92653]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b97d38e3-b26e-4ffc-a12a-06f34759570e tempest-VolumeQuotasNegativeTestJSON-114642080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b9275210-193d-465e-9173-4d8e55d430e8 1073741824" returned: 0 in 0.690s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:41 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-055549b4-c422-4aa4-af65-ca723a89a33a tempest-GroupSnapshotsTest-1525757492 None] Group tempest-GroupSnapshotsTest-Group-1287832528: created successfully Jul 16 23:21:41 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-055549b4-c422-4aa4-af65-ca723a89a33a tempest-GroupSnapshotsTest-1525757492 None] Create group completed successfully. Jul 16 23:21:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b97d38e3-b26e-4ffc-a12a-06f34759570e tempest-VolumeQuotasNegativeTestJSON-114642080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b9275210-193d-465e-9173-4d8e55d430e8 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:41 devstack sudo[92659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b9275210-193d-465e-9173-4d8e55d430e8 Jul 16 23:21:41 devstack sudo[92659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:41 devstack sudo[92659]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b97d38e3-b26e-4ffc-a12a-06f34759570e tempest-VolumeQuotasNegativeTestJSON-114642080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b9275210-193d-465e-9173-4d8e55d430e8" returned: 0 in 0.269s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:41 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-b97d38e3-b26e-4ffc-a12a-06f34759570e tempest-VolumeQuotasNegativeTestJSON-114642080 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:21:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b97d38e3-b26e-4ffc-a12a-06f34759570e tempest-VolumeQuotasNegativeTestJSON-114642080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:21:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b97d38e3-b26e-4ffc-a12a-06f34759570e tempest-VolumeQuotasNegativeTestJSON-114642080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61543738-ce60-4bc5-8ff2-b788157ec58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9275210-193d-465e-9173-4d8e55d430e8', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b97d38e3-b26e-4ffc-a12a-06f34759570e tempest-VolumeQuotasNegativeTestJSON-114642080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01cea033-076c-4db5-8157-22e62920b51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:41 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-b97d38e3-b26e-4ffc-a12a-06f34759570e tempest-VolumeQuotasNegativeTestJSON-114642080 None] Volume volume-b9275210-193d-465e-9173-4d8e55d430e8 (b9275210-193d-465e-9173-4d8e55d430e8): created successfully Jul 16 23:21:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b97d38e3-b26e-4ffc-a12a-06f34759570e tempest-VolumeQuotasNegativeTestJSON-114642080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01cea033-076c-4db5-8157-22e62920b51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b97d38e3-b26e-4ffc-a12a-06f34759570e tempest-VolumeQuotasNegativeTestJSON-114642080 None] Flow 'volume_create_manager' (b01a8b34-f3a8-4b4e-8757-ce3f29789ef0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:21:41 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-b97d38e3-b26e-4ffc-a12a-06f34759570e tempest-VolumeQuotasNegativeTestJSON-114642080 None] Created volume successfully. Jul 16 23:21:43 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a3f18e8-80c6-4e9d-b24d-c96db6d7a1ca tempest-GroupSnapshotsTest-1525757492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:21:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5a3f18e8-80c6-4e9d-b24d-c96db6d7a1ca tempest-GroupSnapshotsTest-1525757492 None] Flow 'volume_create_manager' (b1cdf3e9-1aaf-41ee-b05c-2d3dbe1156b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:21:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5a3f18e8-80c6-4e9d-b24d-c96db6d7a1ca tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dab191d-8c7b-4d3c-8241-4fbec02a3b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5a3f18e8-80c6-4e9d-b24d-c96db6d7a1ca tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dab191d-8c7b-4d3c-8241-4fbec02a3b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1111254114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3145b613-a39d-4c22-818c-d55e58a5f7a1,host='devstack@QuobyteHD#QuobyteHD',id=bc218b88-4b0e-4795-9e7a-02198e194645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dacfebbcb3a247b1a41b9e9e4edcd5d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:21:43Z,use_quota=True,user_id='29ffcc3ab5d0440aa66c49821dd86cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(581937be-8c5c-47b6-b3e0-7f0cf18dc4d9),volume_type_id=581937be-8c5c-47b6-b3e0-7f0cf18dc4d9)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5a3f18e8-80c6-4e9d-b24d-c96db6d7a1ca tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25053f70-7353-4093-b7a1-b32d0f064c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5a3f18e8-80c6-4e9d-b24d-c96db6d7a1ca tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25053f70-7353-4093-b7a1-b32d0f064c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5a3f18e8-80c6-4e9d-b24d-c96db6d7a1ca tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf667202-5180-4bc7-b6e8-354fb58354ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5a3f18e8-80c6-4e9d-b24d-c96db6d7a1ca tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf667202-5180-4bc7-b6e8-354fb58354ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc218b88-4b0e-4795-9e7a-02198e194645', 'volume_name': 'volume-bc218b88-4b0e-4795-9e7a-02198e194645', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5a3f18e8-80c6-4e9d-b24d-c96db6d7a1ca tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c023cb76-24a2-4858-b0d2-28586a4e376a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5a3f18e8-80c6-4e9d-b24d-c96db6d7a1ca tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c023cb76-24a2-4858-b0d2-28586a4e376a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5a3f18e8-80c6-4e9d-b24d-c96db6d7a1ca tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7163a6fc-f14b-4366-9765-f95f2065b618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:43 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-5a3f18e8-80c6-4e9d-b24d-c96db6d7a1ca tempest-GroupSnapshotsTest-1525757492 None] Volume bc218b88-4b0e-4795-9e7a-02198e194645: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc218b88-4b0e-4795-9e7a-02198e194645', 'volume_size': 1} Jul 16 23:21:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5a3f18e8-80c6-4e9d-b24d-c96db6d7a1ca tempest-GroupSnapshotsTest-1525757492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:21:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5a3f18e8-80c6-4e9d-b24d-c96db6d7a1ca tempest-GroupSnapshotsTest-1525757492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:21:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-5a3f18e8-80c6-4e9d-b24d-c96db6d7a1ca tempest-GroupSnapshotsTest-1525757492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3145b613-a39d-4c22-818c-d55e58a5f7a1,created_at=2026-07-16T21:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1111254114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3145b613-a39d-4c22-818c-d55e58a5f7a1,host='devstack@QuobyteHD#QuobyteHD',id=bc218b88-4b0e-4795-9e7a-02198e194645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dacfebbcb3a247b1a41b9e9e4edcd5d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:21:43Z,use_quota=True,user_id='29ffcc3ab5d0440aa66c49821dd86cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(581937be-8c5c-47b6-b3e0-7f0cf18dc4d9),volume_type_id=581937be-8c5c-47b6-b3e0-7f0cf18dc4d9)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:21:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-5a3f18e8-80c6-4e9d-b24d-c96db6d7a1ca tempest-GroupSnapshotsTest-1525757492 None] Creating volume bc218b88-4b0e-4795-9e7a-02198e194645 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:21:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5a3f18e8-80c6-4e9d-b24d-c96db6d7a1ca tempest-GroupSnapshotsTest-1525757492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:21:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5a3f18e8-80c6-4e9d-b24d-c96db6d7a1ca tempest-GroupSnapshotsTest-1525757492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:21:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-5a3f18e8-80c6-4e9d-b24d-c96db6d7a1ca tempest-GroupSnapshotsTest-1525757492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:21:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-5a3f18e8-80c6-4e9d-b24d-c96db6d7a1ca tempest-GroupSnapshotsTest-1525757492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:21:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5a3f18e8-80c6-4e9d-b24d-c96db6d7a1ca tempest-GroupSnapshotsTest-1525757492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:21:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-5a3f18e8-80c6-4e9d-b24d-c96db6d7a1ca tempest-GroupSnapshotsTest-1525757492 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:21:43 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-5a3f18e8-80c6-4e9d-b24d-c96db6d7a1ca tempest-GroupSnapshotsTest-1525757492 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:21:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5a3f18e8-80c6-4e9d-b24d-c96db6d7a1ca tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:43 devstack sudo[92662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645 1073741824 Jul 16 23:21:43 devstack sudo[92662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:44 devstack sudo[92662]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5a3f18e8-80c6-4e9d-b24d-c96db6d7a1ca tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645 1073741824" returned: 0 in 0.459s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5a3f18e8-80c6-4e9d-b24d-c96db6d7a1ca tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:44 devstack sudo[92669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645 Jul 16 23:21:44 devstack sudo[92669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:44 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-a0819b2a-54d1-408b-a31c-05c25a8d4b5f tempest-VolumeQuotasNegativeTestJSON-114642080 None] Acquiring lock "cinder-b9275210-193d-465e-9173-4d8e55d430e8-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:21:44 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-a0819b2a-54d1-408b-a31c-05c25a8d4b5f tempest-VolumeQuotasNegativeTestJSON-114642080 None] Lock "cinder-b9275210-193d-465e-9173-4d8e55d430e8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:21:44 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-a0819b2a-54d1-408b-a31c-05c25a8d4b5f tempest-VolumeQuotasNegativeTestJSON-114642080 None] Acquiring lock "cinder-quobyte-b9275210-193d-465e-9173-4d8e55d430e8" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:21:44 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-a0819b2a-54d1-408b-a31c-05c25a8d4b5f tempest-VolumeQuotasNegativeTestJSON-114642080 None] Lock "cinder-quobyte-b9275210-193d-465e-9173-4d8e55d430e8" acquired by "delete_volume" :: waited 0.020s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:21:44 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0f65a8-5a32-411f-9d02-21cbfc7e1152]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:21:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a0819b2a-54d1-408b-a31c-05c25a8d4b5f tempest-VolumeQuotasNegativeTestJSON-114642080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b9275210-193d-465e-9173-4d8e55d430e8 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:44 devstack sudo[92669]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5a3f18e8-80c6-4e9d-b24d-c96db6d7a1ca tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645" returned: 0 in 0.444s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:44 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-5a3f18e8-80c6-4e9d-b24d-c96db6d7a1ca tempest-GroupSnapshotsTest-1525757492 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:21:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5a3f18e8-80c6-4e9d-b24d-c96db6d7a1ca tempest-GroupSnapshotsTest-1525757492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:21:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5a3f18e8-80c6-4e9d-b24d-c96db6d7a1ca tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7163a6fc-f14b-4366-9765-f95f2065b618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc218b88-4b0e-4795-9e7a-02198e194645', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5a3f18e8-80c6-4e9d-b24d-c96db6d7a1ca tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a36970fc-c2d8-4c5f-88d5-d19386210f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:44 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-5a3f18e8-80c6-4e9d-b24d-c96db6d7a1ca tempest-GroupSnapshotsTest-1525757492 None] Volume volume-bc218b88-4b0e-4795-9e7a-02198e194645 (bc218b88-4b0e-4795-9e7a-02198e194645): created successfully Jul 16 23:21:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5a3f18e8-80c6-4e9d-b24d-c96db6d7a1ca tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a36970fc-c2d8-4c5f-88d5-d19386210f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5a3f18e8-80c6-4e9d-b24d-c96db6d7a1ca tempest-GroupSnapshotsTest-1525757492 None] Flow 'volume_create_manager' (b1cdf3e9-1aaf-41ee-b05c-2d3dbe1156b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:21:44 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-5a3f18e8-80c6-4e9d-b24d-c96db6d7a1ca tempest-GroupSnapshotsTest-1525757492 None] Created volume successfully. Jul 16 23:21:44 devstack sudo[92672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b9275210-193d-465e-9173-4d8e55d430e8 Jul 16 23:21:44 devstack sudo[92672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:44 devstack sudo[92672]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a0819b2a-54d1-408b-a31c-05c25a8d4b5f tempest-VolumeQuotasNegativeTestJSON-114642080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b9275210-193d-465e-9173-4d8e55d430e8" returned: 0 in 0.470s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a0819b2a-54d1-408b-a31c-05c25a8d4b5f tempest-VolumeQuotasNegativeTestJSON-114642080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b9275210-193d-465e-9173-4d8e55d430e8 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:45 devstack sudo[92677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b9275210-193d-465e-9173-4d8e55d430e8 Jul 16 23:21:45 devstack sudo[92677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:45 devstack sudo[92677]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a0819b2a-54d1-408b-a31c-05c25a8d4b5f tempest-VolumeQuotasNegativeTestJSON-114642080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b9275210-193d-465e-9173-4d8e55d430e8" returned: 0 in 0.305s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:45 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-a0819b2a-54d1-408b-a31c-05c25a8d4b5f tempest-VolumeQuotasNegativeTestJSON-114642080 None] Lock "cinder-quobyte-b9275210-193d-465e-9173-4d8e55d430e8" released by "delete_volume" :: held 0.842s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:21:45 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-a0819b2a-54d1-408b-a31c-05c25a8d4b5f tempest-VolumeQuotasNegativeTestJSON-114642080 None] Created reservations ['0ac1e94c-55ec-42a9-97e1-7aa4455003e5', '560c74cb-7e75-44ad-a3bc-dfc411a0e68e', 'ca3c6da2-6036-4b63-a53d-599409f86e06', '82c80d76-d3b9-4700-a1d8-676eb3d303ad'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:21:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a0819b2a-54d1-408b-a31c-05c25a8d4b5f tempest-VolumeQuotasNegativeTestJSON-114642080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:21:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a0819b2a-54d1-408b-a31c-05c25a8d4b5f tempest-VolumeQuotasNegativeTestJSON-114642080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:21:45 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a0819b2a-54d1-408b-a31c-05c25a8d4b5f tempest-VolumeQuotasNegativeTestJSON-114642080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:21:45 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a0819b2a-54d1-408b-a31c-05c25a8d4b5f tempest-VolumeQuotasNegativeTestJSON-114642080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:21:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a0819b2a-54d1-408b-a31c-05c25a8d4b5f tempest-VolumeQuotasNegativeTestJSON-114642080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:21:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a0819b2a-54d1-408b-a31c-05c25a8d4b5f tempest-VolumeQuotasNegativeTestJSON-114642080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:45 devstack sudo[92680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:21:45 devstack sudo[92680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:45 devstack sudo[92680]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a0819b2a-54d1-408b-a31c-05c25a8d4b5f tempest-VolumeQuotasNegativeTestJSON-114642080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.301s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:45 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-a0819b2a-54d1-408b-a31c-05c25a8d4b5f tempest-VolumeQuotasNegativeTestJSON-114642080 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:21:45 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-a0819b2a-54d1-408b-a31c-05c25a8d4b5f tempest-VolumeQuotasNegativeTestJSON-114642080 None] Deleted volume successfully. Jul 16 23:21:45 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-a0819b2a-54d1-408b-a31c-05c25a8d4b5f tempest-VolumeQuotasNegativeTestJSON-114642080 None] Lock "cinder-b9275210-193d-465e-9173-4d8e55d430e8-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:21:46 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-50b60dd5-8fea-48c4-833a-fa12dd56783e tempest-GroupSnapshotsTest-1525757492 None] GroupSnapshot 5647d9f4-660d-4dd0-b66e-c5176f79ef5f: creating. Jul 16 23:21:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-50b60dd5-8fea-48c4-833a-fa12dd56783e tempest-GroupSnapshotsTest-1525757492 None] Group snapshot 5647d9f4-660d-4dd0-b66e-c5176f79ef5f: creating. {{(pid=87607) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 16 23:21:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-50b60dd5-8fea-48c4-833a-fa12dd56783e tempest-GroupSnapshotsTest-1525757492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:21:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-50b60dd5-8fea-48c4-833a-fa12dd56783e tempest-GroupSnapshotsTest-1525757492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:21:46 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-50b60dd5-8fea-48c4-833a-fa12dd56783e tempest-GroupSnapshotsTest-1525757492 None] Creating offline snapshot b0fb29c5-632b-4dee-99b4-7ad9547575a4 of volume bc218b88-4b0e-4795-9e7a-02198e194645 {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:21:46 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd81d8b-2d75-4333-9ccd-d2efed5d5c48]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:21:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-50b60dd5-8fea-48c4-833a-fa12dd56783e tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:46 devstack sudo[92703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645 Jul 16 23:21:46 devstack sudo[92703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:46 devstack sudo[92703]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-50b60dd5-8fea-48c4-833a-fa12dd56783e tempest-GroupSnapshotsTest-1525757492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645" returned: 0 in 0.412s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-50b60dd5-8fea-48c4-833a-fa12dd56783e tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645.b0fb29c5-632b-4dee-99b4-7ad9547575a4 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:46 devstack sudo[92708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645.b0fb29c5-632b-4dee-99b4-7ad9547575a4 1G Jul 16 23:21:46 devstack sudo[92708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:47 devstack sudo[92708]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-50b60dd5-8fea-48c4-833a-fa12dd56783e tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645.b0fb29c5-632b-4dee-99b4-7ad9547575a4 1G" returned: 0 in 0.469s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-50b60dd5-8fea-48c4-833a-fa12dd56783e tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc218b88-4b0e-4795-9e7a-02198e194645 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645.b0fb29c5-632b-4dee-99b4-7ad9547575a4 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:47 devstack sudo[92715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc218b88-4b0e-4795-9e7a-02198e194645 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645.b0fb29c5-632b-4dee-99b4-7ad9547575a4 Jul 16 23:21:47 devstack sudo[92715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:47 devstack sudo[92715]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-50b60dd5-8fea-48c4-833a-fa12dd56783e tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc218b88-4b0e-4795-9e7a-02198e194645 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645.b0fb29c5-632b-4dee-99b4-7ad9547575a4" returned: 0 in 0.377s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:47 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-50b60dd5-8fea-48c4-833a-fa12dd56783e tempest-GroupSnapshotsTest-1525757492 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645.b0fb29c5-632b-4dee-99b4-7ad9547575a4 is being set with open permissions: ugo+rw: NotImplementedError Jul 16 23:21:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-50b60dd5-8fea-48c4-833a-fa12dd56783e tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645.b0fb29c5-632b-4dee-99b4-7ad9547575a4 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:47 devstack sudo[92721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645.b0fb29c5-632b-4dee-99b4-7ad9547575a4 Jul 16 23:21:47 devstack sudo[92721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:47 devstack sudo[92721]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-50b60dd5-8fea-48c4-833a-fa12dd56783e tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645.b0fb29c5-632b-4dee-99b4-7ad9547575a4" returned: 0 in 0.290s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-50b60dd5-8fea-48c4-833a-fa12dd56783e tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:47 devstack sudo[92724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645.info Jul 16 23:21:47 devstack sudo[92724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:48 devstack sudo[92724]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-50b60dd5-8fea-48c4-833a-fa12dd56783e tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645.info" returned: 0 in 0.291s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:48 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-50b60dd5-8fea-48c4-833a-fa12dd56783e tempest-GroupSnapshotsTest-1525757492 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645.info is being set with open permissions: ugo+rw: NotImplementedError Jul 16 23:21:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-50b60dd5-8fea-48c4-833a-fa12dd56783e tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:48 devstack sudo[92727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645.info Jul 16 23:21:48 devstack sudo[92727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:48 devstack sudo[92727]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-50b60dd5-8fea-48c4-833a-fa12dd56783e tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645.info" returned: 0 in 0.304s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-50b60dd5-8fea-48c4-833a-fa12dd56783e tempest-GroupSnapshotsTest-1525757492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.262s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:21:48 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-50b60dd5-8fea-48c4-833a-fa12dd56783e tempest-GroupSnapshotsTest-1525757492 None] group_snapshot 5647d9f4-660d-4dd0-b66e-c5176f79ef5f: created successfully Jul 16 23:21:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1e873fc6-bfac-44e5-ae13-473b793d6ab3 tempest-GroupSnapshotsTest-1525757492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:21:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1e873fc6-bfac-44e5-ae13-473b793d6ab3 tempest-GroupSnapshotsTest-1525757492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:21:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1e873fc6-bfac-44e5-ae13-473b793d6ab3 tempest-GroupSnapshotsTest-1525757492 None] Acquiring lock "cinder-quobyte-b0fb29c5-632b-4dee-99b4-7ad9547575a4-d983b617-75e8-419a-b71c-cafe2621458b" by "_create_volume_from_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:21:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1e873fc6-bfac-44e5-ae13-473b793d6ab3 tempest-GroupSnapshotsTest-1525757492 None] Lock "cinder-quobyte-b0fb29c5-632b-4dee-99b4-7ad9547575a4-d983b617-75e8-419a-b71c-cafe2621458b" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:21:50 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1e873fc6-bfac-44e5-ae13-473b793d6ab3 tempest-GroupSnapshotsTest-1525757492 None] Creating volume d983b617-75e8-419a-b71c-cafe2621458b from snapshot b0fb29c5-632b-4dee-99b4-7ad9547575a4 {{(pid=87607) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 16 23:21:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1e873fc6-bfac-44e5-ae13-473b793d6ab3 tempest-GroupSnapshotsTest-1525757492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:21:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1e873fc6-bfac-44e5-ae13-473b793d6ab3 tempest-GroupSnapshotsTest-1525757492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:21:50 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1e873fc6-bfac-44e5-ae13-473b793d6ab3 tempest-GroupSnapshotsTest-1525757492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:21:50 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1e873fc6-bfac-44e5-ae13-473b793d6ab3 tempest-GroupSnapshotsTest-1525757492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:21:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1e873fc6-bfac-44e5-ae13-473b793d6ab3 tempest-GroupSnapshotsTest-1525757492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:21:50 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1e873fc6-bfac-44e5-ae13-473b793d6ab3 tempest-GroupSnapshotsTest-1525757492 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:21:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1e873fc6-bfac-44e5-ae13-473b793d6ab3 tempest-GroupSnapshotsTest-1525757492 None] Acquiring lock "cinder-quobyte-d983b617-75e8-419a-b71c-cafe2621458b" by "_copy_volume_from_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:21:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1e873fc6-bfac-44e5-ae13-473b793d6ab3 tempest-GroupSnapshotsTest-1525757492 None] Lock "cinder-quobyte-d983b617-75e8-419a-b71c-cafe2621458b" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:21:50 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1e873fc6-bfac-44e5-ae13-473b793d6ab3 tempest-GroupSnapshotsTest-1525757492 None] snapshot: b0fb29c5-632b-4dee-99b4-7ad9547575a4, volume: d983b617-75e8-419a-b71c-cafe2621458b, {{(pid=87607) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 16 23:21:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1e873fc6-bfac-44e5-ae13-473b793d6ab3 tempest-GroupSnapshotsTest-1525757492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:21:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1e873fc6-bfac-44e5-ae13-473b793d6ab3 tempest-GroupSnapshotsTest-1525757492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:21:50 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1e873fc6-bfac-44e5-ae13-473b793d6ab3 tempest-GroupSnapshotsTest-1525757492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:21:50 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1e873fc6-bfac-44e5-ae13-473b793d6ab3 tempest-GroupSnapshotsTest-1525757492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:21:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1e873fc6-bfac-44e5-ae13-473b793d6ab3 tempest-GroupSnapshotsTest-1525757492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:21:50 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7a9529-5373-4e53-bb74-23639608e5c1]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:21:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1e873fc6-bfac-44e5-ae13-473b793d6ab3 tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645.b0fb29c5-632b-4dee-99b4-7ad9547575a4 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:50 devstack sudo[92743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645.b0fb29c5-632b-4dee-99b4-7ad9547575a4 Jul 16 23:21:50 devstack sudo[92743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:50 devstack sudo[92743]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1e873fc6-bfac-44e5-ae13-473b793d6ab3 tempest-GroupSnapshotsTest-1525757492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645.b0fb29c5-632b-4dee-99b4-7ad9547575a4" returned: 0 in 0.502s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:51 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-1e873fc6-bfac-44e5-ae13-473b793d6ab3 tempest-GroupSnapshotsTest-1525757492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc218b88-4b0e-4795-9e7a-02198e194645(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:21:51 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1e873fc6-bfac-44e5-ae13-473b793d6ab3 tempest-GroupSnapshotsTest-1525757492 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645 {{(pid=87607) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 16 23:21:51 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1e873fc6-bfac-44e5-ae13-473b793d6ab3 tempest-GroupSnapshotsTest-1525757492 None] Creating direct copy from snapshot {{(pid=87607) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 16 23:21:51 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b80946b-8a3c-4f79-830a-0c7f98ec77da]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:21:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1e873fc6-bfac-44e5-ae13-473b793d6ab3 tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:51 devstack sudo[92752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645 Jul 16 23:21:51 devstack sudo[92752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:51 devstack sudo[92752]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1e873fc6-bfac-44e5-ae13-473b793d6ab3 tempest-GroupSnapshotsTest-1525757492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645" returned: 0 in 0.695s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:51 devstack cinder-volume[87607]: DEBUG cinder.utils [None req-1e873fc6-bfac-44e5-ae13-473b793d6ab3 tempest-GroupSnapshotsTest-1525757492 None] Path /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d983b617-75e8-419a-b71c-cafe2621458b not found in is_blk_device check {{(pid=87607) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 16 23:21:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1e873fc6-bfac-44e5-ae13-473b793d6ab3 tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d983b617-75e8-419a-b71c-cafe2621458b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:51 devstack sudo[92757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d983b617-75e8-419a-b71c-cafe2621458b Jul 16 23:21:51 devstack sudo[92757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:54 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-36a6e625-9d21-46b2-b732-70f67cdca1df tempest-VolumeTypesAccessTest-2088049063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:21:54 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-36a6e625-9d21-46b2-b732-70f67cdca1df tempest-VolumeTypesAccessTest-2088049063 None] Flow 'volume_create_manager' (16b0d540-9580-45cf-b20c-baefa0bf66c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:21:54 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-36a6e625-9d21-46b2-b732-70f67cdca1df tempest-VolumeTypesAccessTest-2088049063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5835c332-366a-4c4e-9656-9b0cd69837a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:54 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-36a6e625-9d21-46b2-b732-70f67cdca1df tempest-VolumeTypesAccessTest-2088049063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5835c332-366a-4c4e-9656-9b0cd69837a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-660291780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acb60abb-d011-4fd2-a8e1-f1221a17069d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7366b52ce1848b588597349421a1200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:21:55Z,use_quota=True,user_id='de52b43c6ba5490a806afd8043028540',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccd0d0ca-641c-40a3-9412-8aade7d8336e),volume_type_id=ccd0d0ca-641c-40a3-9412-8aade7d8336e)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:54 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-36a6e625-9d21-46b2-b732-70f67cdca1df tempest-VolumeTypesAccessTest-2088049063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26ae56eb-e617-40c0-94b4-af3f2d1d5527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:54 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-36a6e625-9d21-46b2-b732-70f67cdca1df tempest-VolumeTypesAccessTest-2088049063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26ae56eb-e617-40c0-94b4-af3f2d1d5527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:54 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-36a6e625-9d21-46b2-b732-70f67cdca1df tempest-VolumeTypesAccessTest-2088049063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1739943-7867-477f-bdd1-c4074835d0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:54 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-36a6e625-9d21-46b2-b732-70f67cdca1df tempest-VolumeTypesAccessTest-2088049063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1739943-7867-477f-bdd1-c4074835d0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acb60abb-d011-4fd2-a8e1-f1221a17069d', 'volume_name': 'volume-acb60abb-d011-4fd2-a8e1-f1221a17069d', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:54 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-36a6e625-9d21-46b2-b732-70f67cdca1df tempest-VolumeTypesAccessTest-2088049063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d1ee20b-0074-4313-810d-69b3f294e52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:54 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-36a6e625-9d21-46b2-b732-70f67cdca1df tempest-VolumeTypesAccessTest-2088049063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d1ee20b-0074-4313-810d-69b3f294e52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:21:54 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-36a6e625-9d21-46b2-b732-70f67cdca1df tempest-VolumeTypesAccessTest-2088049063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0930bd09-efba-4548-9f3a-08ca0252280c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:21:55 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-36a6e625-9d21-46b2-b732-70f67cdca1df tempest-VolumeTypesAccessTest-2088049063 None] Volume acb60abb-d011-4fd2-a8e1-f1221a17069d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acb60abb-d011-4fd2-a8e1-f1221a17069d', 'volume_size': 1} Jul 16 23:21:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-36a6e625-9d21-46b2-b732-70f67cdca1df tempest-VolumeTypesAccessTest-2088049063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:21:58 devstack sudo[92757]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1e873fc6-bfac-44e5-ae13-473b793d6ab3 tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d983b617-75e8-419a-b71c-cafe2621458b" returned: 0 in 6.620s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:58 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa2f825-17f2-4482-aed7-6fc0586517e1]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:21:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1e873fc6-bfac-44e5-ae13-473b793d6ab3 tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:58 devstack sudo[92783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645 Jul 16 23:21:58 devstack sudo[92783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:58 devstack sudo[92783]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1e873fc6-bfac-44e5-ae13-473b793d6ab3 tempest-GroupSnapshotsTest-1525757492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645" returned: 0 in 0.553s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:58 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-1e873fc6-bfac-44e5-ae13-473b793d6ab3 tempest-GroupSnapshotsTest-1525757492 None] Image conversion details: src /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645, size 1024.00 MB, duration 6.62 sec, destination /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d983b617-75e8-419a-b71c-cafe2621458b {{(pid=87607) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 23:21:58 devstack cinder-volume[87607]: INFO cinder.image.image_utils [None req-1e873fc6-bfac-44e5-ae13-473b793d6ab3 tempest-GroupSnapshotsTest-1525757492 None] Converted 1024.00 MB image at 154.67 MB/s Jul 16 23:21:58 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-1e873fc6-bfac-44e5-ae13-473b793d6ab3 tempest-GroupSnapshotsTest-1525757492 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d983b617-75e8-419a-b71c-cafe2621458b is being set with open permissions: ugo+rw: NotImplementedError Jul 16 23:21:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1e873fc6-bfac-44e5-ae13-473b793d6ab3 tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d983b617-75e8-419a-b71c-cafe2621458b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:58 devstack sudo[92789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d983b617-75e8-419a-b71c-cafe2621458b Jul 16 23:21:58 devstack sudo[92789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:59 devstack sudo[92789]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1e873fc6-bfac-44e5-ae13-473b793d6ab3 tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d983b617-75e8-419a-b71c-cafe2621458b" returned: 0 in 0.256s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:59 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1e873fc6-bfac-44e5-ae13-473b793d6ab3 tempest-GroupSnapshotsTest-1525757492 None] Lock "cinder-quobyte-d983b617-75e8-419a-b71c-cafe2621458b" released by "_copy_volume_from_snapshot" :: held 8.765s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:21:59 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1e873fc6-bfac-44e5-ae13-473b793d6ab3 tempest-GroupSnapshotsTest-1525757492 None] Lock "cinder-quobyte-b0fb29c5-632b-4dee-99b4-7ad9547575a4-d983b617-75e8-419a-b71c-cafe2621458b" released by "_create_volume_from_snapshot" :: held 8.824s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:21:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1e873fc6-bfac-44e5-ae13-473b793d6ab3 tempest-GroupSnapshotsTest-1525757492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.854s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:21:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-36a6e625-9d21-46b2-b732-70f67cdca1df tempest-VolumeTypesAccessTest-2088049063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.201s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:21:59 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-36a6e625-9d21-46b2-b732-70f67cdca1df tempest-VolumeTypesAccessTest-2088049063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-660291780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acb60abb-d011-4fd2-a8e1-f1221a17069d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7366b52ce1848b588597349421a1200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:21:55Z,use_quota=True,user_id='de52b43c6ba5490a806afd8043028540',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccd0d0ca-641c-40a3-9412-8aade7d8336e),volume_type_id=ccd0d0ca-641c-40a3-9412-8aade7d8336e)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:21:59 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-36a6e625-9d21-46b2-b732-70f67cdca1df tempest-VolumeTypesAccessTest-2088049063 None] Creating volume acb60abb-d011-4fd2-a8e1-f1221a17069d {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:21:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-36a6e625-9d21-46b2-b732-70f67cdca1df tempest-VolumeTypesAccessTest-2088049063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:21:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-36a6e625-9d21-46b2-b732-70f67cdca1df tempest-VolumeTypesAccessTest-2088049063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:21:59 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-36a6e625-9d21-46b2-b732-70f67cdca1df tempest-VolumeTypesAccessTest-2088049063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:21:59 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-36a6e625-9d21-46b2-b732-70f67cdca1df tempest-VolumeTypesAccessTest-2088049063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:21:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-36a6e625-9d21-46b2-b732-70f67cdca1df tempest-VolumeTypesAccessTest-2088049063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:21:59 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-36a6e625-9d21-46b2-b732-70f67cdca1df tempest-VolumeTypesAccessTest-2088049063 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:21:59 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-36a6e625-9d21-46b2-b732-70f67cdca1df tempest-VolumeTypesAccessTest-2088049063 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:21:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-36a6e625-9d21-46b2-b732-70f67cdca1df tempest-VolumeTypesAccessTest-2088049063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-acb60abb-d011-4fd2-a8e1-f1221a17069d 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:59 devstack sudo[92792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-acb60abb-d011-4fd2-a8e1-f1221a17069d 1073741824 Jul 16 23:21:59 devstack sudo[92792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:21:59 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-1e873fc6-bfac-44e5-ae13-473b793d6ab3 tempest-GroupSnapshotsTest-1525757492 None] Create group from source-snapshot-5647d9f4-660d-4dd0-b66e-c5176f79ef5f completed successfully. Jul 16 23:21:59 devstack sudo[92792]: pam_unix(sudo:session): session closed for user root Jul 16 23:21:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-36a6e625-9d21-46b2-b732-70f67cdca1df tempest-VolumeTypesAccessTest-2088049063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-acb60abb-d011-4fd2-a8e1-f1221a17069d 1073741824" returned: 0 in 0.473s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:21:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-36a6e625-9d21-46b2-b732-70f67cdca1df tempest-VolumeTypesAccessTest-2088049063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-acb60abb-d011-4fd2-a8e1-f1221a17069d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:21:59 devstack sudo[92804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-acb60abb-d011-4fd2-a8e1-f1221a17069d Jul 16 23:21:59 devstack sudo[92804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:00 devstack sudo[92804]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-36a6e625-9d21-46b2-b732-70f67cdca1df tempest-VolumeTypesAccessTest-2088049063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-acb60abb-d011-4fd2-a8e1-f1221a17069d" returned: 0 in 0.287s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:00 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-36a6e625-9d21-46b2-b732-70f67cdca1df tempest-VolumeTypesAccessTest-2088049063 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:22:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-36a6e625-9d21-46b2-b732-70f67cdca1df tempest-VolumeTypesAccessTest-2088049063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:00 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-36a6e625-9d21-46b2-b732-70f67cdca1df tempest-VolumeTypesAccessTest-2088049063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0930bd09-efba-4548-9f3a-08ca0252280c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acb60abb-d011-4fd2-a8e1-f1221a17069d', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:00 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-36a6e625-9d21-46b2-b732-70f67cdca1df tempest-VolumeTypesAccessTest-2088049063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c67f80a3-d662-425c-abca-6118329f11ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:00 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-36a6e625-9d21-46b2-b732-70f67cdca1df tempest-VolumeTypesAccessTest-2088049063 None] Volume volume-acb60abb-d011-4fd2-a8e1-f1221a17069d (acb60abb-d011-4fd2-a8e1-f1221a17069d): created successfully Jul 16 23:22:00 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-36a6e625-9d21-46b2-b732-70f67cdca1df tempest-VolumeTypesAccessTest-2088049063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c67f80a3-d662-425c-abca-6118329f11ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:00 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-36a6e625-9d21-46b2-b732-70f67cdca1df tempest-VolumeTypesAccessTest-2088049063 None] Flow 'volume_create_manager' (16b0d540-9580-45cf-b20c-baefa0bf66c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:22:00 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-36a6e625-9d21-46b2-b732-70f67cdca1df tempest-VolumeTypesAccessTest-2088049063 None] Created volume successfully. Jul 16 23:22:00 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6d03a6e-a5e2-477b-a929-45044ff87fb9 tempest-AttachVolumeTestJSON-886512989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:22:00 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e6d03a6e-a5e2-477b-a929-45044ff87fb9 tempest-AttachVolumeTestJSON-886512989 None] Flow 'volume_create_manager' (68eaf888-98ff-4921-b23e-2260ec9b0877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:22:00 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e6d03a6e-a5e2-477b-a929-45044ff87fb9 tempest-AttachVolumeTestJSON-886512989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24311d6b-3c80-44b9-9110-810392a62e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:00 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e6d03a6e-a5e2-477b-a929-45044ff87fb9 tempest-AttachVolumeTestJSON-886512989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24311d6b-3c80-44b9-9110-810392a62e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1694723782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70b02aa0-e8ae-4aaa-bb47-d48c7f3eb9c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f3ab8578d9c45a992334f8e308a7da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:22:01Z,use_quota=True,user_id='f25c9557a8864126a12ef4fe1cd177c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:00 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e6d03a6e-a5e2-477b-a929-45044ff87fb9 tempest-AttachVolumeTestJSON-886512989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36ea6b94-0f34-4f12-a461-9ece8b413896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:00 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e6d03a6e-a5e2-477b-a929-45044ff87fb9 tempest-AttachVolumeTestJSON-886512989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36ea6b94-0f34-4f12-a461-9ece8b413896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:00 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e6d03a6e-a5e2-477b-a929-45044ff87fb9 tempest-AttachVolumeTestJSON-886512989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60c241a7-44fd-490b-8ace-f95f79454c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:00 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e6d03a6e-a5e2-477b-a929-45044ff87fb9 tempest-AttachVolumeTestJSON-886512989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60c241a7-44fd-490b-8ace-f95f79454c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70b02aa0-e8ae-4aaa-bb47-d48c7f3eb9c7', 'volume_name': 'volume-70b02aa0-e8ae-4aaa-bb47-d48c7f3eb9c7', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:00 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e6d03a6e-a5e2-477b-a929-45044ff87fb9 tempest-AttachVolumeTestJSON-886512989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b6aced1-6e3f-4663-baa5-9e986257848f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:00 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e6d03a6e-a5e2-477b-a929-45044ff87fb9 tempest-AttachVolumeTestJSON-886512989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b6aced1-6e3f-4663-baa5-9e986257848f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:00 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e6d03a6e-a5e2-477b-a929-45044ff87fb9 tempest-AttachVolumeTestJSON-886512989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35d4f35f-ab52-4e21-831f-46cffea8a059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:00 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-e6d03a6e-a5e2-477b-a929-45044ff87fb9 tempest-AttachVolumeTestJSON-886512989 None] Volume 70b02aa0-e8ae-4aaa-bb47-d48c7f3eb9c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70b02aa0-e8ae-4aaa-bb47-d48c7f3eb9c7', 'volume_size': 1} Jul 16 23:22:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e6d03a6e-a5e2-477b-a929-45044ff87fb9 tempest-AttachVolumeTestJSON-886512989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e6d03a6e-a5e2-477b-a929-45044ff87fb9 tempest-AttachVolumeTestJSON-886512989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:00 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e6d03a6e-a5e2-477b-a929-45044ff87fb9 tempest-AttachVolumeTestJSON-886512989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1694723782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70b02aa0-e8ae-4aaa-bb47-d48c7f3eb9c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f3ab8578d9c45a992334f8e308a7da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:22:01Z,use_quota=True,user_id='f25c9557a8864126a12ef4fe1cd177c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:22:00 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-e6d03a6e-a5e2-477b-a929-45044ff87fb9 tempest-AttachVolumeTestJSON-886512989 None] Creating volume 70b02aa0-e8ae-4aaa-bb47-d48c7f3eb9c7 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:22:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e6d03a6e-a5e2-477b-a929-45044ff87fb9 tempest-AttachVolumeTestJSON-886512989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e6d03a6e-a5e2-477b-a929-45044ff87fb9 tempest-AttachVolumeTestJSON-886512989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:00 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e6d03a6e-a5e2-477b-a929-45044ff87fb9 tempest-AttachVolumeTestJSON-886512989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:22:00 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e6d03a6e-a5e2-477b-a929-45044ff87fb9 tempest-AttachVolumeTestJSON-886512989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:22:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e6d03a6e-a5e2-477b-a929-45044ff87fb9 tempest-AttachVolumeTestJSON-886512989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:00 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e6d03a6e-a5e2-477b-a929-45044ff87fb9 tempest-AttachVolumeTestJSON-886512989 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:22:00 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-e6d03a6e-a5e2-477b-a929-45044ff87fb9 tempest-AttachVolumeTestJSON-886512989 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:22:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e6d03a6e-a5e2-477b-a929-45044ff87fb9 tempest-AttachVolumeTestJSON-886512989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-70b02aa0-e8ae-4aaa-bb47-d48c7f3eb9c7 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:00 devstack sudo[92807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-70b02aa0-e8ae-4aaa-bb47-d48c7f3eb9c7 1073741824 Jul 16 23:22:00 devstack sudo[92807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:00 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-de5e3e16-1563-456e-9a0b-ff96d8a31bd5 tempest-GroupSnapshotsTest-1525757492 None] Acquiring lock "cinder-quobyte-d983b617-75e8-419a-b71c-cafe2621458b" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:22:00 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-de5e3e16-1563-456e-9a0b-ff96d8a31bd5 tempest-GroupSnapshotsTest-1525757492 None] Lock "cinder-quobyte-d983b617-75e8-419a-b71c-cafe2621458b" acquired by "delete_volume" :: waited 0.035s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:22:00 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f6905c-2491-4fce-9ed8-773c820f0d3c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:22:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-de5e3e16-1563-456e-9a0b-ff96d8a31bd5 tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d983b617-75e8-419a-b71c-cafe2621458b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:01 devstack sudo[92809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d983b617-75e8-419a-b71c-cafe2621458b Jul 16 23:22:01 devstack sudo[92809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:01 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-49204c0a-05be-45c4-9c79-52b7972f7d83 tempest-VolumeTypesAccessTest-2088049063 None] Acquiring lock "cinder-acb60abb-d011-4fd2-a8e1-f1221a17069d-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:22:01 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-49204c0a-05be-45c4-9c79-52b7972f7d83 tempest-VolumeTypesAccessTest-2088049063 None] Lock "cinder-acb60abb-d011-4fd2-a8e1-f1221a17069d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:22:01 devstack sudo[92807]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e6d03a6e-a5e2-477b-a929-45044ff87fb9 tempest-AttachVolumeTestJSON-886512989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-70b02aa0-e8ae-4aaa-bb47-d48c7f3eb9c7 1073741824" returned: 0 in 0.538s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e6d03a6e-a5e2-477b-a929-45044ff87fb9 tempest-AttachVolumeTestJSON-886512989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-70b02aa0-e8ae-4aaa-bb47-d48c7f3eb9c7 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:01 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-49204c0a-05be-45c4-9c79-52b7972f7d83 tempest-VolumeTypesAccessTest-2088049063 None] Acquiring lock "cinder-quobyte-acb60abb-d011-4fd2-a8e1-f1221a17069d" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:22:01 devstack sudo[92819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-70b02aa0-e8ae-4aaa-bb47-d48c7f3eb9c7 Jul 16 23:22:01 devstack sudo[92819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:01 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-49204c0a-05be-45c4-9c79-52b7972f7d83 tempest-VolumeTypesAccessTest-2088049063 None] Lock "cinder-quobyte-acb60abb-d011-4fd2-a8e1-f1221a17069d" acquired by "delete_volume" :: waited 0.020s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:22:01 devstack sudo[92809]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-de5e3e16-1563-456e-9a0b-ff96d8a31bd5 tempest-GroupSnapshotsTest-1525757492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d983b617-75e8-419a-b71c-cafe2621458b" returned: 0 in 0.513s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-de5e3e16-1563-456e-9a0b-ff96d8a31bd5 tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d983b617-75e8-419a-b71c-cafe2621458b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:01 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d586c71-992f-4ef2-aed2-db9c068612d2]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:22:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-49204c0a-05be-45c4-9c79-52b7972f7d83 tempest-VolumeTypesAccessTest-2088049063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-acb60abb-d011-4fd2-a8e1-f1221a17069d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:01 devstack sudo[92821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d983b617-75e8-419a-b71c-cafe2621458b Jul 16 23:22:01 devstack sudo[92821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:01 devstack sudo[92822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-acb60abb-d011-4fd2-a8e1-f1221a17069d Jul 16 23:22:01 devstack sudo[92822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:01 devstack sudo[92819]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e6d03a6e-a5e2-477b-a929-45044ff87fb9 tempest-AttachVolumeTestJSON-886512989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-70b02aa0-e8ae-4aaa-bb47-d48c7f3eb9c7" returned: 0 in 0.290s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:01 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e6d03a6e-a5e2-477b-a929-45044ff87fb9 tempest-AttachVolumeTestJSON-886512989 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:22:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e6d03a6e-a5e2-477b-a929-45044ff87fb9 tempest-AttachVolumeTestJSON-886512989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e6d03a6e-a5e2-477b-a929-45044ff87fb9 tempest-AttachVolumeTestJSON-886512989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35d4f35f-ab52-4e21-831f-46cffea8a059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70b02aa0-e8ae-4aaa-bb47-d48c7f3eb9c7', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e6d03a6e-a5e2-477b-a929-45044ff87fb9 tempest-AttachVolumeTestJSON-886512989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea1fad48-9bcc-41a5-a700-d6f664082feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:01 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-e6d03a6e-a5e2-477b-a929-45044ff87fb9 tempest-AttachVolumeTestJSON-886512989 None] Volume volume-70b02aa0-e8ae-4aaa-bb47-d48c7f3eb9c7 (70b02aa0-e8ae-4aaa-bb47-d48c7f3eb9c7): created successfully Jul 16 23:22:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e6d03a6e-a5e2-477b-a929-45044ff87fb9 tempest-AttachVolumeTestJSON-886512989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea1fad48-9bcc-41a5-a700-d6f664082feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e6d03a6e-a5e2-477b-a929-45044ff87fb9 tempest-AttachVolumeTestJSON-886512989 None] Flow 'volume_create_manager' (68eaf888-98ff-4921-b23e-2260ec9b0877) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:22:01 devstack sudo[92821]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-de5e3e16-1563-456e-9a0b-ff96d8a31bd5 tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d983b617-75e8-419a-b71c-cafe2621458b" returned: 0 in 0.303s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:01 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-e6d03a6e-a5e2-477b-a929-45044ff87fb9 tempest-AttachVolumeTestJSON-886512989 None] Created volume successfully. Jul 16 23:22:01 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-de5e3e16-1563-456e-9a0b-ff96d8a31bd5 tempest-GroupSnapshotsTest-1525757492 None] Lock "cinder-quobyte-d983b617-75e8-419a-b71c-cafe2621458b" released by "delete_volume" :: held 0.882s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:22:01 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-de5e3e16-1563-456e-9a0b-ff96d8a31bd5 tempest-GroupSnapshotsTest-1525757492 None] Created reservations ['92c59b3e-2480-47dc-a3c3-aea6c0b49a31'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:22:01 devstack cinder-volume[87607]: WARNING cinder.quota [None req-de5e3e16-1563-456e-9a0b-ff96d8a31bd5 tempest-GroupSnapshotsTest-1525757492 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-132113537 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-132113537, it is now deprecated. Please use the default quota class for default quota. Jul 16 23:22:01 devstack cinder-volume[87607]: WARNING cinder.quota [None req-de5e3e16-1563-456e-9a0b-ff96d8a31bd5 tempest-GroupSnapshotsTest-1525757492 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-132113537 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-132113537, it is now deprecated. Please use the default quota class for default quota. Jul 16 23:22:01 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-de5e3e16-1563-456e-9a0b-ff96d8a31bd5 tempest-GroupSnapshotsTest-1525757492 None] Created reservations ['6274e993-43f1-45e9-a482-ba219eea0369', 'b30841d9-fee6-4378-bc6f-bb8c8c6ad3e1', 'a620d548-83d7-468d-8f73-772dbbffa0df', 'afd192fa-83be-4fd4-81a9-5adb97e81ac9'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:22:01 devstack sudo[92822]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-49204c0a-05be-45c4-9c79-52b7972f7d83 tempest-VolumeTypesAccessTest-2088049063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-acb60abb-d011-4fd2-a8e1-f1221a17069d" returned: 0 in 0.458s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-49204c0a-05be-45c4-9c79-52b7972f7d83 tempest-VolumeTypesAccessTest-2088049063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-acb60abb-d011-4fd2-a8e1-f1221a17069d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:01 devstack sudo[92830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-acb60abb-d011-4fd2-a8e1-f1221a17069d Jul 16 23:22:01 devstack sudo[92830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-de5e3e16-1563-456e-9a0b-ff96d8a31bd5 tempest-GroupSnapshotsTest-1525757492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-de5e3e16-1563-456e-9a0b-ff96d8a31bd5 tempest-GroupSnapshotsTest-1525757492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:01 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-de5e3e16-1563-456e-9a0b-ff96d8a31bd5 tempest-GroupSnapshotsTest-1525757492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:22:01 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-de5e3e16-1563-456e-9a0b-ff96d8a31bd5 tempest-GroupSnapshotsTest-1525757492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:22:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-de5e3e16-1563-456e-9a0b-ff96d8a31bd5 tempest-GroupSnapshotsTest-1525757492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-de5e3e16-1563-456e-9a0b-ff96d8a31bd5 tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:02 devstack sudo[92832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:22:02 devstack sudo[92832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:02 devstack sudo[92830]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:02 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-58cb0cfd-a168-479c-a899-89c2671f7ee1 tempest-GroupSnapshotsTest-1525757492 None] group_snapshot 5647d9f4-660d-4dd0-b66e-c5176f79ef5f: deleting Jul 16 23:22:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-49204c0a-05be-45c4-9c79-52b7972f7d83 tempest-VolumeTypesAccessTest-2088049063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-acb60abb-d011-4fd2-a8e1-f1221a17069d" returned: 0 in 0.326s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:02 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-49204c0a-05be-45c4-9c79-52b7972f7d83 tempest-VolumeTypesAccessTest-2088049063 None] Lock "cinder-quobyte-acb60abb-d011-4fd2-a8e1-f1221a17069d" released by "delete_volume" :: held 0.850s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:22:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-58cb0cfd-a168-479c-a899-89c2671f7ee1 tempest-GroupSnapshotsTest-1525757492 None] group_snapshot 5647d9f4-660d-4dd0-b66e-c5176f79ef5f: deleting {{(pid=87607) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 16 23:22:02 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-58cb0cfd-a168-479c-a899-89c2671f7ee1 tempest-GroupSnapshotsTest-1525757492 None] Acquiring lock "cinder-quobyte-bc218b88-4b0e-4795-9e7a-02198e194645" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:22:02 devstack cinder-volume[87607]: WARNING cinder.quota [None req-49204c0a-05be-45c4-9c79-52b7972f7d83 tempest-VolumeTypesAccessTest-2088049063 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1027770366 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1027770366, it is now deprecated. Please use the default quota class for default quota. Jul 16 23:22:02 devstack cinder-volume[87607]: WARNING cinder.quota [None req-49204c0a-05be-45c4-9c79-52b7972f7d83 tempest-VolumeTypesAccessTest-2088049063 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1027770366 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1027770366, it is now deprecated. Please use the default quota class for default quota. Jul 16 23:22:02 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-58cb0cfd-a168-479c-a899-89c2671f7ee1 tempest-GroupSnapshotsTest-1525757492 None] Lock "cinder-quobyte-bc218b88-4b0e-4795-9e7a-02198e194645" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:22:02 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-58cb0cfd-a168-479c-a899-89c2671f7ee1 tempest-GroupSnapshotsTest-1525757492 None] Acquiring lock "cinder-quobyte-b0fb29c5-632b-4dee-99b4-7ad9547575a4" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:22:02 devstack sudo[92832]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:02 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-49204c0a-05be-45c4-9c79-52b7972f7d83 tempest-VolumeTypesAccessTest-2088049063 None] Created reservations ['c7d0c199-942b-43ed-ba65-48847d3d22d4', '63535fef-676a-4a77-8080-ca2e3fc146e0', '5d877450-54b1-423b-bcdd-af36c4e8cfcc', '4fcc2a81-403f-4fd8-9086-a6f89be5ea85'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:22:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-de5e3e16-1563-456e-9a0b-ff96d8a31bd5 tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.360s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:02 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-de5e3e16-1563-456e-9a0b-ff96d8a31bd5 tempest-GroupSnapshotsTest-1525757492 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:22:02 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-58cb0cfd-a168-479c-a899-89c2671f7ee1 tempest-GroupSnapshotsTest-1525757492 None] Lock "cinder-quobyte-b0fb29c5-632b-4dee-99b4-7ad9547575a4" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:22:02 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-58cb0cfd-a168-479c-a899-89c2671f7ee1 tempest-GroupSnapshotsTest-1525757492 None] Deleting offline snapshot b0fb29c5-632b-4dee-99b4-7ad9547575a4 of volume bc218b88-4b0e-4795-9e7a-02198e194645 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:22:02 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-58cb0cfd-a168-479c-a899-89c2671f7ee1 tempest-GroupSnapshotsTest-1525757492 None] snapshot_file for this snap is: volume-bc218b88-4b0e-4795-9e7a-02198e194645.b0fb29c5-632b-4dee-99b4-7ad9547575a4 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:22:02 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-de5e3e16-1563-456e-9a0b-ff96d8a31bd5 tempest-GroupSnapshotsTest-1525757492 None] Delete group completed successfully. Jul 16 23:22:02 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20c2096-92df-4942-a3fe-e590b1b4619c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:22:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-58cb0cfd-a168-479c-a899-89c2671f7ee1 tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645.b0fb29c5-632b-4dee-99b4-7ad9547575a4 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-49204c0a-05be-45c4-9c79-52b7972f7d83 tempest-VolumeTypesAccessTest-2088049063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-49204c0a-05be-45c4-9c79-52b7972f7d83 tempest-VolumeTypesAccessTest-2088049063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:02 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-49204c0a-05be-45c4-9c79-52b7972f7d83 tempest-VolumeTypesAccessTest-2088049063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:22:02 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-49204c0a-05be-45c4-9c79-52b7972f7d83 tempest-VolumeTypesAccessTest-2088049063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:22:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-49204c0a-05be-45c4-9c79-52b7972f7d83 tempest-VolumeTypesAccessTest-2088049063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-49204c0a-05be-45c4-9c79-52b7972f7d83 tempest-VolumeTypesAccessTest-2088049063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:02 devstack sudo[92836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645.b0fb29c5-632b-4dee-99b4-7ad9547575a4 Jul 16 23:22:02 devstack sudo[92836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:02 devstack sudo[92838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:22:02 devstack sudo[92838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:02 devstack sudo[92838]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-49204c0a-05be-45c4-9c79-52b7972f7d83 tempest-VolumeTypesAccessTest-2088049063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.311s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:02 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-49204c0a-05be-45c4-9c79-52b7972f7d83 tempest-VolumeTypesAccessTest-2088049063 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:22:02 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-49204c0a-05be-45c4-9c79-52b7972f7d83 tempest-VolumeTypesAccessTest-2088049063 None] Deleted volume successfully. Jul 16 23:22:02 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-49204c0a-05be-45c4-9c79-52b7972f7d83 tempest-VolumeTypesAccessTest-2088049063 None] Lock "cinder-acb60abb-d011-4fd2-a8e1-f1221a17069d-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:22:02 devstack sudo[92836]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-58cb0cfd-a168-479c-a899-89c2671f7ee1 tempest-GroupSnapshotsTest-1525757492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645.b0fb29c5-632b-4dee-99b4-7ad9547575a4" returned: 0 in 0.574s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:02 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-58cb0cfd-a168-479c-a899-89c2671f7ee1 tempest-GroupSnapshotsTest-1525757492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc218b88-4b0e-4795-9e7a-02198e194645(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:22:03 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[909f2aca-b057-4132-b51d-63a5f5459a8a]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:22:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-58cb0cfd-a168-479c-a899-89c2671f7ee1 tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:03 devstack sudo[92849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645 Jul 16 23:22:03 devstack sudo[92849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:03 devstack sudo[92849]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-58cb0cfd-a168-479c-a899-89c2671f7ee1 tempest-GroupSnapshotsTest-1525757492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645" returned: 0 in 0.494s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-58cb0cfd-a168-479c-a899-89c2671f7ee1 tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645.b0fb29c5-632b-4dee-99b4-7ad9547575a4 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:03 devstack sudo[92863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645.b0fb29c5-632b-4dee-99b4-7ad9547575a4 Jul 16 23:22:03 devstack sudo[92863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-cab7c0af-ea1e-432c-a260-66489900ccdc req-b5132f7c-6f15-4958-9365-a913d6a33234 tempest-AttachVolumeTestJSON-886512989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-cab7c0af-ea1e-432c-a260-66489900ccdc req-b5132f7c-6f15-4958-9365-a913d6a33234 tempest-AttachVolumeTestJSON-886512989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-cab7c0af-ea1e-432c-a260-66489900ccdc req-b5132f7c-6f15-4958-9365-a913d6a33234 tempest-AttachVolumeTestJSON-886512989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-cab7c0af-ea1e-432c-a260-66489900ccdc req-b5132f7c-6f15-4958-9365-a913d6a33234 tempest-AttachVolumeTestJSON-886512989 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72', 'name': 'volume-70b02aa0-e8ae-4aaa-bb47-d48c7f3eb9c7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a3ee422f-4980-4211-bb48-df0263be1361', 'enforce_multipath': True} {{(pid=87607) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 23:22:03 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-cab7c0af-ea1e-432c-a260-66489900ccdc req-b5132f7c-6f15-4958-9365-a913d6a33234 tempest-AttachVolumeTestJSON-886512989 None] attachment_update completed successfully. Jul 16 23:22:03 devstack sudo[92863]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-58cb0cfd-a168-479c-a899-89c2671f7ee1 tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645.b0fb29c5-632b-4dee-99b4-7ad9547575a4" returned: 0 in 0.440s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-58cb0cfd-a168-479c-a899-89c2671f7ee1 tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645.b0fb29c5-632b-4dee-99b4-7ad9547575a4 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:03 devstack sudo[92896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645.b0fb29c5-632b-4dee-99b4-7ad9547575a4 Jul 16 23:22:03 devstack sudo[92896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:04 devstack sudo[92896]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-58cb0cfd-a168-479c-a899-89c2671f7ee1 tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645.b0fb29c5-632b-4dee-99b4-7ad9547575a4" returned: 0 in 0.321s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:04 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-58cb0cfd-a168-479c-a899-89c2671f7ee1 tempest-GroupSnapshotsTest-1525757492 None] Lock "cinder-quobyte-b0fb29c5-632b-4dee-99b4-7ad9547575a4" released by "_delete_snapshot" :: held 1.963s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:22:04 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-58cb0cfd-a168-479c-a899-89c2671f7ee1 tempest-GroupSnapshotsTest-1525757492 None] Lock "cinder-quobyte-bc218b88-4b0e-4795-9e7a-02198e194645" released by "delete_snapshot" :: held 2.027s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:22:04 devstack cinder-volume[87607]: WARNING cinder.quota [None req-58cb0cfd-a168-479c-a899-89c2671f7ee1 tempest-GroupSnapshotsTest-1525757492 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-132113537 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-132113537, it is now deprecated. Please use the default quota class for default quota. Jul 16 23:22:04 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-58cb0cfd-a168-479c-a899-89c2671f7ee1 tempest-GroupSnapshotsTest-1525757492 None] Created reservations ['7f78c50c-bf4f-47e6-8c80-b5d785dd854b', 'c565b7e1-fece-4398-bd7b-c5329390f1f7', 'bcc98ddd-7b7f-4ef6-be91-abe24d9dd845', '584ef314-c3dc-4a1f-a407-8fdc6eafc784'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:22:04 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-58cb0cfd-a168-479c-a899-89c2671f7ee1 tempest-GroupSnapshotsTest-1525757492 None] group_snapshot 5647d9f4-660d-4dd0-b66e-c5176f79ef5f: deleted successfully Jul 16 23:22:05 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0da9ef96-2f81-40c4-b066-e21077790d2b tempest-GroupSnapshotsTest-1525757492 None] Acquiring lock "cinder-quobyte-bc218b88-4b0e-4795-9e7a-02198e194645" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:22:05 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0da9ef96-2f81-40c4-b066-e21077790d2b tempest-GroupSnapshotsTest-1525757492 None] Lock "cinder-quobyte-bc218b88-4b0e-4795-9e7a-02198e194645" acquired by "delete_volume" :: waited 0.029s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:22:05 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b794cfc-3c22-4b7c-8f11-0b346d701ceb]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:22:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0da9ef96-2f81-40c4-b066-e21077790d2b tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:05 devstack sudo[93253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645 Jul 16 23:22:05 devstack sudo[93253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:05 devstack sudo[93253]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0da9ef96-2f81-40c4-b066-e21077790d2b tempest-GroupSnapshotsTest-1525757492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645" returned: 0 in 0.457s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0da9ef96-2f81-40c4-b066-e21077790d2b tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:05 devstack sudo[93259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645 Jul 16 23:22:05 devstack sudo[93259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:05 devstack sudo[93259]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0da9ef96-2f81-40c4-b066-e21077790d2b tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bc218b88-4b0e-4795-9e7a-02198e194645" returned: 0 in 0.325s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:05 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0da9ef96-2f81-40c4-b066-e21077790d2b tempest-GroupSnapshotsTest-1525757492 None] Lock "cinder-quobyte-bc218b88-4b0e-4795-9e7a-02198e194645" released by "delete_volume" :: held 0.896s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:22:06 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-0da9ef96-2f81-40c4-b066-e21077790d2b tempest-GroupSnapshotsTest-1525757492 None] Created reservations ['c38a5ef1-e335-4991-9fed-50d7d119ed42'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:22:06 devstack cinder-volume[87607]: WARNING cinder.db.api [None req-0da9ef96-2f81-40c4-b066-e21077790d2b tempest-GroupSnapshotsTest-1525757492 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-132113537'] Jul 16 23:22:06 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-0da9ef96-2f81-40c4-b066-e21077790d2b tempest-GroupSnapshotsTest-1525757492 None] Created reservations ['0c2619f4-2878-4e1f-b842-e21caebbb3a1', 'cd125830-7574-4ea3-a581-f3387bddc07f', '52541e74-cb87-4ab5-a12c-2f395e44db35', 'b4aa026f-7396-45e9-9a54-5b53ed019610'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:22:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0da9ef96-2f81-40c4-b066-e21077790d2b tempest-GroupSnapshotsTest-1525757492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0da9ef96-2f81-40c4-b066-e21077790d2b tempest-GroupSnapshotsTest-1525757492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0da9ef96-2f81-40c4-b066-e21077790d2b tempest-GroupSnapshotsTest-1525757492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:22:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0da9ef96-2f81-40c4-b066-e21077790d2b tempest-GroupSnapshotsTest-1525757492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:22:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0da9ef96-2f81-40c4-b066-e21077790d2b tempest-GroupSnapshotsTest-1525757492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0da9ef96-2f81-40c4-b066-e21077790d2b tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:06 devstack sudo[93269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:22:06 devstack sudo[93269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:06 devstack sudo[93269]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0da9ef96-2f81-40c4-b066-e21077790d2b tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.389s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:06 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-0da9ef96-2f81-40c4-b066-e21077790d2b tempest-GroupSnapshotsTest-1525757492 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:22:06 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-0da9ef96-2f81-40c4-b066-e21077790d2b tempest-GroupSnapshotsTest-1525757492 None] Delete group completed successfully. Jul 16 23:22:06 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-3966ac99-0dfb-49c2-84fa-a8dd7ef4e45f tempest-GroupSnapshotsTest-1525757492 None] Group tempest-GroupSnapshotsTest-Group-389956089: creating Jul 16 23:22:06 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-3966ac99-0dfb-49c2-84fa-a8dd7ef4e45f tempest-GroupSnapshotsTest-1525757492 None] Group tempest-GroupSnapshotsTest-Group-389956089: created successfully Jul 16 23:22:06 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-3966ac99-0dfb-49c2-84fa-a8dd7ef4e45f tempest-GroupSnapshotsTest-1525757492 None] Create group completed successfully. Jul 16 23:22:08 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e5696dd-af98-4fd7-a853-9107018ca103 tempest-GroupSnapshotsTest-1525757492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:22:08 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0e5696dd-af98-4fd7-a853-9107018ca103 tempest-GroupSnapshotsTest-1525757492 None] Flow 'volume_create_manager' (4b23a5db-da5b-4592-965e-4ac36ecd8ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:22:08 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0e5696dd-af98-4fd7-a853-9107018ca103 tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4eae8a7-6cb1-4b3b-8c47-936f95498a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:08 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0e5696dd-af98-4fd7-a853-9107018ca103 tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4eae8a7-6cb1-4b3b-8c47-936f95498a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1775688599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9504ca2f-f1c3-4ce8-a3ed-0004367e9557,host='devstack@QuobyteHD#QuobyteHD',id=636be79e-f7d9-4fb0-9592-3124f5f876e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dacfebbcb3a247b1a41b9e9e4edcd5d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:22:09Z,use_quota=True,user_id='29ffcc3ab5d0440aa66c49821dd86cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ce4accb-c082-403e-934d-cb47a03c7934),volume_type_id=2ce4accb-c082-403e-934d-cb47a03c7934)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:08 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0e5696dd-af98-4fd7-a853-9107018ca103 tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9a9ac4c-06ee-4dae-970e-30a31cc1b8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:08 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0e5696dd-af98-4fd7-a853-9107018ca103 tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9a9ac4c-06ee-4dae-970e-30a31cc1b8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:08 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0e5696dd-af98-4fd7-a853-9107018ca103 tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3733fef9-5860-454e-b840-a8688ddefcca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:08 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0e5696dd-af98-4fd7-a853-9107018ca103 tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3733fef9-5860-454e-b840-a8688ddefcca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '636be79e-f7d9-4fb0-9592-3124f5f876e2', 'volume_name': 'volume-636be79e-f7d9-4fb0-9592-3124f5f876e2', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:08 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0e5696dd-af98-4fd7-a853-9107018ca103 tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50e0d3c4-adc9-4473-ab24-ce766c6dab26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:08 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0e5696dd-af98-4fd7-a853-9107018ca103 tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50e0d3c4-adc9-4473-ab24-ce766c6dab26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:08 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0e5696dd-af98-4fd7-a853-9107018ca103 tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7384314-2b74-410c-bf31-abba61d95b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:08 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-0e5696dd-af98-4fd7-a853-9107018ca103 tempest-GroupSnapshotsTest-1525757492 None] Volume 636be79e-f7d9-4fb0-9592-3124f5f876e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-636be79e-f7d9-4fb0-9592-3124f5f876e2', 'volume_size': 1} Jul 16 23:22:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0e5696dd-af98-4fd7-a853-9107018ca103 tempest-GroupSnapshotsTest-1525757492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0e5696dd-af98-4fd7-a853-9107018ca103 tempest-GroupSnapshotsTest-1525757492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:08 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0e5696dd-af98-4fd7-a853-9107018ca103 tempest-GroupSnapshotsTest-1525757492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9504ca2f-f1c3-4ce8-a3ed-0004367e9557,created_at=2026-07-16T21:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1775688599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9504ca2f-f1c3-4ce8-a3ed-0004367e9557,host='devstack@QuobyteHD#QuobyteHD',id=636be79e-f7d9-4fb0-9592-3124f5f876e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dacfebbcb3a247b1a41b9e9e4edcd5d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:22:09Z,use_quota=True,user_id='29ffcc3ab5d0440aa66c49821dd86cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ce4accb-c082-403e-934d-cb47a03c7934),volume_type_id=2ce4accb-c082-403e-934d-cb47a03c7934)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:22:08 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-0e5696dd-af98-4fd7-a853-9107018ca103 tempest-GroupSnapshotsTest-1525757492 None] Creating volume 636be79e-f7d9-4fb0-9592-3124f5f876e2 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:22:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0e5696dd-af98-4fd7-a853-9107018ca103 tempest-GroupSnapshotsTest-1525757492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0e5696dd-af98-4fd7-a853-9107018ca103 tempest-GroupSnapshotsTest-1525757492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:08 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0e5696dd-af98-4fd7-a853-9107018ca103 tempest-GroupSnapshotsTest-1525757492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:22:08 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0e5696dd-af98-4fd7-a853-9107018ca103 tempest-GroupSnapshotsTest-1525757492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:22:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0e5696dd-af98-4fd7-a853-9107018ca103 tempest-GroupSnapshotsTest-1525757492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:08 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0e5696dd-af98-4fd7-a853-9107018ca103 tempest-GroupSnapshotsTest-1525757492 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:22:08 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-0e5696dd-af98-4fd7-a853-9107018ca103 tempest-GroupSnapshotsTest-1525757492 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:22:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0e5696dd-af98-4fd7-a853-9107018ca103 tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:08 devstack sudo[93274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2 1073741824 Jul 16 23:22:08 devstack sudo[93274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:09 devstack sudo[93274]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0e5696dd-af98-4fd7-a853-9107018ca103 tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2 1073741824" returned: 0 in 0.545s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0e5696dd-af98-4fd7-a853-9107018ca103 tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:09 devstack sudo[93280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2 Jul 16 23:22:09 devstack sudo[93280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:09 devstack sudo[93280]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0e5696dd-af98-4fd7-a853-9107018ca103 tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2" returned: 0 in 0.280s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:09 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0e5696dd-af98-4fd7-a853-9107018ca103 tempest-GroupSnapshotsTest-1525757492 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:22:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0e5696dd-af98-4fd7-a853-9107018ca103 tempest-GroupSnapshotsTest-1525757492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:09 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0e5696dd-af98-4fd7-a853-9107018ca103 tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7384314-2b74-410c-bf31-abba61d95b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-636be79e-f7d9-4fb0-9592-3124f5f876e2', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:09 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0e5696dd-af98-4fd7-a853-9107018ca103 tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f58f44c-c460-44b0-9838-c280c3161c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:09 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-0e5696dd-af98-4fd7-a853-9107018ca103 tempest-GroupSnapshotsTest-1525757492 None] Volume volume-636be79e-f7d9-4fb0-9592-3124f5f876e2 (636be79e-f7d9-4fb0-9592-3124f5f876e2): created successfully Jul 16 23:22:09 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0e5696dd-af98-4fd7-a853-9107018ca103 tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f58f44c-c460-44b0-9838-c280c3161c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:09 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0e5696dd-af98-4fd7-a853-9107018ca103 tempest-GroupSnapshotsTest-1525757492 None] Flow 'volume_create_manager' (4b23a5db-da5b-4592-965e-4ac36ecd8ebd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:22:09 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-0e5696dd-af98-4fd7-a853-9107018ca103 tempest-GroupSnapshotsTest-1525757492 None] Created volume successfully. Jul 16 23:22:10 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bd6e4ee-e103-42ed-8e2c-88d2e07745e8 tempest-GroupSnapshotsTest-1525757492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:22:11 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7bd6e4ee-e103-42ed-8e2c-88d2e07745e8 tempest-GroupSnapshotsTest-1525757492 None] Flow 'volume_create_manager' (fa274885-f694-4d8f-962d-fa0df04962f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:22:11 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7bd6e4ee-e103-42ed-8e2c-88d2e07745e8 tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db0f392-1d51-4848-8345-ad497d6e3265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:11 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7bd6e4ee-e103-42ed-8e2c-88d2e07745e8 tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db0f392-1d51-4848-8345-ad497d6e3265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1520248558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9504ca2f-f1c3-4ce8-a3ed-0004367e9557,host='devstack@QuobyteHD#QuobyteHD',id=661af809-137a-4d27-9b9a-9cf63063dbe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dacfebbcb3a247b1a41b9e9e4edcd5d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:22:11Z,use_quota=True,user_id='29ffcc3ab5d0440aa66c49821dd86cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ce4accb-c082-403e-934d-cb47a03c7934),volume_type_id=2ce4accb-c082-403e-934d-cb47a03c7934)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:11 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7bd6e4ee-e103-42ed-8e2c-88d2e07745e8 tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e82c70c-3675-4a53-a22a-6bbda6071fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:11 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7bd6e4ee-e103-42ed-8e2c-88d2e07745e8 tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e82c70c-3675-4a53-a22a-6bbda6071fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:11 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7bd6e4ee-e103-42ed-8e2c-88d2e07745e8 tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfc5979f-d6d3-4b3c-a0d7-9ba27542e83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:11 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7bd6e4ee-e103-42ed-8e2c-88d2e07745e8 tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfc5979f-d6d3-4b3c-a0d7-9ba27542e83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '661af809-137a-4d27-9b9a-9cf63063dbe9', 'volume_name': 'volume-661af809-137a-4d27-9b9a-9cf63063dbe9', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:11 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7bd6e4ee-e103-42ed-8e2c-88d2e07745e8 tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afbdf594-1d86-415b-a8b4-24cd0c05bca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:11 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7bd6e4ee-e103-42ed-8e2c-88d2e07745e8 tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afbdf594-1d86-415b-a8b4-24cd0c05bca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:11 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7bd6e4ee-e103-42ed-8e2c-88d2e07745e8 tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c2eb389-39c4-419d-94f5-d2e5ae31bd21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:11 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-7bd6e4ee-e103-42ed-8e2c-88d2e07745e8 tempest-GroupSnapshotsTest-1525757492 None] Volume 661af809-137a-4d27-9b9a-9cf63063dbe9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-661af809-137a-4d27-9b9a-9cf63063dbe9', 'volume_size': 1} Jul 16 23:22:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7bd6e4ee-e103-42ed-8e2c-88d2e07745e8 tempest-GroupSnapshotsTest-1525757492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7bd6e4ee-e103-42ed-8e2c-88d2e07745e8 tempest-GroupSnapshotsTest-1525757492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:11 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-7bd6e4ee-e103-42ed-8e2c-88d2e07745e8 tempest-GroupSnapshotsTest-1525757492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9504ca2f-f1c3-4ce8-a3ed-0004367e9557,created_at=2026-07-16T21:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1520248558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9504ca2f-f1c3-4ce8-a3ed-0004367e9557,host='devstack@QuobyteHD#QuobyteHD',id=661af809-137a-4d27-9b9a-9cf63063dbe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dacfebbcb3a247b1a41b9e9e4edcd5d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:22:11Z,use_quota=True,user_id='29ffcc3ab5d0440aa66c49821dd86cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ce4accb-c082-403e-934d-cb47a03c7934),volume_type_id=2ce4accb-c082-403e-934d-cb47a03c7934)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:22:11 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-7bd6e4ee-e103-42ed-8e2c-88d2e07745e8 tempest-GroupSnapshotsTest-1525757492 None] Creating volume 661af809-137a-4d27-9b9a-9cf63063dbe9 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:22:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7bd6e4ee-e103-42ed-8e2c-88d2e07745e8 tempest-GroupSnapshotsTest-1525757492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7bd6e4ee-e103-42ed-8e2c-88d2e07745e8 tempest-GroupSnapshotsTest-1525757492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:11 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-7bd6e4ee-e103-42ed-8e2c-88d2e07745e8 tempest-GroupSnapshotsTest-1525757492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:22:11 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-7bd6e4ee-e103-42ed-8e2c-88d2e07745e8 tempest-GroupSnapshotsTest-1525757492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:22:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7bd6e4ee-e103-42ed-8e2c-88d2e07745e8 tempest-GroupSnapshotsTest-1525757492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:11 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-7bd6e4ee-e103-42ed-8e2c-88d2e07745e8 tempest-GroupSnapshotsTest-1525757492 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:22:11 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-7bd6e4ee-e103-42ed-8e2c-88d2e07745e8 tempest-GroupSnapshotsTest-1525757492 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:22:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7bd6e4ee-e103-42ed-8e2c-88d2e07745e8 tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:11 devstack sudo[93283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9 1073741824 Jul 16 23:22:11 devstack sudo[93283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:11 devstack sudo[93283]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7bd6e4ee-e103-42ed-8e2c-88d2e07745e8 tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9 1073741824" returned: 0 in 0.860s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7bd6e4ee-e103-42ed-8e2c-88d2e07745e8 tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:12 devstack sudo[93395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9 Jul 16 23:22:12 devstack sudo[93395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:12 devstack sudo[93395]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7bd6e4ee-e103-42ed-8e2c-88d2e07745e8 tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9" returned: 0 in 0.368s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:12 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-7bd6e4ee-e103-42ed-8e2c-88d2e07745e8 tempest-GroupSnapshotsTest-1525757492 None] <== create_volume: return (1323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:22:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7bd6e4ee-e103-42ed-8e2c-88d2e07745e8 tempest-GroupSnapshotsTest-1525757492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.325s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:12 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7bd6e4ee-e103-42ed-8e2c-88d2e07745e8 tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c2eb389-39c4-419d-94f5-d2e5ae31bd21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-661af809-137a-4d27-9b9a-9cf63063dbe9', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:12 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7bd6e4ee-e103-42ed-8e2c-88d2e07745e8 tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2548aa28-7041-43c6-b36d-ba8f1c2e6e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:12 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-7bd6e4ee-e103-42ed-8e2c-88d2e07745e8 tempest-GroupSnapshotsTest-1525757492 None] Volume volume-661af809-137a-4d27-9b9a-9cf63063dbe9 (661af809-137a-4d27-9b9a-9cf63063dbe9): created successfully Jul 16 23:22:12 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7bd6e4ee-e103-42ed-8e2c-88d2e07745e8 tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2548aa28-7041-43c6-b36d-ba8f1c2e6e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:12 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7bd6e4ee-e103-42ed-8e2c-88d2e07745e8 tempest-GroupSnapshotsTest-1525757492 None] Flow 'volume_create_manager' (fa274885-f694-4d8f-962d-fa0df04962f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:22:12 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-7bd6e4ee-e103-42ed-8e2c-88d2e07745e8 tempest-GroupSnapshotsTest-1525757492 None] Created volume successfully. Jul 16 23:22:13 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-99bf093e-ea62-4d58-9282-c161b073cc2e tempest-GroupSnapshotsTest-1525757492 None] Update group completed successfully. Jul 16 23:22:15 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-1d60f5f8-057d-4f6f-bfeb-2f6235bd57b3 tempest-GroupSnapshotsTest-1525757492 None] Update group completed successfully. Jul 16 23:22:16 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-2a22ae07-40ee-4d81-bcd7-ee2184b5ae2c tempest-GroupSnapshotsTest-1525757492 None] Update group completed successfully. Jul 16 23:22:18 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-7d5cc0e8-5b6f-4660-b258-1dc37ff76db5 tempest-GroupSnapshotsTest-1525757492 None] Update group completed successfully. Jul 16 23:22:19 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-bfdacbb8-028e-4091-962f-a828306b45cd tempest-GroupSnapshotsTest-1525757492 None] GroupSnapshot bf67b553-ce3c-43b7-8154-4504afe64993: creating. Jul 16 23:22:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bfdacbb8-028e-4091-962f-a828306b45cd tempest-GroupSnapshotsTest-1525757492 None] Group snapshot bf67b553-ce3c-43b7-8154-4504afe64993: creating. {{(pid=87607) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 16 23:22:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bfdacbb8-028e-4091-962f-a828306b45cd tempest-GroupSnapshotsTest-1525757492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bfdacbb8-028e-4091-962f-a828306b45cd tempest-GroupSnapshotsTest-1525757492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:19 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-bfdacbb8-028e-4091-962f-a828306b45cd tempest-GroupSnapshotsTest-1525757492 None] Creating offline snapshot 96a1fe41-4608-4e14-a7ed-05bd01a4a893 of volume 661af809-137a-4d27-9b9a-9cf63063dbe9 {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:22:19 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[878a6cc2-5ba6-429f-ad1c-509a0dc2595d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:22:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bfdacbb8-028e-4091-962f-a828306b45cd tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:20 devstack sudo[93815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9 Jul 16 23:22:20 devstack sudo[93815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:20 devstack sudo[93815]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bfdacbb8-028e-4091-962f-a828306b45cd tempest-GroupSnapshotsTest-1525757492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9" returned: 0 in 0.471s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bfdacbb8-028e-4091-962f-a828306b45cd tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9.96a1fe41-4608-4e14-a7ed-05bd01a4a893 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:20 devstack sudo[93821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9.96a1fe41-4608-4e14-a7ed-05bd01a4a893 1G Jul 16 23:22:20 devstack sudo[93821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:21 devstack sudo[93821]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bfdacbb8-028e-4091-962f-a828306b45cd tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9.96a1fe41-4608-4e14-a7ed-05bd01a4a893 1G" returned: 0 in 0.657s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bfdacbb8-028e-4091-962f-a828306b45cd tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-661af809-137a-4d27-9b9a-9cf63063dbe9 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9.96a1fe41-4608-4e14-a7ed-05bd01a4a893 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:21 devstack sudo[93828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-661af809-137a-4d27-9b9a-9cf63063dbe9 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9.96a1fe41-4608-4e14-a7ed-05bd01a4a893 Jul 16 23:22:21 devstack sudo[93828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:21 devstack sudo[93828]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bfdacbb8-028e-4091-962f-a828306b45cd tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-661af809-137a-4d27-9b9a-9cf63063dbe9 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9.96a1fe41-4608-4e14-a7ed-05bd01a4a893" returned: 0 in 0.485s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:21 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-bfdacbb8-028e-4091-962f-a828306b45cd tempest-GroupSnapshotsTest-1525757492 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9.96a1fe41-4608-4e14-a7ed-05bd01a4a893 is being set with open permissions: ugo+rw: NotImplementedError Jul 16 23:22:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bfdacbb8-028e-4091-962f-a828306b45cd tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9.96a1fe41-4608-4e14-a7ed-05bd01a4a893 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:21 devstack sudo[93834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9.96a1fe41-4608-4e14-a7ed-05bd01a4a893 Jul 16 23:22:21 devstack sudo[93834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bfdacbb8-028e-4091-962f-a828306b45cd tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9.96a1fe41-4608-4e14-a7ed-05bd01a4a893" returned: 0 in 0.280s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:21 devstack sudo[93834]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bfdacbb8-028e-4091-962f-a828306b45cd tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:21 devstack sudo[93837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9.info Jul 16 23:22:21 devstack sudo[93837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:22 devstack sudo[93837]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bfdacbb8-028e-4091-962f-a828306b45cd tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9.info" returned: 0 in 0.630s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:22 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-bfdacbb8-028e-4091-962f-a828306b45cd tempest-GroupSnapshotsTest-1525757492 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9.info is being set with open permissions: ugo+rw: NotImplementedError Jul 16 23:22:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bfdacbb8-028e-4091-962f-a828306b45cd tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:22 devstack sudo[93879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9.info Jul 16 23:22:22 devstack sudo[93879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:23 devstack sudo[93879]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bfdacbb8-028e-4091-962f-a828306b45cd tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9.info" returned: 0 in 0.628s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bfdacbb8-028e-4091-962f-a828306b45cd tempest-GroupSnapshotsTest-1525757492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.310s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bfdacbb8-028e-4091-962f-a828306b45cd tempest-GroupSnapshotsTest-1525757492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bfdacbb8-028e-4091-962f-a828306b45cd tempest-GroupSnapshotsTest-1525757492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:23 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-bfdacbb8-028e-4091-962f-a828306b45cd tempest-GroupSnapshotsTest-1525757492 None] Creating offline snapshot bbf8cb45-3436-43b5-9c72-68eba7e5ddb5 of volume 636be79e-f7d9-4fb0-9592-3124f5f876e2 {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:22:23 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[860f19c4-a795-4750-9240-55c13e8bce0e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:22:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bfdacbb8-028e-4091-962f-a828306b45cd tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:23 devstack sudo[93908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2 Jul 16 23:22:23 devstack sudo[93908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:23 devstack sudo[93908]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bfdacbb8-028e-4091-962f-a828306b45cd tempest-GroupSnapshotsTest-1525757492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2" returned: 0 in 0.553s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bfdacbb8-028e-4091-962f-a828306b45cd tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2.bbf8cb45-3436-43b5-9c72-68eba7e5ddb5 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:24 devstack sudo[93920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2.bbf8cb45-3436-43b5-9c72-68eba7e5ddb5 1G Jul 16 23:22:24 devstack sudo[93920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:24 devstack sudo[93920]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bfdacbb8-028e-4091-962f-a828306b45cd tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2.bbf8cb45-3436-43b5-9c72-68eba7e5ddb5 1G" returned: 0 in 0.657s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bfdacbb8-028e-4091-962f-a828306b45cd tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-636be79e-f7d9-4fb0-9592-3124f5f876e2 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2.bbf8cb45-3436-43b5-9c72-68eba7e5ddb5 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:24 devstack sudo[93926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-636be79e-f7d9-4fb0-9592-3124f5f876e2 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2.bbf8cb45-3436-43b5-9c72-68eba7e5ddb5 Jul 16 23:22:24 devstack sudo[93926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:25 devstack sudo[93926]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bfdacbb8-028e-4091-962f-a828306b45cd tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-636be79e-f7d9-4fb0-9592-3124f5f876e2 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2.bbf8cb45-3436-43b5-9c72-68eba7e5ddb5" returned: 0 in 0.520s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:25 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-bfdacbb8-028e-4091-962f-a828306b45cd tempest-GroupSnapshotsTest-1525757492 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2.bbf8cb45-3436-43b5-9c72-68eba7e5ddb5 is being set with open permissions: ugo+rw: NotImplementedError Jul 16 23:22:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bfdacbb8-028e-4091-962f-a828306b45cd tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2.bbf8cb45-3436-43b5-9c72-68eba7e5ddb5 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:25 devstack sudo[93932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2.bbf8cb45-3436-43b5-9c72-68eba7e5ddb5 Jul 16 23:22:25 devstack sudo[93932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:25 devstack sudo[93932]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bfdacbb8-028e-4091-962f-a828306b45cd tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2.bbf8cb45-3436-43b5-9c72-68eba7e5ddb5" returned: 0 in 0.406s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bfdacbb8-028e-4091-962f-a828306b45cd tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:25 devstack sudo[93935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2.info Jul 16 23:22:25 devstack sudo[93935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:26 devstack sudo[93935]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bfdacbb8-028e-4091-962f-a828306b45cd tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2.info" returned: 0 in 0.456s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:26 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-bfdacbb8-028e-4091-962f-a828306b45cd tempest-GroupSnapshotsTest-1525757492 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2.info is being set with open permissions: ugo+rw: NotImplementedError Jul 16 23:22:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bfdacbb8-028e-4091-962f-a828306b45cd tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:26 devstack sudo[93938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2.info Jul 16 23:22:26 devstack sudo[93938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:26 devstack sudo[93938]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bfdacbb8-028e-4091-962f-a828306b45cd tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2.info" returned: 0 in 0.543s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bfdacbb8-028e-4091-962f-a828306b45cd tempest-GroupSnapshotsTest-1525757492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.404s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:26 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-bfdacbb8-028e-4091-962f-a828306b45cd tempest-GroupSnapshotsTest-1525757492 None] group_snapshot bf67b553-ce3c-43b7-8154-4504afe64993: created successfully Jul 16 23:22:27 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-73e04124-e2cc-4013-9d1b-95a60e90b75f tempest-VolumesActionsTest-945510952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:22:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-73e04124-e2cc-4013-9d1b-95a60e90b75f tempest-VolumesActionsTest-945510952 None] Flow 'volume_create_manager' (73c8c349-bab1-4c56-805d-477046dc34e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:22:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-73e04124-e2cc-4013-9d1b-95a60e90b75f tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27b521e2-64aa-4252-b61b-e31d8c1f4762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-73e04124-e2cc-4013-9d1b-95a60e90b75f tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27b521e2-64aa-4252-b61b-e31d8c1f4762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-338961956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd815cf7-9e31-4150-b13f-7d2d539bc2be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b6831797d7e401cb13e3160cc927031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:22:27Z,use_quota=True,user_id='09da365af4e94489a1407a040f05c1c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-73e04124-e2cc-4013-9d1b-95a60e90b75f tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec2c56e0-dd98-4544-9cd8-93c731c0ec4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-73e04124-e2cc-4013-9d1b-95a60e90b75f tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec2c56e0-dd98-4544-9cd8-93c731c0ec4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-73e04124-e2cc-4013-9d1b-95a60e90b75f tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ca51b5d-2771-448b-aa4f-2ac4c9f34dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-73e04124-e2cc-4013-9d1b-95a60e90b75f tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ca51b5d-2771-448b-aa4f-2ac4c9f34dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd815cf7-9e31-4150-b13f-7d2d539bc2be', 'volume_name': 'volume-cd815cf7-9e31-4150-b13f-7d2d539bc2be', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-73e04124-e2cc-4013-9d1b-95a60e90b75f tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ca2d0cd-fe94-422b-adbd-3b9411694414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-73e04124-e2cc-4013-9d1b-95a60e90b75f tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ca2d0cd-fe94-422b-adbd-3b9411694414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-73e04124-e2cc-4013-9d1b-95a60e90b75f tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (345bfd8c-010f-4b3b-8e05-bb99cededee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:27 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-73e04124-e2cc-4013-9d1b-95a60e90b75f tempest-VolumesActionsTest-945510952 None] Volume cd815cf7-9e31-4150-b13f-7d2d539bc2be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd815cf7-9e31-4150-b13f-7d2d539bc2be', 'volume_size': 1} Jul 16 23:22:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-73e04124-e2cc-4013-9d1b-95a60e90b75f tempest-VolumesActionsTest-945510952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-73e04124-e2cc-4013-9d1b-95a60e90b75f tempest-VolumesActionsTest-945510952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:27 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-73e04124-e2cc-4013-9d1b-95a60e90b75f tempest-VolumesActionsTest-945510952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-338961956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd815cf7-9e31-4150-b13f-7d2d539bc2be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b6831797d7e401cb13e3160cc927031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:22:27Z,use_quota=True,user_id='09da365af4e94489a1407a040f05c1c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:22:27 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-73e04124-e2cc-4013-9d1b-95a60e90b75f tempest-VolumesActionsTest-945510952 None] Creating volume cd815cf7-9e31-4150-b13f-7d2d539bc2be {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:22:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-73e04124-e2cc-4013-9d1b-95a60e90b75f tempest-VolumesActionsTest-945510952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-73e04124-e2cc-4013-9d1b-95a60e90b75f tempest-VolumesActionsTest-945510952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:27 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-73e04124-e2cc-4013-9d1b-95a60e90b75f tempest-VolumesActionsTest-945510952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:22:27 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-73e04124-e2cc-4013-9d1b-95a60e90b75f tempest-VolumesActionsTest-945510952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:22:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-73e04124-e2cc-4013-9d1b-95a60e90b75f tempest-VolumesActionsTest-945510952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:27 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-73e04124-e2cc-4013-9d1b-95a60e90b75f tempest-VolumesActionsTest-945510952 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:22:27 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-73e04124-e2cc-4013-9d1b-95a60e90b75f tempest-VolumesActionsTest-945510952 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:22:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-73e04124-e2cc-4013-9d1b-95a60e90b75f tempest-VolumesActionsTest-945510952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cd815cf7-9e31-4150-b13f-7d2d539bc2be 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:27 devstack sudo[93941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cd815cf7-9e31-4150-b13f-7d2d539bc2be 1073741824 Jul 16 23:22:27 devstack sudo[93941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:27 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-66e711e6-73b8-4e67-8155-fe0948d6b868 tempest-GroupSnapshotsTest-1525757492 None] group_snapshot bf67b553-ce3c-43b7-8154-4504afe64993: deleting Jul 16 23:22:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-66e711e6-73b8-4e67-8155-fe0948d6b868 tempest-GroupSnapshotsTest-1525757492 None] group_snapshot bf67b553-ce3c-43b7-8154-4504afe64993: deleting {{(pid=87607) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 16 23:22:27 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-66e711e6-73b8-4e67-8155-fe0948d6b868 tempest-GroupSnapshotsTest-1525757492 None] Acquiring lock "cinder-quobyte-661af809-137a-4d27-9b9a-9cf63063dbe9" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:22:27 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-66e711e6-73b8-4e67-8155-fe0948d6b868 tempest-GroupSnapshotsTest-1525757492 None] Lock "cinder-quobyte-661af809-137a-4d27-9b9a-9cf63063dbe9" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:22:27 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-66e711e6-73b8-4e67-8155-fe0948d6b868 tempest-GroupSnapshotsTest-1525757492 None] Acquiring lock "cinder-quobyte-96a1fe41-4608-4e14-a7ed-05bd01a4a893" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:22:27 devstack sudo[93941]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:27 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-66e711e6-73b8-4e67-8155-fe0948d6b868 tempest-GroupSnapshotsTest-1525757492 None] Lock "cinder-quobyte-96a1fe41-4608-4e14-a7ed-05bd01a4a893" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:22:28 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-66e711e6-73b8-4e67-8155-fe0948d6b868 tempest-GroupSnapshotsTest-1525757492 None] Deleting offline snapshot 96a1fe41-4608-4e14-a7ed-05bd01a4a893 of volume 661af809-137a-4d27-9b9a-9cf63063dbe9 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:22:28 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-66e711e6-73b8-4e67-8155-fe0948d6b868 tempest-GroupSnapshotsTest-1525757492 None] snapshot_file for this snap is: volume-661af809-137a-4d27-9b9a-9cf63063dbe9.96a1fe41-4608-4e14-a7ed-05bd01a4a893 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:22:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-73e04124-e2cc-4013-9d1b-95a60e90b75f tempest-VolumesActionsTest-945510952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cd815cf7-9e31-4150-b13f-7d2d539bc2be 1073741824" returned: 0 in 0.841s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:28 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedea5ea-8b85-4e4c-a985-955bd2095fb0]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:22:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-66e711e6-73b8-4e67-8155-fe0948d6b868 tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9.96a1fe41-4608-4e14-a7ed-05bd01a4a893 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-73e04124-e2cc-4013-9d1b-95a60e90b75f tempest-VolumesActionsTest-945510952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cd815cf7-9e31-4150-b13f-7d2d539bc2be {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:28 devstack sudo[93947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cd815cf7-9e31-4150-b13f-7d2d539bc2be Jul 16 23:22:28 devstack sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:28 devstack sudo[93946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9.96a1fe41-4608-4e14-a7ed-05bd01a4a893 Jul 16 23:22:28 devstack sudo[93946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:28 devstack sudo[93946]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-66e711e6-73b8-4e67-8155-fe0948d6b868 tempest-GroupSnapshotsTest-1525757492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9.96a1fe41-4608-4e14-a7ed-05bd01a4a893" returned: 0 in 0.554s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:28 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-66e711e6-73b8-4e67-8155-fe0948d6b868 tempest-GroupSnapshotsTest-1525757492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-661af809-137a-4d27-9b9a-9cf63063dbe9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:22:28 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f88c17f-fffb-4c8e-a10d-345e79b02eb4]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:22:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-66e711e6-73b8-4e67-8155-fe0948d6b868 tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:28 devstack sudo[93947]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-73e04124-e2cc-4013-9d1b-95a60e90b75f tempest-VolumesActionsTest-945510952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cd815cf7-9e31-4150-b13f-7d2d539bc2be" returned: 0 in 0.582s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:28 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-73e04124-e2cc-4013-9d1b-95a60e90b75f tempest-VolumesActionsTest-945510952 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:22:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-73e04124-e2cc-4013-9d1b-95a60e90b75f tempest-VolumesActionsTest-945510952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:28 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-73e04124-e2cc-4013-9d1b-95a60e90b75f tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (345bfd8c-010f-4b3b-8e05-bb99cededee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd815cf7-9e31-4150-b13f-7d2d539bc2be', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:28 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-73e04124-e2cc-4013-9d1b-95a60e90b75f tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24033f6b-3d2f-4171-984c-c680093940b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:28 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-73e04124-e2cc-4013-9d1b-95a60e90b75f tempest-VolumesActionsTest-945510952 None] Volume volume-cd815cf7-9e31-4150-b13f-7d2d539bc2be (cd815cf7-9e31-4150-b13f-7d2d539bc2be): created successfully Jul 16 23:22:28 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-73e04124-e2cc-4013-9d1b-95a60e90b75f tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24033f6b-3d2f-4171-984c-c680093940b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:28 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-73e04124-e2cc-4013-9d1b-95a60e90b75f tempest-VolumesActionsTest-945510952 None] Flow 'volume_create_manager' (73c8c349-bab1-4c56-805d-477046dc34e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:22:28 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-73e04124-e2cc-4013-9d1b-95a60e90b75f tempest-VolumesActionsTest-945510952 None] Created volume successfully. Jul 16 23:22:28 devstack sudo[93975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9 Jul 16 23:22:28 devstack sudo[93975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:29 devstack sudo[93975]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-66e711e6-73b8-4e67-8155-fe0948d6b868 tempest-GroupSnapshotsTest-1525757492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9" returned: 0 in 0.470s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-66e711e6-73b8-4e67-8155-fe0948d6b868 tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9.96a1fe41-4608-4e14-a7ed-05bd01a4a893 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:29 devstack sudo[93980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9.96a1fe41-4608-4e14-a7ed-05bd01a4a893 Jul 16 23:22:29 devstack sudo[93980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:29 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-02276a91-8574-4474-ae3c-a2e69cbbf374 tempest-VolumesActionsTest-945510952 None] Acquiring lock "cinder-cd815cf7-9e31-4150-b13f-7d2d539bc2be" by "attach_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:22:29 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-02276a91-8574-4474-ae3c-a2e69cbbf374 tempest-VolumesActionsTest-945510952 None] Lock "cinder-cd815cf7-9e31-4150-b13f-7d2d539bc2be" acquired by "attach_volume" :: waited 0.035s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:22:29 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-02276a91-8574-4474-ae3c-a2e69cbbf374 tempest-VolumesActionsTest-945510952 None] Attaching volume cd815cf7-9e31-4150-b13f-7d2d539bc2be to instance 9a21af8c-7921-43bb-b851-cacd5f2f1c5f at mountpoint /dev/vdb on host None. Jul 16 23:22:29 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-02276a91-8574-4474-ae3c-a2e69cbbf374 tempest-VolumesActionsTest-945510952 None] Attach volume completed successfully. Jul 16 23:22:29 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-02276a91-8574-4474-ae3c-a2e69cbbf374 tempest-VolumesActionsTest-945510952 None] Lock "cinder-cd815cf7-9e31-4150-b13f-7d2d539bc2be" released by "attach_volume" :: held 0.146s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:22:29 devstack sudo[93980]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-66e711e6-73b8-4e67-8155-fe0948d6b868 tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9.96a1fe41-4608-4e14-a7ed-05bd01a4a893" returned: 0 in 0.622s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-66e711e6-73b8-4e67-8155-fe0948d6b868 tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9.96a1fe41-4608-4e14-a7ed-05bd01a4a893 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:29 devstack sudo[93985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9.96a1fe41-4608-4e14-a7ed-05bd01a4a893 Jul 16 23:22:29 devstack sudo[93985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:30 devstack sudo[93985]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-66e711e6-73b8-4e67-8155-fe0948d6b868 tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9.96a1fe41-4608-4e14-a7ed-05bd01a4a893" returned: 0 in 0.312s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:30 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-66e711e6-73b8-4e67-8155-fe0948d6b868 tempest-GroupSnapshotsTest-1525757492 None] Lock "cinder-quobyte-96a1fe41-4608-4e14-a7ed-05bd01a4a893" released by "_delete_snapshot" :: held 2.129s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:22:30 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-66e711e6-73b8-4e67-8155-fe0948d6b868 tempest-GroupSnapshotsTest-1525757492 None] Lock "cinder-quobyte-661af809-137a-4d27-9b9a-9cf63063dbe9" released by "delete_snapshot" :: held 2.172s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:22:30 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-66e711e6-73b8-4e67-8155-fe0948d6b868 tempest-GroupSnapshotsTest-1525757492 None] Acquiring lock "cinder-quobyte-636be79e-f7d9-4fb0-9592-3124f5f876e2" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:22:30 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-66e711e6-73b8-4e67-8155-fe0948d6b868 tempest-GroupSnapshotsTest-1525757492 None] Lock "cinder-quobyte-636be79e-f7d9-4fb0-9592-3124f5f876e2" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:22:30 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-66e711e6-73b8-4e67-8155-fe0948d6b868 tempest-GroupSnapshotsTest-1525757492 None] Acquiring lock "cinder-quobyte-bbf8cb45-3436-43b5-9c72-68eba7e5ddb5" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:22:30 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-66e711e6-73b8-4e67-8155-fe0948d6b868 tempest-GroupSnapshotsTest-1525757492 None] Lock "cinder-quobyte-bbf8cb45-3436-43b5-9c72-68eba7e5ddb5" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:22:30 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-66e711e6-73b8-4e67-8155-fe0948d6b868 tempest-GroupSnapshotsTest-1525757492 None] Deleting offline snapshot bbf8cb45-3436-43b5-9c72-68eba7e5ddb5 of volume 636be79e-f7d9-4fb0-9592-3124f5f876e2 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:22:30 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-66e711e6-73b8-4e67-8155-fe0948d6b868 tempest-GroupSnapshotsTest-1525757492 None] snapshot_file for this snap is: volume-636be79e-f7d9-4fb0-9592-3124f5f876e2.bbf8cb45-3436-43b5-9c72-68eba7e5ddb5 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:22:30 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[543466b2-f75e-4df7-8044-56629b425718]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:22:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-66e711e6-73b8-4e67-8155-fe0948d6b868 tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2.bbf8cb45-3436-43b5-9c72-68eba7e5ddb5 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:30 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-88813bb4-2a5e-4822-8e3b-1606f59808d3 tempest-VolumesActionsTest-170587690 None] Terminate volume connection completed successfully. Jul 16 23:22:30 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-88813bb4-2a5e-4822-8e3b-1606f59808d3 tempest-VolumesActionsTest-170587690 None] Acquiring lock "cinder-cd815cf7-9e31-4150-b13f-7d2d539bc2be-detach_volume" by "detach_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:22:30 devstack sudo[93988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2.bbf8cb45-3436-43b5-9c72-68eba7e5ddb5 Jul 16 23:22:30 devstack sudo[93988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:30 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-88813bb4-2a5e-4822-8e3b-1606f59808d3 tempest-VolumesActionsTest-170587690 None] Lock "cinder-cd815cf7-9e31-4150-b13f-7d2d539bc2be-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:22:30 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-88813bb4-2a5e-4822-8e3b-1606f59808d3 tempest-VolumesActionsTest-170587690 None] Detaching volume cd815cf7-9e31-4150-b13f-7d2d539bc2be from instance 9a21af8c-7921-43bb-b851-cacd5f2f1c5f. Jul 16 23:22:30 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-88813bb4-2a5e-4822-8e3b-1606f59808d3 tempest-VolumesActionsTest-170587690 None] Detach volume completed successfully. Jul 16 23:22:30 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-88813bb4-2a5e-4822-8e3b-1606f59808d3 tempest-VolumesActionsTest-170587690 None] Lock "cinder-cd815cf7-9e31-4150-b13f-7d2d539bc2be-detach_volume" released by "detach_volume" :: held 0.081s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:22:30 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0e5ec662-6e3f-410c-86b5-d5cd6903972e tempest-VolumesActionsTest-945510952 None] Acquiring lock "cinder-cd815cf7-9e31-4150-b13f-7d2d539bc2be-detach_volume" by "detach_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:22:30 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0e5ec662-6e3f-410c-86b5-d5cd6903972e tempest-VolumesActionsTest-945510952 None] Lock "cinder-cd815cf7-9e31-4150-b13f-7d2d539bc2be-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:22:30 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-0e5ec662-6e3f-410c-86b5-d5cd6903972e tempest-VolumesActionsTest-945510952 None] Volume detach called, but volume not attached. Jul 16 23:22:30 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0e5ec662-6e3f-410c-86b5-d5cd6903972e tempest-VolumesActionsTest-945510952 None] Lock "cinder-cd815cf7-9e31-4150-b13f-7d2d539bc2be-detach_volume" released by "detach_volume" :: held 0.043s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:22:30 devstack sudo[93988]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-66e711e6-73b8-4e67-8155-fe0948d6b868 tempest-GroupSnapshotsTest-1525757492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2.bbf8cb45-3436-43b5-9c72-68eba7e5ddb5" returned: 0 in 0.638s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:30 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-66e711e6-73b8-4e67-8155-fe0948d6b868 tempest-GroupSnapshotsTest-1525757492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-636be79e-f7d9-4fb0-9592-3124f5f876e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:22:30 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[270209a1-dffa-4361-8e6b-57f5efda179a]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:22:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-66e711e6-73b8-4e67-8155-fe0948d6b868 tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:31 devstack sudo[94027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2 Jul 16 23:22:31 devstack sudo[94027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:31 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b65c8f44-ad46-47e9-bb10-76d6d82201a8 tempest-VolumesActionsTest-945510952 None] Acquiring lock "cinder-cd815cf7-9e31-4150-b13f-7d2d539bc2be-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:22:31 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b65c8f44-ad46-47e9-bb10-76d6d82201a8 tempest-VolumesActionsTest-945510952 None] Lock "cinder-cd815cf7-9e31-4150-b13f-7d2d539bc2be-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:22:31 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b65c8f44-ad46-47e9-bb10-76d6d82201a8 tempest-VolumesActionsTest-945510952 None] Acquiring lock "cinder-quobyte-cd815cf7-9e31-4150-b13f-7d2d539bc2be" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:22:31 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b65c8f44-ad46-47e9-bb10-76d6d82201a8 tempest-VolumesActionsTest-945510952 None] Lock "cinder-quobyte-cd815cf7-9e31-4150-b13f-7d2d539bc2be" acquired by "delete_volume" :: waited 0.019s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:22:31 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[1875a92a-4a8c-4a8e-b107-00cde3345549]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:22:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b65c8f44-ad46-47e9-bb10-76d6d82201a8 tempest-VolumesActionsTest-945510952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cd815cf7-9e31-4150-b13f-7d2d539bc2be {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:31 devstack sudo[94027]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-66e711e6-73b8-4e67-8155-fe0948d6b868 tempest-GroupSnapshotsTest-1525757492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2" returned: 0 in 0.609s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-66e711e6-73b8-4e67-8155-fe0948d6b868 tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2.bbf8cb45-3436-43b5-9c72-68eba7e5ddb5 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:31 devstack sudo[94031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cd815cf7-9e31-4150-b13f-7d2d539bc2be Jul 16 23:22:31 devstack sudo[94031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:31 devstack sudo[94035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2.bbf8cb45-3436-43b5-9c72-68eba7e5ddb5 Jul 16 23:22:31 devstack sudo[94035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:31 devstack sudo[94031]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b65c8f44-ad46-47e9-bb10-76d6d82201a8 tempest-VolumesActionsTest-945510952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cd815cf7-9e31-4150-b13f-7d2d539bc2be" returned: 0 in 0.427s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b65c8f44-ad46-47e9-bb10-76d6d82201a8 tempest-VolumesActionsTest-945510952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cd815cf7-9e31-4150-b13f-7d2d539bc2be {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:31 devstack sudo[94045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cd815cf7-9e31-4150-b13f-7d2d539bc2be Jul 16 23:22:31 devstack sudo[94045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:32 devstack sudo[94035]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-66e711e6-73b8-4e67-8155-fe0948d6b868 tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2.bbf8cb45-3436-43b5-9c72-68eba7e5ddb5" returned: 0 in 0.528s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-66e711e6-73b8-4e67-8155-fe0948d6b868 tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2.bbf8cb45-3436-43b5-9c72-68eba7e5ddb5 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:32 devstack sudo[94072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2.bbf8cb45-3436-43b5-9c72-68eba7e5ddb5 Jul 16 23:22:32 devstack sudo[94072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:32 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-de6c679c-5024-41b0-a0d3-89ced3645573 tempest-VolumesListAdminTestJSON-961640462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:22:32 devstack sudo[94045]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:32 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-de6c679c-5024-41b0-a0d3-89ced3645573 tempest-VolumesListAdminTestJSON-961640462 None] Flow 'volume_create_manager' (045076bf-80d2-49c4-9cbe-64b4f176a749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:22:32 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-de6c679c-5024-41b0-a0d3-89ced3645573 tempest-VolumesListAdminTestJSON-961640462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74b64510-c222-4e48-8d6f-9341122dc191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b65c8f44-ad46-47e9-bb10-76d6d82201a8 tempest-VolumesActionsTest-945510952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cd815cf7-9e31-4150-b13f-7d2d539bc2be" returned: 0 in 0.359s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:32 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-de6c679c-5024-41b0-a0d3-89ced3645573 tempest-VolumesListAdminTestJSON-961640462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74b64510-c222-4e48-8d6f-9341122dc191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-275482035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0586dcb9-79b8-477a-889e-bcdda9d7234f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eddb9b1653f64ceeb0723c93b16537ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:22:32Z,use_quota=True,user_id='57fb4168a9db40fc97b6f8728c16cdee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:32 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-de6c679c-5024-41b0-a0d3-89ced3645573 tempest-VolumesListAdminTestJSON-961640462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de8b87b2-adcc-4f78-966d-e71ea7c8a2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:32 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-de6c679c-5024-41b0-a0d3-89ced3645573 tempest-VolumesListAdminTestJSON-961640462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de8b87b2-adcc-4f78-966d-e71ea7c8a2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:32 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-de6c679c-5024-41b0-a0d3-89ced3645573 tempest-VolumesListAdminTestJSON-961640462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc76b4a2-edb5-491c-8875-4aa0b8a2b1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:32 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-de6c679c-5024-41b0-a0d3-89ced3645573 tempest-VolumesListAdminTestJSON-961640462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc76b4a2-edb5-491c-8875-4aa0b8a2b1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0586dcb9-79b8-477a-889e-bcdda9d7234f', 'volume_name': 'volume-0586dcb9-79b8-477a-889e-bcdda9d7234f', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:32 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-de6c679c-5024-41b0-a0d3-89ced3645573 tempest-VolumesListAdminTestJSON-961640462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b12ad186-753c-4070-b4ea-59e5fc288e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:32 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-de6c679c-5024-41b0-a0d3-89ced3645573 tempest-VolumesListAdminTestJSON-961640462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b12ad186-753c-4070-b4ea-59e5fc288e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:32 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-de6c679c-5024-41b0-a0d3-89ced3645573 tempest-VolumesListAdminTestJSON-961640462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee0cffa5-d0a8-44de-a401-554befbf77a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:32 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-de6c679c-5024-41b0-a0d3-89ced3645573 tempest-VolumesListAdminTestJSON-961640462 None] Volume 0586dcb9-79b8-477a-889e-bcdda9d7234f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0586dcb9-79b8-477a-889e-bcdda9d7234f', 'volume_size': 1} Jul 16 23:22:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-de6c679c-5024-41b0-a0d3-89ced3645573 tempest-VolumesListAdminTestJSON-961640462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-de6c679c-5024-41b0-a0d3-89ced3645573 tempest-VolumesListAdminTestJSON-961640462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:32 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-de6c679c-5024-41b0-a0d3-89ced3645573 tempest-VolumesListAdminTestJSON-961640462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-275482035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0586dcb9-79b8-477a-889e-bcdda9d7234f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eddb9b1653f64ceeb0723c93b16537ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:22:32Z,use_quota=True,user_id='57fb4168a9db40fc97b6f8728c16cdee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:22:32 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-de6c679c-5024-41b0-a0d3-89ced3645573 tempest-VolumesListAdminTestJSON-961640462 None] Creating volume 0586dcb9-79b8-477a-889e-bcdda9d7234f {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:22:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-de6c679c-5024-41b0-a0d3-89ced3645573 tempest-VolumesListAdminTestJSON-961640462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-de6c679c-5024-41b0-a0d3-89ced3645573 tempest-VolumesListAdminTestJSON-961640462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:32 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-de6c679c-5024-41b0-a0d3-89ced3645573 tempest-VolumesListAdminTestJSON-961640462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:22:32 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-de6c679c-5024-41b0-a0d3-89ced3645573 tempest-VolumesListAdminTestJSON-961640462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:22:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-de6c679c-5024-41b0-a0d3-89ced3645573 tempest-VolumesListAdminTestJSON-961640462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:32 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-de6c679c-5024-41b0-a0d3-89ced3645573 tempest-VolumesListAdminTestJSON-961640462 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:22:32 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-de6c679c-5024-41b0-a0d3-89ced3645573 tempest-VolumesListAdminTestJSON-961640462 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:22:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-de6c679c-5024-41b0-a0d3-89ced3645573 tempest-VolumesListAdminTestJSON-961640462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0586dcb9-79b8-477a-889e-bcdda9d7234f 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:32 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b65c8f44-ad46-47e9-bb10-76d6d82201a8 tempest-VolumesActionsTest-945510952 None] Lock "cinder-quobyte-cd815cf7-9e31-4150-b13f-7d2d539bc2be" released by "delete_volume" :: held 0.902s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:22:32 devstack sudo[94075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0586dcb9-79b8-477a-889e-bcdda9d7234f 1073741824 Jul 16 23:22:32 devstack sudo[94075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:32 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-b65c8f44-ad46-47e9-bb10-76d6d82201a8 tempest-VolumesActionsTest-945510952 None] Created reservations ['e57086a2-161c-42fa-937a-2a356383bf82', '14975094-b3f1-4021-9079-8a07cac4dc41', 'fb85aebe-e9cb-4d68-84bd-06fd90e150e2', '39d7731f-d78a-4ee5-afc9-30b6f626ff65'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:22:32 devstack sudo[94072]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-66e711e6-73b8-4e67-8155-fe0948d6b868 tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2.bbf8cb45-3436-43b5-9c72-68eba7e5ddb5" returned: 0 in 0.360s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:32 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-66e711e6-73b8-4e67-8155-fe0948d6b868 tempest-GroupSnapshotsTest-1525757492 None] Lock "cinder-quobyte-bbf8cb45-3436-43b5-9c72-68eba7e5ddb5" released by "_delete_snapshot" :: held 2.277s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:22:32 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-66e711e6-73b8-4e67-8155-fe0948d6b868 tempest-GroupSnapshotsTest-1525757492 None] Lock "cinder-quobyte-636be79e-f7d9-4fb0-9592-3124f5f876e2" released by "delete_snapshot" :: held 2.309s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:22:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b65c8f44-ad46-47e9-bb10-76d6d82201a8 tempest-VolumesActionsTest-945510952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b65c8f44-ad46-47e9-bb10-76d6d82201a8 tempest-VolumesActionsTest-945510952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:32 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-b65c8f44-ad46-47e9-bb10-76d6d82201a8 tempest-VolumesActionsTest-945510952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:22:32 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-b65c8f44-ad46-47e9-bb10-76d6d82201a8 tempest-VolumesActionsTest-945510952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:22:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b65c8f44-ad46-47e9-bb10-76d6d82201a8 tempest-VolumesActionsTest-945510952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b65c8f44-ad46-47e9-bb10-76d6d82201a8 tempest-VolumesActionsTest-945510952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:32 devstack sudo[94078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:22:32 devstack sudo[94078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:32 devstack cinder-volume[87607]: WARNING cinder.quota [None req-66e711e6-73b8-4e67-8155-fe0948d6b868 tempest-GroupSnapshotsTest-1525757492 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1017059373 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1017059373, it is now deprecated. Please use the default quota class for default quota. Jul 16 23:22:32 devstack cinder-volume[87607]: WARNING cinder.quota [None req-66e711e6-73b8-4e67-8155-fe0948d6b868 tempest-GroupSnapshotsTest-1525757492 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1017059373 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1017059373, it is now deprecated. Please use the default quota class for default quota. Jul 16 23:22:32 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-66e711e6-73b8-4e67-8155-fe0948d6b868 tempest-GroupSnapshotsTest-1525757492 None] Created reservations ['64b1a97b-a320-4339-8451-1903ceb8a788', '6d4add4c-57d6-46f8-a868-58ce28452e30', '2c71d372-e81c-439c-9d94-e0f96cabc958', '2d955b7e-fbb2-4062-9acc-370f0b9425fc'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:22:32 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-66e711e6-73b8-4e67-8155-fe0948d6b868 tempest-GroupSnapshotsTest-1525757492 None] Created reservations ['665ec397-97b6-48e2-8cf3-8fc9e55801bf', '12f799ab-cd52-46b2-b324-85a0388e164e', '724a6995-b4b7-4ce8-890f-80f2a43c3b71', 'e2897927-9931-4440-a95c-65779286a70b'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:22:32 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-66e711e6-73b8-4e67-8155-fe0948d6b868 tempest-GroupSnapshotsTest-1525757492 None] group_snapshot bf67b553-ce3c-43b7-8154-4504afe64993: deleted successfully Jul 16 23:22:32 devstack sudo[94075]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-de6c679c-5024-41b0-a0d3-89ced3645573 tempest-VolumesListAdminTestJSON-961640462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0586dcb9-79b8-477a-889e-bcdda9d7234f 1073741824" returned: 0 in 0.559s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-de6c679c-5024-41b0-a0d3-89ced3645573 tempest-VolumesListAdminTestJSON-961640462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0586dcb9-79b8-477a-889e-bcdda9d7234f {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:32 devstack sudo[94078]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b65c8f44-ad46-47e9-bb10-76d6d82201a8 tempest-VolumesActionsTest-945510952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.384s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:32 devstack sudo[94085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0586dcb9-79b8-477a-889e-bcdda9d7234f Jul 16 23:22:32 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-b65c8f44-ad46-47e9-bb10-76d6d82201a8 tempest-VolumesActionsTest-945510952 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:22:32 devstack sudo[94085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:32 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-b65c8f44-ad46-47e9-bb10-76d6d82201a8 tempest-VolumesActionsTest-945510952 None] Deleted volume successfully. Jul 16 23:22:32 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b65c8f44-ad46-47e9-bb10-76d6d82201a8 tempest-VolumesActionsTest-945510952 None] Lock "cinder-cd815cf7-9e31-4150-b13f-7d2d539bc2be-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:22:33 devstack sudo[94085]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-de6c679c-5024-41b0-a0d3-89ced3645573 tempest-VolumesListAdminTestJSON-961640462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0586dcb9-79b8-477a-889e-bcdda9d7234f" returned: 0 in 0.283s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:33 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-de6c679c-5024-41b0-a0d3-89ced3645573 tempest-VolumesListAdminTestJSON-961640462 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:22:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-de6c679c-5024-41b0-a0d3-89ced3645573 tempest-VolumesListAdminTestJSON-961640462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:33 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-de6c679c-5024-41b0-a0d3-89ced3645573 tempest-VolumesListAdminTestJSON-961640462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee0cffa5-d0a8-44de-a401-554befbf77a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0586dcb9-79b8-477a-889e-bcdda9d7234f', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:33 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-de6c679c-5024-41b0-a0d3-89ced3645573 tempest-VolumesListAdminTestJSON-961640462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d80ff15f-ba89-4295-ad58-3455eb90056d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:33 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-de6c679c-5024-41b0-a0d3-89ced3645573 tempest-VolumesListAdminTestJSON-961640462 None] Volume volume-0586dcb9-79b8-477a-889e-bcdda9d7234f (0586dcb9-79b8-477a-889e-bcdda9d7234f): created successfully Jul 16 23:22:33 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-de6c679c-5024-41b0-a0d3-89ced3645573 tempest-VolumesListAdminTestJSON-961640462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d80ff15f-ba89-4295-ad58-3455eb90056d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:33 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-de6c679c-5024-41b0-a0d3-89ced3645573 tempest-VolumesListAdminTestJSON-961640462 None] Flow 'volume_create_manager' (045076bf-80d2-49c4-9cbe-64b4f176a749) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:22:33 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-de6c679c-5024-41b0-a0d3-89ced3645573 tempest-VolumesListAdminTestJSON-961640462 None] Created volume successfully. Jul 16 23:22:34 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-cd2541d0-20fe-44d2-961e-d2a6b3beaa5b tempest-GroupSnapshotsTest-1525757492 None] Acquiring lock "cinder-quobyte-636be79e-f7d9-4fb0-9592-3124f5f876e2" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:22:34 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-cd2541d0-20fe-44d2-961e-d2a6b3beaa5b tempest-GroupSnapshotsTest-1525757492 None] Lock "cinder-quobyte-636be79e-f7d9-4fb0-9592-3124f5f876e2" acquired by "delete_volume" :: waited 0.037s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:22:34 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2c6b5b-d8aa-4031-8a7b-632393c449c2]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:22:34 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cd2541d0-20fe-44d2-961e-d2a6b3beaa5b tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:34 devstack sudo[94111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2 Jul 16 23:22:34 devstack sudo[94111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:34 devstack sudo[94111]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:34 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cd2541d0-20fe-44d2-961e-d2a6b3beaa5b tempest-GroupSnapshotsTest-1525757492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2" returned: 0 in 0.564s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:34 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cd2541d0-20fe-44d2-961e-d2a6b3beaa5b tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:35 devstack sudo[94116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2 Jul 16 23:22:35 devstack sudo[94116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:35 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:SELECT=122,cinder:UPDATE=104,cinder:DELETE=4,cinder:INSERT=25 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:22:35 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-690c5cec-82b8-41f9-9ccc-a5589372c908 tempest-VolumesListAdminTestJSON-961640462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:22:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-690c5cec-82b8-41f9-9ccc-a5589372c908 tempest-VolumesListAdminTestJSON-961640462 None] Flow 'volume_create_manager' (1a5077ea-bfc0-46de-a51e-0c3fe88acbde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:22:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-690c5cec-82b8-41f9-9ccc-a5589372c908 tempest-VolumesListAdminTestJSON-961640462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1e3efcb-32a2-4ba7-8547-98776372da31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-690c5cec-82b8-41f9-9ccc-a5589372c908 tempest-VolumesListAdminTestJSON-961640462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1e3efcb-32a2-4ba7-8547-98776372da31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-540072447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3109e230-dd74-411b-9741-02ea29369a31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eddb9b1653f64ceeb0723c93b16537ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:22:35Z,use_quota=True,user_id='57fb4168a9db40fc97b6f8728c16cdee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-690c5cec-82b8-41f9-9ccc-a5589372c908 tempest-VolumesListAdminTestJSON-961640462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f908111-65a5-48bc-b6fe-42279a740ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-690c5cec-82b8-41f9-9ccc-a5589372c908 tempest-VolumesListAdminTestJSON-961640462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f908111-65a5-48bc-b6fe-42279a740ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-690c5cec-82b8-41f9-9ccc-a5589372c908 tempest-VolumesListAdminTestJSON-961640462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (001bd0db-7523-4b30-b203-db9891a6814b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-690c5cec-82b8-41f9-9ccc-a5589372c908 tempest-VolumesListAdminTestJSON-961640462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (001bd0db-7523-4b30-b203-db9891a6814b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3109e230-dd74-411b-9741-02ea29369a31', 'volume_name': 'volume-3109e230-dd74-411b-9741-02ea29369a31', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-690c5cec-82b8-41f9-9ccc-a5589372c908 tempest-VolumesListAdminTestJSON-961640462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfb2c086-9a0c-4b6d-ad34-2f6d3ca71434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-690c5cec-82b8-41f9-9ccc-a5589372c908 tempest-VolumesListAdminTestJSON-961640462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfb2c086-9a0c-4b6d-ad34-2f6d3ca71434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-690c5cec-82b8-41f9-9ccc-a5589372c908 tempest-VolumesListAdminTestJSON-961640462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46194d40-ee08-424f-8eb6-276482d3ff2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:35 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-690c5cec-82b8-41f9-9ccc-a5589372c908 tempest-VolumesListAdminTestJSON-961640462 None] Volume 3109e230-dd74-411b-9741-02ea29369a31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3109e230-dd74-411b-9741-02ea29369a31', 'volume_size': 1} Jul 16 23:22:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-690c5cec-82b8-41f9-9ccc-a5589372c908 tempest-VolumesListAdminTestJSON-961640462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-690c5cec-82b8-41f9-9ccc-a5589372c908 tempest-VolumesListAdminTestJSON-961640462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:35 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-690c5cec-82b8-41f9-9ccc-a5589372c908 tempest-VolumesListAdminTestJSON-961640462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-540072447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3109e230-dd74-411b-9741-02ea29369a31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eddb9b1653f64ceeb0723c93b16537ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:22:35Z,use_quota=True,user_id='57fb4168a9db40fc97b6f8728c16cdee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:22:35 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-690c5cec-82b8-41f9-9ccc-a5589372c908 tempest-VolumesListAdminTestJSON-961640462 None] Creating volume 3109e230-dd74-411b-9741-02ea29369a31 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:22:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-690c5cec-82b8-41f9-9ccc-a5589372c908 tempest-VolumesListAdminTestJSON-961640462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-690c5cec-82b8-41f9-9ccc-a5589372c908 tempest-VolumesListAdminTestJSON-961640462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:35 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-690c5cec-82b8-41f9-9ccc-a5589372c908 tempest-VolumesListAdminTestJSON-961640462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:22:35 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-690c5cec-82b8-41f9-9ccc-a5589372c908 tempest-VolumesListAdminTestJSON-961640462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:22:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-690c5cec-82b8-41f9-9ccc-a5589372c908 tempest-VolumesListAdminTestJSON-961640462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:35 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-690c5cec-82b8-41f9-9ccc-a5589372c908 tempest-VolumesListAdminTestJSON-961640462 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:22:35 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-690c5cec-82b8-41f9-9ccc-a5589372c908 tempest-VolumesListAdminTestJSON-961640462 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:22:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-690c5cec-82b8-41f9-9ccc-a5589372c908 tempest-VolumesListAdminTestJSON-961640462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3109e230-dd74-411b-9741-02ea29369a31 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:35 devstack sudo[94120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3109e230-dd74-411b-9741-02ea29369a31 1073741824 Jul 16 23:22:35 devstack sudo[94120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:35 devstack sudo[94116]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cd2541d0-20fe-44d2-961e-d2a6b3beaa5b tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-636be79e-f7d9-4fb0-9592-3124f5f876e2" returned: 0 in 0.473s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:35 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-cd2541d0-20fe-44d2-961e-d2a6b3beaa5b tempest-GroupSnapshotsTest-1525757492 None] Lock "cinder-quobyte-636be79e-f7d9-4fb0-9592-3124f5f876e2" released by "delete_volume" :: held 1.130s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:22:35 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-cd2541d0-20fe-44d2-961e-d2a6b3beaa5b tempest-GroupSnapshotsTest-1525757492 None] Acquiring lock "cinder-quobyte-661af809-137a-4d27-9b9a-9cf63063dbe9" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:22:35 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-cd2541d0-20fe-44d2-961e-d2a6b3beaa5b tempest-GroupSnapshotsTest-1525757492 None] Lock "cinder-quobyte-661af809-137a-4d27-9b9a-9cf63063dbe9" acquired by "delete_volume" :: waited 0.023s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:22:35 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87b06ea-74ad-4cee-ba4c-8d1e0eb602dc]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:22:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cd2541d0-20fe-44d2-961e-d2a6b3beaa5b tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:35 devstack sudo[94123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9 Jul 16 23:22:35 devstack sudo[94123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:35 devstack sudo[94120]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-690c5cec-82b8-41f9-9ccc-a5589372c908 tempest-VolumesListAdminTestJSON-961640462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3109e230-dd74-411b-9741-02ea29369a31 1073741824" returned: 0 in 0.664s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:35 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:UPDATE=108,cinder:SELECT=103,cinder:INSERT=22,cinder:DELETE=7 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:22:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-690c5cec-82b8-41f9-9ccc-a5589372c908 tempest-VolumesListAdminTestJSON-961640462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3109e230-dd74-411b-9741-02ea29369a31 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:36 devstack sudo[94132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3109e230-dd74-411b-9741-02ea29369a31 Jul 16 23:22:36 devstack sudo[94132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:36 devstack sudo[94123]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cd2541d0-20fe-44d2-961e-d2a6b3beaa5b tempest-GroupSnapshotsTest-1525757492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9" returned: 0 in 0.552s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cd2541d0-20fe-44d2-961e-d2a6b3beaa5b tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:36 devstack sudo[94134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9 Jul 16 23:22:36 devstack sudo[94134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:36 devstack sudo[94132]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-690c5cec-82b8-41f9-9ccc-a5589372c908 tempest-VolumesListAdminTestJSON-961640462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3109e230-dd74-411b-9741-02ea29369a31" returned: 0 in 0.312s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:36 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-690c5cec-82b8-41f9-9ccc-a5589372c908 tempest-VolumesListAdminTestJSON-961640462 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:22:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-690c5cec-82b8-41f9-9ccc-a5589372c908 tempest-VolumesListAdminTestJSON-961640462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:36 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-690c5cec-82b8-41f9-9ccc-a5589372c908 tempest-VolumesListAdminTestJSON-961640462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46194d40-ee08-424f-8eb6-276482d3ff2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3109e230-dd74-411b-9741-02ea29369a31', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:36 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-690c5cec-82b8-41f9-9ccc-a5589372c908 tempest-VolumesListAdminTestJSON-961640462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c876bcdc-a5c6-40bc-ae6e-362021dc3e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:36 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-690c5cec-82b8-41f9-9ccc-a5589372c908 tempest-VolumesListAdminTestJSON-961640462 None] Volume volume-3109e230-dd74-411b-9741-02ea29369a31 (3109e230-dd74-411b-9741-02ea29369a31): created successfully Jul 16 23:22:36 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-690c5cec-82b8-41f9-9ccc-a5589372c908 tempest-VolumesListAdminTestJSON-961640462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c876bcdc-a5c6-40bc-ae6e-362021dc3e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:36 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-690c5cec-82b8-41f9-9ccc-a5589372c908 tempest-VolumesListAdminTestJSON-961640462 None] Flow 'volume_create_manager' (1a5077ea-bfc0-46de-a51e-0c3fe88acbde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:22:36 devstack sudo[94134]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cd2541d0-20fe-44d2-961e-d2a6b3beaa5b tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-661af809-137a-4d27-9b9a-9cf63063dbe9" returned: 0 in 0.321s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:36 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-690c5cec-82b8-41f9-9ccc-a5589372c908 tempest-VolumesListAdminTestJSON-961640462 None] Created volume successfully. Jul 16 23:22:36 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-cd2541d0-20fe-44d2-961e-d2a6b3beaa5b tempest-GroupSnapshotsTest-1525757492 None] Lock "cinder-quobyte-661af809-137a-4d27-9b9a-9cf63063dbe9" released by "delete_volume" :: held 0.957s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:22:36 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-cd2541d0-20fe-44d2-961e-d2a6b3beaa5b tempest-GroupSnapshotsTest-1525757492 None] Created reservations ['d7e1a295-1455-43d8-a94c-f0f1812580c8'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:22:36 devstack cinder-volume[87607]: WARNING cinder.quota [None req-cd2541d0-20fe-44d2-961e-d2a6b3beaa5b tempest-GroupSnapshotsTest-1525757492 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1017059373 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1017059373, it is now deprecated. Please use the default quota class for default quota. Jul 16 23:22:36 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-cd2541d0-20fe-44d2-961e-d2a6b3beaa5b tempest-GroupSnapshotsTest-1525757492 None] Created reservations ['e68cb5c2-56f6-4ce0-be90-d0d8391e2da2', 'd1bf87ff-b5ff-4925-8496-e4ecc63e2e4c', '5a9fe183-cd1a-4350-835a-777891764ad4', '84d9e5d3-c388-4d0e-868a-7cd0b33fddc0'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:22:36 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-cd2541d0-20fe-44d2-961e-d2a6b3beaa5b tempest-GroupSnapshotsTest-1525757492 None] Created reservations ['28a4ec33-61af-4d11-8941-42255684b98a', 'c7e504bd-f330-41fd-90cb-53800da7d59a', 'f9865128-e836-4631-b7bd-4e5fbb34e3ac', '80afa6ad-8e0d-4457-a644-d4dec50d6156'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:22:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-cd2541d0-20fe-44d2-961e-d2a6b3beaa5b tempest-GroupSnapshotsTest-1525757492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-cd2541d0-20fe-44d2-961e-d2a6b3beaa5b tempest-GroupSnapshotsTest-1525757492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:36 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-cd2541d0-20fe-44d2-961e-d2a6b3beaa5b tempest-GroupSnapshotsTest-1525757492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:22:36 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-cd2541d0-20fe-44d2-961e-d2a6b3beaa5b tempest-GroupSnapshotsTest-1525757492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:22:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-cd2541d0-20fe-44d2-961e-d2a6b3beaa5b tempest-GroupSnapshotsTest-1525757492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cd2541d0-20fe-44d2-961e-d2a6b3beaa5b tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:36 devstack sudo[94141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:22:36 devstack sudo[94141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:37 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-c15e63b4-99db-4b17-b6d5-616215979384 tempest-VolumesActionsTest-945510952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:22:37 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c15e63b4-99db-4b17-b6d5-616215979384 tempest-VolumesActionsTest-945510952 None] Flow 'volume_create_manager' (7d85e8c9-31cf-459e-bfaf-bb1bf3fcf450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:22:37 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c15e63b4-99db-4b17-b6d5-616215979384 tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cfc5426-0443-49a2-b8ae-3d04ebdbbdd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:37 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c15e63b4-99db-4b17-b6d5-616215979384 tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cfc5426-0443-49a2-b8ae-3d04ebdbbdd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-298151768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=663eb6a8-690a-4303-abc3-3756762a72a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b6831797d7e401cb13e3160cc927031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:22:37Z,use_quota=True,user_id='09da365af4e94489a1407a040f05c1c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:37 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c15e63b4-99db-4b17-b6d5-616215979384 tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96639306-9b37-4c3b-917e-7e2653edabd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:37 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c15e63b4-99db-4b17-b6d5-616215979384 tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96639306-9b37-4c3b-917e-7e2653edabd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:37 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c15e63b4-99db-4b17-b6d5-616215979384 tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a148d2cf-f9d8-49e6-b126-29c2c826e657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:37 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c15e63b4-99db-4b17-b6d5-616215979384 tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a148d2cf-f9d8-49e6-b126-29c2c826e657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '663eb6a8-690a-4303-abc3-3756762a72a1', 'volume_name': 'volume-663eb6a8-690a-4303-abc3-3756762a72a1', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:37 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c15e63b4-99db-4b17-b6d5-616215979384 tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade7e233-e40e-45ea-882f-8f1392eafe0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:37 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c15e63b4-99db-4b17-b6d5-616215979384 tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade7e233-e40e-45ea-882f-8f1392eafe0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:37 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c15e63b4-99db-4b17-b6d5-616215979384 tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c998a7c-1bcf-4228-a80e-082ba1cdc240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:37 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-c15e63b4-99db-4b17-b6d5-616215979384 tempest-VolumesActionsTest-945510952 None] Volume 663eb6a8-690a-4303-abc3-3756762a72a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-663eb6a8-690a-4303-abc3-3756762a72a1', 'volume_size': 1} Jul 16 23:22:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c15e63b4-99db-4b17-b6d5-616215979384 tempest-VolumesActionsTest-945510952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c15e63b4-99db-4b17-b6d5-616215979384 tempest-VolumesActionsTest-945510952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:37 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-c15e63b4-99db-4b17-b6d5-616215979384 tempest-VolumesActionsTest-945510952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-298151768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=663eb6a8-690a-4303-abc3-3756762a72a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b6831797d7e401cb13e3160cc927031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:22:37Z,use_quota=True,user_id='09da365af4e94489a1407a040f05c1c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:22:37 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-c15e63b4-99db-4b17-b6d5-616215979384 tempest-VolumesActionsTest-945510952 None] Creating volume 663eb6a8-690a-4303-abc3-3756762a72a1 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:22:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c15e63b4-99db-4b17-b6d5-616215979384 tempest-VolumesActionsTest-945510952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c15e63b4-99db-4b17-b6d5-616215979384 tempest-VolumesActionsTest-945510952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:37 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-c15e63b4-99db-4b17-b6d5-616215979384 tempest-VolumesActionsTest-945510952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:22:37 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-c15e63b4-99db-4b17-b6d5-616215979384 tempest-VolumesActionsTest-945510952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:22:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c15e63b4-99db-4b17-b6d5-616215979384 tempest-VolumesActionsTest-945510952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:37 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-c15e63b4-99db-4b17-b6d5-616215979384 tempest-VolumesActionsTest-945510952 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:22:37 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-c15e63b4-99db-4b17-b6d5-616215979384 tempest-VolumesActionsTest-945510952 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:22:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c15e63b4-99db-4b17-b6d5-616215979384 tempest-VolumesActionsTest-945510952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-663eb6a8-690a-4303-abc3-3756762a72a1 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:37 devstack sudo[94144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-663eb6a8-690a-4303-abc3-3756762a72a1 1073741824 Jul 16 23:22:37 devstack sudo[94144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:37 devstack sudo[94141]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cd2541d0-20fe-44d2-961e-d2a6b3beaa5b tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.446s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:37 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-cd2541d0-20fe-44d2-961e-d2a6b3beaa5b tempest-GroupSnapshotsTest-1525757492 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:22:37 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-cd2541d0-20fe-44d2-961e-d2a6b3beaa5b tempest-GroupSnapshotsTest-1525757492 None] Delete group completed successfully. Jul 16 23:22:37 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-54421790-82ff-44ae-a0c6-1717ee8445f8 tempest-GroupSnapshotsTest-1525757492 None] Group tempest-GroupSnapshotsTest-Group-608215885: creating Jul 16 23:22:37 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-54421790-82ff-44ae-a0c6-1717ee8445f8 tempest-GroupSnapshotsTest-1525757492 None] Group tempest-GroupSnapshotsTest-Group-608215885: created successfully Jul 16 23:22:37 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-54421790-82ff-44ae-a0c6-1717ee8445f8 tempest-GroupSnapshotsTest-1525757492 None] Create group completed successfully. Jul 16 23:22:37 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-b1fc4068-599a-4f53-878e-863cae5ea190 req-39ed0a0a-9818-4212-9804-b6317548cd2b tempest-AttachVolumeTestJSON-886512989 None] Terminate volume connection completed successfully. Jul 16 23:22:37 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-b1fc4068-599a-4f53-878e-863cae5ea190 req-39ed0a0a-9818-4212-9804-b6317548cd2b tempest-AttachVolumeTestJSON-886512989 None] Deleting attachment a3ee422f-4980-4211-bb48-df0263be1361. {{(pid=87607) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 23:22:37 devstack sudo[94144]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c15e63b4-99db-4b17-b6d5-616215979384 tempest-VolumesActionsTest-945510952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-663eb6a8-690a-4303-abc3-3756762a72a1 1073741824" returned: 0 in 0.591s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c15e63b4-99db-4b17-b6d5-616215979384 tempest-VolumesActionsTest-945510952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-663eb6a8-690a-4303-abc3-3756762a72a1 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:37 devstack sudo[94154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-663eb6a8-690a-4303-abc3-3756762a72a1 Jul 16 23:22:37 devstack sudo[94154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:37 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a4d88fa-ce6d-4fd9-9d1b-4487bb149431 tempest-VolumesListAdminTestJSON-961640462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:22:37 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5a4d88fa-ce6d-4fd9-9d1b-4487bb149431 tempest-VolumesListAdminTestJSON-961640462 None] Flow 'volume_create_manager' (73c54d82-f066-4dac-8db8-b86d6bc99538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:22:37 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5a4d88fa-ce6d-4fd9-9d1b-4487bb149431 tempest-VolumesListAdminTestJSON-961640462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa067183-1b1a-4e4d-98a2-a604fea2263c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:37 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5a4d88fa-ce6d-4fd9-9d1b-4487bb149431 tempest-VolumesListAdminTestJSON-961640462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa067183-1b1a-4e4d-98a2-a604fea2263c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-954946244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a481a2cb-27bb-4408-8b6d-c2b717f8d045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eddb9b1653f64ceeb0723c93b16537ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:22:38Z,use_quota=True,user_id='57fb4168a9db40fc97b6f8728c16cdee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:37 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5a4d88fa-ce6d-4fd9-9d1b-4487bb149431 tempest-VolumesListAdminTestJSON-961640462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53e9a6b2-506a-47c3-aa81-025389c8deb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:37 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5a4d88fa-ce6d-4fd9-9d1b-4487bb149431 tempest-VolumesListAdminTestJSON-961640462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53e9a6b2-506a-47c3-aa81-025389c8deb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:37 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5a4d88fa-ce6d-4fd9-9d1b-4487bb149431 tempest-VolumesListAdminTestJSON-961640462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7d05f94-4d0b-4f83-bc90-5c30cd07a72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:37 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5a4d88fa-ce6d-4fd9-9d1b-4487bb149431 tempest-VolumesListAdminTestJSON-961640462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7d05f94-4d0b-4f83-bc90-5c30cd07a72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a481a2cb-27bb-4408-8b6d-c2b717f8d045', 'volume_name': 'volume-a481a2cb-27bb-4408-8b6d-c2b717f8d045', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:37 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5a4d88fa-ce6d-4fd9-9d1b-4487bb149431 tempest-VolumesListAdminTestJSON-961640462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae851f9c-6c5b-4ae0-a5ed-af2d261b2f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:37 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5a4d88fa-ce6d-4fd9-9d1b-4487bb149431 tempest-VolumesListAdminTestJSON-961640462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae851f9c-6c5b-4ae0-a5ed-af2d261b2f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5a4d88fa-ce6d-4fd9-9d1b-4487bb149431 tempest-VolumesListAdminTestJSON-961640462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e3691e6-1bf6-4ab9-85bd-bdf635f066bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:38 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-5a4d88fa-ce6d-4fd9-9d1b-4487bb149431 tempest-VolumesListAdminTestJSON-961640462 None] Volume a481a2cb-27bb-4408-8b6d-c2b717f8d045: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a481a2cb-27bb-4408-8b6d-c2b717f8d045', 'volume_size': 1} Jul 16 23:22:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5a4d88fa-ce6d-4fd9-9d1b-4487bb149431 tempest-VolumesListAdminTestJSON-961640462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:38 devstack sudo[94154]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c15e63b4-99db-4b17-b6d5-616215979384 tempest-VolumesActionsTest-945510952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-663eb6a8-690a-4303-abc3-3756762a72a1" returned: 0 in 0.319s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:38 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-c15e63b4-99db-4b17-b6d5-616215979384 tempest-VolumesActionsTest-945510952 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:22:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c15e63b4-99db-4b17-b6d5-616215979384 tempest-VolumesActionsTest-945510952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5a4d88fa-ce6d-4fd9-9d1b-4487bb149431 tempest-VolumesListAdminTestJSON-961640462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.150s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:38 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-5a4d88fa-ce6d-4fd9-9d1b-4487bb149431 tempest-VolumesListAdminTestJSON-961640462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-954946244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a481a2cb-27bb-4408-8b6d-c2b717f8d045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eddb9b1653f64ceeb0723c93b16537ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:22:38Z,use_quota=True,user_id='57fb4168a9db40fc97b6f8728c16cdee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:22:38 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-5a4d88fa-ce6d-4fd9-9d1b-4487bb149431 tempest-VolumesListAdminTestJSON-961640462 None] Creating volume a481a2cb-27bb-4408-8b6d-c2b717f8d045 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:22:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5a4d88fa-ce6d-4fd9-9d1b-4487bb149431 tempest-VolumesListAdminTestJSON-961640462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5a4d88fa-ce6d-4fd9-9d1b-4487bb149431 tempest-VolumesListAdminTestJSON-961640462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:38 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-5a4d88fa-ce6d-4fd9-9d1b-4487bb149431 tempest-VolumesListAdminTestJSON-961640462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:22:38 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-5a4d88fa-ce6d-4fd9-9d1b-4487bb149431 tempest-VolumesListAdminTestJSON-961640462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:22:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5a4d88fa-ce6d-4fd9-9d1b-4487bb149431 tempest-VolumesListAdminTestJSON-961640462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:38 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-5a4d88fa-ce6d-4fd9-9d1b-4487bb149431 tempest-VolumesListAdminTestJSON-961640462 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:22:38 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-5a4d88fa-ce6d-4fd9-9d1b-4487bb149431 tempest-VolumesListAdminTestJSON-961640462 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:22:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5a4d88fa-ce6d-4fd9-9d1b-4487bb149431 tempest-VolumesListAdminTestJSON-961640462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a481a2cb-27bb-4408-8b6d-c2b717f8d045 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c15e63b4-99db-4b17-b6d5-616215979384 tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c998a7c-1bcf-4228-a80e-082ba1cdc240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-663eb6a8-690a-4303-abc3-3756762a72a1', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c15e63b4-99db-4b17-b6d5-616215979384 tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1f8f4a3-dbc2-4fc6-9775-5ceb73dda9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:38 devstack sudo[94157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a481a2cb-27bb-4408-8b6d-c2b717f8d045 1073741824 Jul 16 23:22:38 devstack sudo[94157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:38 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-c15e63b4-99db-4b17-b6d5-616215979384 tempest-VolumesActionsTest-945510952 None] Volume volume-663eb6a8-690a-4303-abc3-3756762a72a1 (663eb6a8-690a-4303-abc3-3756762a72a1): created successfully Jul 16 23:22:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c15e63b4-99db-4b17-b6d5-616215979384 tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1f8f4a3-dbc2-4fc6-9775-5ceb73dda9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c15e63b4-99db-4b17-b6d5-616215979384 tempest-VolumesActionsTest-945510952 None] Flow 'volume_create_manager' (7d85e8c9-31cf-459e-bfaf-bb1bf3fcf450) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:22:38 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-c15e63b4-99db-4b17-b6d5-616215979384 tempest-VolumesActionsTest-945510952 None] Created volume successfully. Jul 16 23:22:38 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-310b29e9-9a65-4700-9dac-63694b0613cd tempest-GroupSnapshotsTest-1525757492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:22:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-310b29e9-9a65-4700-9dac-63694b0613cd tempest-GroupSnapshotsTest-1525757492 None] Flow 'volume_create_manager' (42447deb-aec7-49d7-a8c1-e1a07b171211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:22:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-310b29e9-9a65-4700-9dac-63694b0613cd tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8201139d-b90c-4c41-b830-ad65146ddba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-310b29e9-9a65-4700-9dac-63694b0613cd tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8201139d-b90c-4c41-b830-ad65146ddba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-75218692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0cba2969-15aa-4bc7-af86-be1ea81d9acb,host='devstack@QuobyteHD#QuobyteHD',id=2e6fb8ae-931e-427f-94d7-ffa806a59007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dacfebbcb3a247b1a41b9e9e4edcd5d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:22:38Z,use_quota=True,user_id='29ffcc3ab5d0440aa66c49821dd86cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34b52c43-5f65-4edc-90dd-dfae031f1985),volume_type_id=34b52c43-5f65-4edc-90dd-dfae031f1985)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-310b29e9-9a65-4700-9dac-63694b0613cd tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eac7ded-1c33-44be-af94-64aa80513aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-310b29e9-9a65-4700-9dac-63694b0613cd tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eac7ded-1c33-44be-af94-64aa80513aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-310b29e9-9a65-4700-9dac-63694b0613cd tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b18ec4d-2df3-44e8-baad-510d44949791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-310b29e9-9a65-4700-9dac-63694b0613cd tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b18ec4d-2df3-44e8-baad-510d44949791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e6fb8ae-931e-427f-94d7-ffa806a59007', 'volume_name': 'volume-2e6fb8ae-931e-427f-94d7-ffa806a59007', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-310b29e9-9a65-4700-9dac-63694b0613cd tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e644fc1a-edb9-4b6e-a076-f8dfd87f0d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-310b29e9-9a65-4700-9dac-63694b0613cd tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e644fc1a-edb9-4b6e-a076-f8dfd87f0d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-310b29e9-9a65-4700-9dac-63694b0613cd tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1efcecb-6ad8-489e-ad00-04d9bfa228a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:38 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-310b29e9-9a65-4700-9dac-63694b0613cd tempest-GroupSnapshotsTest-1525757492 None] Volume 2e6fb8ae-931e-427f-94d7-ffa806a59007: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e6fb8ae-931e-427f-94d7-ffa806a59007', 'volume_size': 1} Jul 16 23:22:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-310b29e9-9a65-4700-9dac-63694b0613cd tempest-GroupSnapshotsTest-1525757492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:38 devstack sudo[94157]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5a4d88fa-ce6d-4fd9-9d1b-4487bb149431 tempest-VolumesListAdminTestJSON-961640462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a481a2cb-27bb-4408-8b6d-c2b717f8d045 1073741824" returned: 0 in 0.608s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5a4d88fa-ce6d-4fd9-9d1b-4487bb149431 tempest-VolumesListAdminTestJSON-961640462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a481a2cb-27bb-4408-8b6d-c2b717f8d045 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:38 devstack sudo[94169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a481a2cb-27bb-4408-8b6d-c2b717f8d045 Jul 16 23:22:38 devstack sudo[94169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:39 devstack sudo[94169]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5a4d88fa-ce6d-4fd9-9d1b-4487bb149431 tempest-VolumesListAdminTestJSON-961640462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a481a2cb-27bb-4408-8b6d-c2b717f8d045" returned: 0 in 0.249s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-5a4d88fa-ce6d-4fd9-9d1b-4487bb149431 tempest-VolumesListAdminTestJSON-961640462 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:22:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5a4d88fa-ce6d-4fd9-9d1b-4487bb149431 tempest-VolumesListAdminTestJSON-961640462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-310b29e9-9a65-4700-9dac-63694b0613cd tempest-GroupSnapshotsTest-1525757492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.446s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-310b29e9-9a65-4700-9dac-63694b0613cd tempest-GroupSnapshotsTest-1525757492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0cba2969-15aa-4bc7-af86-be1ea81d9acb,created_at=2026-07-16T21:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-75218692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0cba2969-15aa-4bc7-af86-be1ea81d9acb,host='devstack@QuobyteHD#QuobyteHD',id=2e6fb8ae-931e-427f-94d7-ffa806a59007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dacfebbcb3a247b1a41b9e9e4edcd5d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:22:38Z,use_quota=True,user_id='29ffcc3ab5d0440aa66c49821dd86cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34b52c43-5f65-4edc-90dd-dfae031f1985),volume_type_id=34b52c43-5f65-4edc-90dd-dfae031f1985)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:22:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-310b29e9-9a65-4700-9dac-63694b0613cd tempest-GroupSnapshotsTest-1525757492 None] Creating volume 2e6fb8ae-931e-427f-94d7-ffa806a59007 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:22:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-310b29e9-9a65-4700-9dac-63694b0613cd tempest-GroupSnapshotsTest-1525757492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-310b29e9-9a65-4700-9dac-63694b0613cd tempest-GroupSnapshotsTest-1525757492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-310b29e9-9a65-4700-9dac-63694b0613cd tempest-GroupSnapshotsTest-1525757492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:22:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-310b29e9-9a65-4700-9dac-63694b0613cd tempest-GroupSnapshotsTest-1525757492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:22:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-310b29e9-9a65-4700-9dac-63694b0613cd tempest-GroupSnapshotsTest-1525757492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-310b29e9-9a65-4700-9dac-63694b0613cd tempest-GroupSnapshotsTest-1525757492 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:22:39 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-310b29e9-9a65-4700-9dac-63694b0613cd tempest-GroupSnapshotsTest-1525757492 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:22:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-310b29e9-9a65-4700-9dac-63694b0613cd tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5a4d88fa-ce6d-4fd9-9d1b-4487bb149431 tempest-VolumesListAdminTestJSON-961640462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e3691e6-1bf6-4ab9-85bd-bdf635f066bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a481a2cb-27bb-4408-8b6d-c2b717f8d045', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5a4d88fa-ce6d-4fd9-9d1b-4487bb149431 tempest-VolumesListAdminTestJSON-961640462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (538b15d4-1886-43f7-8aa0-fcec492b475f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:39 devstack sudo[94172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007 1073741824 Jul 16 23:22:39 devstack sudo[94172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:39 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-5a4d88fa-ce6d-4fd9-9d1b-4487bb149431 tempest-VolumesListAdminTestJSON-961640462 None] Volume volume-a481a2cb-27bb-4408-8b6d-c2b717f8d045 (a481a2cb-27bb-4408-8b6d-c2b717f8d045): created successfully Jul 16 23:22:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5a4d88fa-ce6d-4fd9-9d1b-4487bb149431 tempest-VolumesListAdminTestJSON-961640462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (538b15d4-1886-43f7-8aa0-fcec492b475f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5a4d88fa-ce6d-4fd9-9d1b-4487bb149431 tempest-VolumesListAdminTestJSON-961640462 None] Flow 'volume_create_manager' (73c54d82-f066-4dac-8db8-b86d6bc99538) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:22:39 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-5a4d88fa-ce6d-4fd9-9d1b-4487bb149431 tempest-VolumesListAdminTestJSON-961640462 None] Created volume successfully. Jul 16 23:22:39 devstack cinder-volume[87607]: DEBUG oslo_service.periodic_task [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:22:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:22:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:22:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:39 devstack sudo[94178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:22:39 devstack sudo[94178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:39 devstack sudo[94172]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-310b29e9-9a65-4700-9dac-63694b0613cd tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007 1073741824" returned: 0 in 0.430s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-310b29e9-9a65-4700-9dac-63694b0613cd tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:39 devstack sudo[94180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007 Jul 16 23:22:39 devstack sudo[94180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:39 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0a031b5c-17d4-4e04-9273-f520400e2b6c tempest-VolumesActionsTest-170587690 None] Acquiring lock "cinder-663eb6a8-690a-4303-abc3-3756762a72a1-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:22:39 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0a031b5c-17d4-4e04-9273-f520400e2b6c tempest-VolumesActionsTest-170587690 None] Lock "cinder-663eb6a8-690a-4303-abc3-3756762a72a1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:22:39 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0a031b5c-17d4-4e04-9273-f520400e2b6c tempest-VolumesActionsTest-170587690 None] Acquiring lock "cinder-quobyte-663eb6a8-690a-4303-abc3-3756762a72a1" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:22:39 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0a031b5c-17d4-4e04-9273-f520400e2b6c tempest-VolumesActionsTest-170587690 None] Lock "cinder-quobyte-663eb6a8-690a-4303-abc3-3756762a72a1" acquired by "delete_volume" :: waited 0.017s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:22:39 devstack sudo[94178]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.262s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:39 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:22:39 devstack cinder-volume[87607]: DEBUG oslo_service.periodic_task [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running periodic task VolumeManager._thread_info {{(pid=87607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:22:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] thread count: 8 {{(pid=87607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 23:22:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] thread info: [<_MainThread(MainThread, started 139090403627136)>, , , , , , , ] {{(pid=87607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 23:22:39 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e45a16-c5c1-45f8-ae04-b2db093f4b80]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:22:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0a031b5c-17d4-4e04-9273-f520400e2b6c tempest-VolumesActionsTest-170587690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-663eb6a8-690a-4303-abc3-3756762a72a1 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:39 devstack sudo[94180]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-310b29e9-9a65-4700-9dac-63694b0613cd tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007" returned: 0 in 0.294s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-310b29e9-9a65-4700-9dac-63694b0613cd tempest-GroupSnapshotsTest-1525757492 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:22:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-310b29e9-9a65-4700-9dac-63694b0613cd tempest-GroupSnapshotsTest-1525757492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-310b29e9-9a65-4700-9dac-63694b0613cd tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1efcecb-6ad8-489e-ad00-04d9bfa228a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e6fb8ae-931e-427f-94d7-ffa806a59007', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:39 devstack sudo[94183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-663eb6a8-690a-4303-abc3-3756762a72a1 Jul 16 23:22:39 devstack sudo[94183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-310b29e9-9a65-4700-9dac-63694b0613cd tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8fdcea7-73c1-4eee-860e-71d6fddc302f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:39 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-310b29e9-9a65-4700-9dac-63694b0613cd tempest-GroupSnapshotsTest-1525757492 None] Volume volume-2e6fb8ae-931e-427f-94d7-ffa806a59007 (2e6fb8ae-931e-427f-94d7-ffa806a59007): created successfully Jul 16 23:22:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-310b29e9-9a65-4700-9dac-63694b0613cd tempest-GroupSnapshotsTest-1525757492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8fdcea7-73c1-4eee-860e-71d6fddc302f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-310b29e9-9a65-4700-9dac-63694b0613cd tempest-GroupSnapshotsTest-1525757492 None] Flow 'volume_create_manager' (42447deb-aec7-49d7-a8c1-e1a07b171211) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:22:39 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-310b29e9-9a65-4700-9dac-63694b0613cd tempest-GroupSnapshotsTest-1525757492 None] Created volume successfully. Jul 16 23:22:40 devstack sudo[94183]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0a031b5c-17d4-4e04-9273-f520400e2b6c tempest-VolumesActionsTest-170587690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-663eb6a8-690a-4303-abc3-3756762a72a1" returned: 0 in 0.424s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0a031b5c-17d4-4e04-9273-f520400e2b6c tempest-VolumesActionsTest-170587690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-663eb6a8-690a-4303-abc3-3756762a72a1 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:40 devstack sudo[94190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-663eb6a8-690a-4303-abc3-3756762a72a1 Jul 16 23:22:40 devstack sudo[94190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:40 devstack sudo[94190]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0a031b5c-17d4-4e04-9273-f520400e2b6c tempest-VolumesActionsTest-170587690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-663eb6a8-690a-4303-abc3-3756762a72a1" returned: 0 in 0.323s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:40 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0a031b5c-17d4-4e04-9273-f520400e2b6c tempest-VolumesActionsTest-170587690 None] Lock "cinder-quobyte-663eb6a8-690a-4303-abc3-3756762a72a1" released by "delete_volume" :: held 0.828s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:22:40 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-0a031b5c-17d4-4e04-9273-f520400e2b6c tempest-VolumesActionsTest-170587690 None] Created reservations ['e5f20410-32e9-400b-ae3e-bca20c235057', 'efe48b22-720a-4d76-9e56-5313cd32844b', 'b7ee87e3-2be5-400b-a756-95c2bd7361e1', '7e5a9fdd-c5c3-435a-8e84-d62548481a08'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:22:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0a031b5c-17d4-4e04-9273-f520400e2b6c tempest-VolumesActionsTest-170587690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0a031b5c-17d4-4e04-9273-f520400e2b6c tempest-VolumesActionsTest-170587690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:40 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0a031b5c-17d4-4e04-9273-f520400e2b6c tempest-VolumesActionsTest-170587690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:22:40 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0a031b5c-17d4-4e04-9273-f520400e2b6c tempest-VolumesActionsTest-170587690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:22:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0a031b5c-17d4-4e04-9273-f520400e2b6c tempest-VolumesActionsTest-170587690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0a031b5c-17d4-4e04-9273-f520400e2b6c tempest-VolumesActionsTest-170587690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:40 devstack sudo[94193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:22:40 devstack sudo[94193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:40 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca8d0d1e-5954-4115-a104-08105481cd88 tempest-VolumesListAdminTestJSON-1753835313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:22:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca8d0d1e-5954-4115-a104-08105481cd88 tempest-VolumesListAdminTestJSON-1753835313 None] Flow 'volume_create_manager' (087ede85-2150-4f09-8dcf-8977c27f6b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:22:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca8d0d1e-5954-4115-a104-08105481cd88 tempest-VolumesListAdminTestJSON-1753835313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b3addeb-138c-4136-9ffc-3765b5ebfcea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca8d0d1e-5954-4115-a104-08105481cd88 tempest-VolumesListAdminTestJSON-1753835313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b3addeb-138c-4136-9ffc-3765b5ebfcea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ca1e6b5-4f40-422a-b5ba-a8b3bab61b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26f6d65082b24efaaa6ea9f69d28d1ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:22:41Z,use_quota=True,user_id='3ced3868b8344636bc8f11cc3a82c6ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca8d0d1e-5954-4115-a104-08105481cd88 tempest-VolumesListAdminTestJSON-1753835313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13959e48-59ff-4ba7-bd71-faca89443943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca8d0d1e-5954-4115-a104-08105481cd88 tempest-VolumesListAdminTestJSON-1753835313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13959e48-59ff-4ba7-bd71-faca89443943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca8d0d1e-5954-4115-a104-08105481cd88 tempest-VolumesListAdminTestJSON-1753835313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47fd1c56-b7c8-4e78-bc85-e9123ae4d74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca8d0d1e-5954-4115-a104-08105481cd88 tempest-VolumesListAdminTestJSON-1753835313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47fd1c56-b7c8-4e78-bc85-e9123ae4d74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ca1e6b5-4f40-422a-b5ba-a8b3bab61b6f', 'volume_name': 'volume-8ca1e6b5-4f40-422a-b5ba-a8b3bab61b6f', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca8d0d1e-5954-4115-a104-08105481cd88 tempest-VolumesListAdminTestJSON-1753835313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f67d8a6-d3b5-4fce-9c52-6dad6a5e5e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca8d0d1e-5954-4115-a104-08105481cd88 tempest-VolumesListAdminTestJSON-1753835313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f67d8a6-d3b5-4fce-9c52-6dad6a5e5e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca8d0d1e-5954-4115-a104-08105481cd88 tempest-VolumesListAdminTestJSON-1753835313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14cc565e-f15b-4c50-9bdf-55994132d94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:40 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-ca8d0d1e-5954-4115-a104-08105481cd88 tempest-VolumesListAdminTestJSON-1753835313 None] Volume 8ca1e6b5-4f40-422a-b5ba-a8b3bab61b6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ca1e6b5-4f40-422a-b5ba-a8b3bab61b6f', 'volume_size': 1} Jul 16 23:22:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca8d0d1e-5954-4115-a104-08105481cd88 tempest-VolumesListAdminTestJSON-1753835313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca8d0d1e-5954-4115-a104-08105481cd88 tempest-VolumesListAdminTestJSON-1753835313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:40 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca8d0d1e-5954-4115-a104-08105481cd88 tempest-VolumesListAdminTestJSON-1753835313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ca1e6b5-4f40-422a-b5ba-a8b3bab61b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26f6d65082b24efaaa6ea9f69d28d1ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:22:41Z,use_quota=True,user_id='3ced3868b8344636bc8f11cc3a82c6ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:22:40 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-ca8d0d1e-5954-4115-a104-08105481cd88 tempest-VolumesListAdminTestJSON-1753835313 None] Creating volume 8ca1e6b5-4f40-422a-b5ba-a8b3bab61b6f {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:22:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca8d0d1e-5954-4115-a104-08105481cd88 tempest-VolumesListAdminTestJSON-1753835313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca8d0d1e-5954-4115-a104-08105481cd88 tempest-VolumesListAdminTestJSON-1753835313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:40 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca8d0d1e-5954-4115-a104-08105481cd88 tempest-VolumesListAdminTestJSON-1753835313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:22:40 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca8d0d1e-5954-4115-a104-08105481cd88 tempest-VolumesListAdminTestJSON-1753835313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:22:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca8d0d1e-5954-4115-a104-08105481cd88 tempest-VolumesListAdminTestJSON-1753835313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:40 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca8d0d1e-5954-4115-a104-08105481cd88 tempest-VolumesListAdminTestJSON-1753835313 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:22:40 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-ca8d0d1e-5954-4115-a104-08105481cd88 tempest-VolumesListAdminTestJSON-1753835313 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:22:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca8d0d1e-5954-4115-a104-08105481cd88 tempest-VolumesListAdminTestJSON-1753835313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8ca1e6b5-4f40-422a-b5ba-a8b3bab61b6f 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:40 devstack sudo[94195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8ca1e6b5-4f40-422a-b5ba-a8b3bab61b6f 1073741824 Jul 16 23:22:40 devstack sudo[94195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:41 devstack sudo[94193]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0a031b5c-17d4-4e04-9273-f520400e2b6c tempest-VolumesActionsTest-170587690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.363s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:41 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-0a031b5c-17d4-4e04-9273-f520400e2b6c tempest-VolumesActionsTest-170587690 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:22:41 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-0a031b5c-17d4-4e04-9273-f520400e2b6c tempest-VolumesActionsTest-170587690 None] Deleted volume successfully. Jul 16 23:22:41 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0a031b5c-17d4-4e04-9273-f520400e2b6c tempest-VolumesActionsTest-170587690 None] Lock "cinder-663eb6a8-690a-4303-abc3-3756762a72a1-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:22:41 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-eebac040-7d16-4ece-aed6-38dcd908a7bf tempest-GroupSnapshotsTest-1525757492 None] GroupSnapshot bb303a8a-46f3-46a0-9a4b-8b1fba02715e: creating. Jul 16 23:22:41 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d91ab7b-96fd-4e8c-a29d-5cc599252aca tempest-VolumesActionsTest-945510952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:22:41 devstack sudo[94195]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1d91ab7b-96fd-4e8c-a29d-5cc599252aca tempest-VolumesActionsTest-945510952 None] Flow 'volume_create_manager' (0bcae44d-dedf-465d-91f7-8612d2af0903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:22:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1d91ab7b-96fd-4e8c-a29d-5cc599252aca tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3fba47d-e201-487d-bfc7-61a25ea132be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca8d0d1e-5954-4115-a104-08105481cd88 tempest-VolumesListAdminTestJSON-1753835313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8ca1e6b5-4f40-422a-b5ba-a8b3bab61b6f 1073741824" returned: 0 in 0.889s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-eebac040-7d16-4ece-aed6-38dcd908a7bf tempest-GroupSnapshotsTest-1525757492 None] Group snapshot bb303a8a-46f3-46a0-9a4b-8b1fba02715e: creating. {{(pid=87607) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 16 23:22:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1d91ab7b-96fd-4e8c-a29d-5cc599252aca tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3fba47d-e201-487d-bfc7-61a25ea132be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1150960565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=186ce9a6-cffd-4828-a058-d404110a8470,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b6831797d7e401cb13e3160cc927031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:22:42Z,use_quota=True,user_id='09da365af4e94489a1407a040f05c1c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1d91ab7b-96fd-4e8c-a29d-5cc599252aca tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75a7dd29-18d8-458f-b4ff-baf363431aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1d91ab7b-96fd-4e8c-a29d-5cc599252aca tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75a7dd29-18d8-458f-b4ff-baf363431aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1d91ab7b-96fd-4e8c-a29d-5cc599252aca tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e5400d0-06ce-4a7b-ac3f-0f6420036ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1d91ab7b-96fd-4e8c-a29d-5cc599252aca tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e5400d0-06ce-4a7b-ac3f-0f6420036ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '186ce9a6-cffd-4828-a058-d404110a8470', 'volume_name': 'volume-186ce9a6-cffd-4828-a058-d404110a8470', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1d91ab7b-96fd-4e8c-a29d-5cc599252aca tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb718e34-93f4-42fd-9421-6eb17a0e87c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1d91ab7b-96fd-4e8c-a29d-5cc599252aca tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb718e34-93f4-42fd-9421-6eb17a0e87c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1d91ab7b-96fd-4e8c-a29d-5cc599252aca tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21573f77-fb1d-4b89-97c0-bc5cd314d239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:41 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-1d91ab7b-96fd-4e8c-a29d-5cc599252aca tempest-VolumesActionsTest-945510952 None] Volume 186ce9a6-cffd-4828-a058-d404110a8470: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-186ce9a6-cffd-4828-a058-d404110a8470', 'volume_size': 1} Jul 16 23:22:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1d91ab7b-96fd-4e8c-a29d-5cc599252aca tempest-VolumesActionsTest-945510952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-eebac040-7d16-4ece-aed6-38dcd908a7bf tempest-GroupSnapshotsTest-1525757492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca8d0d1e-5954-4115-a104-08105481cd88 tempest-VolumesListAdminTestJSON-1753835313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8ca1e6b5-4f40-422a-b5ba-a8b3bab61b6f {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:41 devstack sudo[94225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8ca1e6b5-4f40-422a-b5ba-a8b3bab61b6f Jul 16 23:22:42 devstack sudo[94225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:42 devstack sudo[94225]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca8d0d1e-5954-4115-a104-08105481cd88 tempest-VolumesListAdminTestJSON-1753835313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8ca1e6b5-4f40-422a-b5ba-a8b3bab61b6f" returned: 0 in 0.304s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:42 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca8d0d1e-5954-4115-a104-08105481cd88 tempest-VolumesListAdminTestJSON-1753835313 None] <== create_volume: return (1381ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:22:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca8d0d1e-5954-4115-a104-08105481cd88 tempest-VolumesListAdminTestJSON-1753835313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.385s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1d91ab7b-96fd-4e8c-a29d-5cc599252aca tempest-VolumesActionsTest-945510952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.357s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:42 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1d91ab7b-96fd-4e8c-a29d-5cc599252aca tempest-VolumesActionsTest-945510952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1150960565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=186ce9a6-cffd-4828-a058-d404110a8470,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b6831797d7e401cb13e3160cc927031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:22:42Z,use_quota=True,user_id='09da365af4e94489a1407a040f05c1c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:22:42 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-1d91ab7b-96fd-4e8c-a29d-5cc599252aca tempest-VolumesActionsTest-945510952 None] Creating volume 186ce9a6-cffd-4828-a058-d404110a8470 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:22:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1d91ab7b-96fd-4e8c-a29d-5cc599252aca tempest-VolumesActionsTest-945510952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1d91ab7b-96fd-4e8c-a29d-5cc599252aca tempest-VolumesActionsTest-945510952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:42 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1d91ab7b-96fd-4e8c-a29d-5cc599252aca tempest-VolumesActionsTest-945510952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:22:42 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1d91ab7b-96fd-4e8c-a29d-5cc599252aca tempest-VolumesActionsTest-945510952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:22:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1d91ab7b-96fd-4e8c-a29d-5cc599252aca tempest-VolumesActionsTest-945510952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:42 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1d91ab7b-96fd-4e8c-a29d-5cc599252aca tempest-VolumesActionsTest-945510952 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:22:42 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-1d91ab7b-96fd-4e8c-a29d-5cc599252aca tempest-VolumesActionsTest-945510952 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:22:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1d91ab7b-96fd-4e8c-a29d-5cc599252aca tempest-VolumesActionsTest-945510952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-186ce9a6-cffd-4828-a058-d404110a8470 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca8d0d1e-5954-4115-a104-08105481cd88 tempest-VolumesListAdminTestJSON-1753835313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14cc565e-f15b-4c50-9bdf-55994132d94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ca1e6b5-4f40-422a-b5ba-a8b3bab61b6f', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca8d0d1e-5954-4115-a104-08105481cd88 tempest-VolumesListAdminTestJSON-1753835313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (734a0d29-b8c3-4ab7-ba99-90d902ab4eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:42 devstack sudo[94233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-186ce9a6-cffd-4828-a058-d404110a8470 1073741824 Jul 16 23:22:42 devstack sudo[94233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:42 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-ca8d0d1e-5954-4115-a104-08105481cd88 tempest-VolumesListAdminTestJSON-1753835313 None] Volume volume-8ca1e6b5-4f40-422a-b5ba-a8b3bab61b6f (8ca1e6b5-4f40-422a-b5ba-a8b3bab61b6f): created successfully Jul 16 23:22:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca8d0d1e-5954-4115-a104-08105481cd88 tempest-VolumesListAdminTestJSON-1753835313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (734a0d29-b8c3-4ab7-ba99-90d902ab4eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca8d0d1e-5954-4115-a104-08105481cd88 tempest-VolumesListAdminTestJSON-1753835313 None] Flow 'volume_create_manager' (087ede85-2150-4f09-8dcf-8977c27f6b78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:22:42 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-ca8d0d1e-5954-4115-a104-08105481cd88 tempest-VolumesListAdminTestJSON-1753835313 None] Created volume successfully. Jul 16 23:22:43 devstack sudo[94233]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1d91ab7b-96fd-4e8c-a29d-5cc599252aca tempest-VolumesActionsTest-945510952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-186ce9a6-cffd-4828-a058-d404110a8470 1073741824" returned: 0 in 0.823s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1d91ab7b-96fd-4e8c-a29d-5cc599252aca tempest-VolumesActionsTest-945510952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-186ce9a6-cffd-4828-a058-d404110a8470 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:43 devstack sudo[94297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-186ce9a6-cffd-4828-a058-d404110a8470 Jul 16 23:22:43 devstack sudo[94297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:43 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ce7b8703-3334-4aa5-a0c3-298dff70c2a8 tempest-VolumesListAdminTestJSON-1753835313 None] Acquiring lock "cinder-8ca1e6b5-4f40-422a-b5ba-a8b3bab61b6f-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:22:43 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ce7b8703-3334-4aa5-a0c3-298dff70c2a8 tempest-VolumesListAdminTestJSON-1753835313 None] Lock "cinder-8ca1e6b5-4f40-422a-b5ba-a8b3bab61b6f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:22:43 devstack sudo[94297]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1d91ab7b-96fd-4e8c-a29d-5cc599252aca tempest-VolumesActionsTest-945510952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-186ce9a6-cffd-4828-a058-d404110a8470" returned: 0 in 0.449s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1d91ab7b-96fd-4e8c-a29d-5cc599252aca tempest-VolumesActionsTest-945510952 None] <== create_volume: return (1350ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:22:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1d91ab7b-96fd-4e8c-a29d-5cc599252aca tempest-VolumesActionsTest-945510952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-eebac040-7d16-4ece-aed6-38dcd908a7bf tempest-GroupSnapshotsTest-1525757492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.707s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:43 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ce7b8703-3334-4aa5-a0c3-298dff70c2a8 tempest-VolumesListAdminTestJSON-1753835313 None] Acquiring lock "cinder-quobyte-8ca1e6b5-4f40-422a-b5ba-a8b3bab61b6f" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:22:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1d91ab7b-96fd-4e8c-a29d-5cc599252aca tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21573f77-fb1d-4b89-97c0-bc5cd314d239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-186ce9a6-cffd-4828-a058-d404110a8470', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1d91ab7b-96fd-4e8c-a29d-5cc599252aca tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2279b9ae-7e57-4d65-a028-25cee80f3440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:43 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ce7b8703-3334-4aa5-a0c3-298dff70c2a8 tempest-VolumesListAdminTestJSON-1753835313 None] Lock "cinder-quobyte-8ca1e6b5-4f40-422a-b5ba-a8b3bab61b6f" acquired by "delete_volume" :: waited 0.038s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:22:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-eebac040-7d16-4ece-aed6-38dcd908a7bf tempest-GroupSnapshotsTest-1525757492 None] Creating offline snapshot 8977739b-c8d4-404a-8bb6-afc7eef673a6 of volume 2e6fb8ae-931e-427f-94d7-ffa806a59007 {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:22:43 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f03fb6a-ff11-4535-b0e2-a79510a22c04]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:22:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ce7b8703-3334-4aa5-a0c3-298dff70c2a8 tempest-VolumesListAdminTestJSON-1753835313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8ca1e6b5-4f40-422a-b5ba-a8b3bab61b6f {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:43 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-1d91ab7b-96fd-4e8c-a29d-5cc599252aca tempest-VolumesActionsTest-945510952 None] Volume volume-186ce9a6-cffd-4828-a058-d404110a8470 (186ce9a6-cffd-4828-a058-d404110a8470): created successfully Jul 16 23:22:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1d91ab7b-96fd-4e8c-a29d-5cc599252aca tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2279b9ae-7e57-4d65-a028-25cee80f3440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1d91ab7b-96fd-4e8c-a29d-5cc599252aca tempest-VolumesActionsTest-945510952 None] Flow 'volume_create_manager' (0bcae44d-dedf-465d-91f7-8612d2af0903) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:22:43 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d15bc71-6c98-4aa2-a6bc-ebd35879517c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:22:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-eebac040-7d16-4ece-aed6-38dcd908a7bf tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:43 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-1d91ab7b-96fd-4e8c-a29d-5cc599252aca tempest-VolumesActionsTest-945510952 None] Created volume successfully. Jul 16 23:22:43 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-a4d9789c-9252-449a-9ce6-770ffa496e6d tempest-VolumesListAdminTestJSON-961640462 None] Acquiring lock "cinder-a481a2cb-27bb-4408-8b6d-c2b717f8d045-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:22:43 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-a4d9789c-9252-449a-9ce6-770ffa496e6d tempest-VolumesListAdminTestJSON-961640462 None] Lock "cinder-a481a2cb-27bb-4408-8b6d-c2b717f8d045-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:22:43 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-a4d9789c-9252-449a-9ce6-770ffa496e6d tempest-VolumesListAdminTestJSON-961640462 None] Acquiring lock "cinder-quobyte-a481a2cb-27bb-4408-8b6d-c2b717f8d045" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:22:43 devstack sudo[94308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8ca1e6b5-4f40-422a-b5ba-a8b3bab61b6f Jul 16 23:22:43 devstack sudo[94308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:43 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-a4d9789c-9252-449a-9ce6-770ffa496e6d tempest-VolumesListAdminTestJSON-961640462 None] Lock "cinder-quobyte-a481a2cb-27bb-4408-8b6d-c2b717f8d045" acquired by "delete_volume" :: waited 0.015s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:22:43 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab0ea03-19ee-454e-81cf-d8afe9b948c4]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:22:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a4d9789c-9252-449a-9ce6-770ffa496e6d tempest-VolumesListAdminTestJSON-961640462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a481a2cb-27bb-4408-8b6d-c2b717f8d045 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:43 devstack sudo[94309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007 Jul 16 23:22:43 devstack sudo[94309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:44 devstack sudo[94312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a481a2cb-27bb-4408-8b6d-c2b717f8d045 Jul 16 23:22:44 devstack sudo[94312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:44 devstack sudo[94308]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ce7b8703-3334-4aa5-a0c3-298dff70c2a8 tempest-VolumesListAdminTestJSON-1753835313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8ca1e6b5-4f40-422a-b5ba-a8b3bab61b6f" returned: 0 in 0.599s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ce7b8703-3334-4aa5-a0c3-298dff70c2a8 tempest-VolumesListAdminTestJSON-1753835313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8ca1e6b5-4f40-422a-b5ba-a8b3bab61b6f {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:44 devstack sudo[94322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8ca1e6b5-4f40-422a-b5ba-a8b3bab61b6f Jul 16 23:22:44 devstack sudo[94322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:44 devstack sudo[94309]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-eebac040-7d16-4ece-aed6-38dcd908a7bf tempest-GroupSnapshotsTest-1525757492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007" returned: 0 in 0.710s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-eebac040-7d16-4ece-aed6-38dcd908a7bf tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007.8977739b-c8d4-404a-8bb6-afc7eef673a6 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:44 devstack sudo[94325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007.8977739b-c8d4-404a-8bb6-afc7eef673a6 1G Jul 16 23:22:44 devstack sudo[94325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:44 devstack sudo[94312]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a4d9789c-9252-449a-9ce6-770ffa496e6d tempest-VolumesListAdminTestJSON-961640462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a481a2cb-27bb-4408-8b6d-c2b717f8d045" returned: 0 in 0.672s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a4d9789c-9252-449a-9ce6-770ffa496e6d tempest-VolumesListAdminTestJSON-961640462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a481a2cb-27bb-4408-8b6d-c2b717f8d045 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:44 devstack sudo[94331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a481a2cb-27bb-4408-8b6d-c2b717f8d045 Jul 16 23:22:44 devstack sudo[94331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:44 devstack sudo[94322]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ce7b8703-3334-4aa5-a0c3-298dff70c2a8 tempest-VolumesListAdminTestJSON-1753835313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8ca1e6b5-4f40-422a-b5ba-a8b3bab61b6f" returned: 0 in 0.501s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:44 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ce7b8703-3334-4aa5-a0c3-298dff70c2a8 tempest-VolumesListAdminTestJSON-1753835313 None] Lock "cinder-quobyte-8ca1e6b5-4f40-422a-b5ba-a8b3bab61b6f" released by "delete_volume" :: held 1.158s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:22:44 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-ce7b8703-3334-4aa5-a0c3-298dff70c2a8 tempest-VolumesListAdminTestJSON-1753835313 None] Created reservations ['fad5e39d-5448-4b8e-8417-96f1b64ab241', 'c24dec00-9352-419f-8698-88c74c958cbc', '8877fcc7-6801-46ec-88e2-6b1eb5ca8970', '73962582-7299-45ba-8c4c-90b9e8236d79'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:22:45 devstack sudo[94331]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a4d9789c-9252-449a-9ce6-770ffa496e6d tempest-VolumesListAdminTestJSON-961640462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a481a2cb-27bb-4408-8b6d-c2b717f8d045" returned: 0 in 0.494s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:45 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f6baaebf-fe56-4f83-8c07-537c7739b761 tempest-VolumesActionsTest-170587690 None] Acquiring lock "cinder-186ce9a6-cffd-4828-a058-d404110a8470-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:22:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ce7b8703-3334-4aa5-a0c3-298dff70c2a8 tempest-VolumesListAdminTestJSON-1753835313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ce7b8703-3334-4aa5-a0c3-298dff70c2a8 tempest-VolumesListAdminTestJSON-1753835313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:45 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ce7b8703-3334-4aa5-a0c3-298dff70c2a8 tempest-VolumesListAdminTestJSON-1753835313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:22:45 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ce7b8703-3334-4aa5-a0c3-298dff70c2a8 tempest-VolumesListAdminTestJSON-1753835313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:22:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ce7b8703-3334-4aa5-a0c3-298dff70c2a8 tempest-VolumesListAdminTestJSON-1753835313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ce7b8703-3334-4aa5-a0c3-298dff70c2a8 tempest-VolumesListAdminTestJSON-1753835313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:45 devstack sudo[94325]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:45 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-a4d9789c-9252-449a-9ce6-770ffa496e6d tempest-VolumesListAdminTestJSON-961640462 None] Lock "cinder-quobyte-a481a2cb-27bb-4408-8b6d-c2b717f8d045" released by "delete_volume" :: held 1.299s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:22:45 devstack sudo[94342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:22:45 devstack sudo[94342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:45 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f6baaebf-fe56-4f83-8c07-537c7739b761 tempest-VolumesActionsTest-170587690 None] Lock "cinder-186ce9a6-cffd-4828-a058-d404110a8470-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:22:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-eebac040-7d16-4ece-aed6-38dcd908a7bf tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007.8977739b-c8d4-404a-8bb6-afc7eef673a6 1G" returned: 0 in 0.785s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-eebac040-7d16-4ece-aed6-38dcd908a7bf tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e6fb8ae-931e-427f-94d7-ffa806a59007 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007.8977739b-c8d4-404a-8bb6-afc7eef673a6 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:45 devstack sudo[94344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e6fb8ae-931e-427f-94d7-ffa806a59007 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007.8977739b-c8d4-404a-8bb6-afc7eef673a6 Jul 16 23:22:45 devstack sudo[94344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:45 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f6baaebf-fe56-4f83-8c07-537c7739b761 tempest-VolumesActionsTest-170587690 None] Acquiring lock "cinder-quobyte-186ce9a6-cffd-4828-a058-d404110a8470" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:22:45 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f6baaebf-fe56-4f83-8c07-537c7739b761 tempest-VolumesActionsTest-170587690 None] Lock "cinder-quobyte-186ce9a6-cffd-4828-a058-d404110a8470" acquired by "delete_volume" :: waited 0.035s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:22:45 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-a4d9789c-9252-449a-9ce6-770ffa496e6d tempest-VolumesListAdminTestJSON-961640462 None] Created reservations ['3fd5e7a9-e8be-4567-a3a8-af6966e42f1e', 'a5449ad5-ced4-4a29-8ebc-53190e7af218', 'f947cc74-e815-4afd-b3b1-2c5859ed61dc', '3a18d764-9aa0-4173-a3d2-11978d3a5cd5'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:22:45 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd90fb7-4984-4663-9091-9b131c4eaebe]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:22:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f6baaebf-fe56-4f83-8c07-537c7739b761 tempest-VolumesActionsTest-170587690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-186ce9a6-cffd-4828-a058-d404110a8470 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a4d9789c-9252-449a-9ce6-770ffa496e6d tempest-VolumesListAdminTestJSON-961640462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a4d9789c-9252-449a-9ce6-770ffa496e6d tempest-VolumesListAdminTestJSON-961640462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:45 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a4d9789c-9252-449a-9ce6-770ffa496e6d tempest-VolumesListAdminTestJSON-961640462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:22:45 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a4d9789c-9252-449a-9ce6-770ffa496e6d tempest-VolumesListAdminTestJSON-961640462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:22:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a4d9789c-9252-449a-9ce6-770ffa496e6d tempest-VolumesListAdminTestJSON-961640462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a4d9789c-9252-449a-9ce6-770ffa496e6d tempest-VolumesListAdminTestJSON-961640462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:45 devstack sudo[94348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:22:45 devstack sudo[94348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:45 devstack sudo[94342]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ce7b8703-3334-4aa5-a0c3-298dff70c2a8 tempest-VolumesListAdminTestJSON-1753835313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.388s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:45 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-ce7b8703-3334-4aa5-a0c3-298dff70c2a8 tempest-VolumesListAdminTestJSON-1753835313 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:22:45 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-ce7b8703-3334-4aa5-a0c3-298dff70c2a8 tempest-VolumesListAdminTestJSON-1753835313 None] Deleted volume successfully. Jul 16 23:22:45 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ce7b8703-3334-4aa5-a0c3-298dff70c2a8 tempest-VolumesListAdminTestJSON-1753835313 None] Lock "cinder-8ca1e6b5-4f40-422a-b5ba-a8b3bab61b6f-delete_volume" released by "delete_volume" :: held 2.021s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:22:45 devstack sudo[94346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-186ce9a6-cffd-4828-a058-d404110a8470 Jul 16 23:22:45 devstack sudo[94346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:45 devstack sudo[94344]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-eebac040-7d16-4ece-aed6-38dcd908a7bf tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e6fb8ae-931e-427f-94d7-ffa806a59007 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007.8977739b-c8d4-404a-8bb6-afc7eef673a6" returned: 0 in 0.420s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:45 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-eebac040-7d16-4ece-aed6-38dcd908a7bf tempest-GroupSnapshotsTest-1525757492 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007.8977739b-c8d4-404a-8bb6-afc7eef673a6 is being set with open permissions: ugo+rw: NotImplementedError Jul 16 23:22:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-eebac040-7d16-4ece-aed6-38dcd908a7bf tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007.8977739b-c8d4-404a-8bb6-afc7eef673a6 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:45 devstack sudo[94355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007.8977739b-c8d4-404a-8bb6-afc7eef673a6 Jul 16 23:22:45 devstack sudo[94355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:45 devstack sudo[94348]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a4d9789c-9252-449a-9ce6-770ffa496e6d tempest-VolumesListAdminTestJSON-961640462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.321s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:45 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-a4d9789c-9252-449a-9ce6-770ffa496e6d tempest-VolumesListAdminTestJSON-961640462 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:22:45 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-a4d9789c-9252-449a-9ce6-770ffa496e6d tempest-VolumesListAdminTestJSON-961640462 None] Deleted volume successfully. Jul 16 23:22:45 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-a4d9789c-9252-449a-9ce6-770ffa496e6d tempest-VolumesListAdminTestJSON-961640462 None] Lock "cinder-a481a2cb-27bb-4408-8b6d-c2b717f8d045-delete_volume" released by "delete_volume" :: held 1.998s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:22:45 devstack sudo[94346]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f6baaebf-fe56-4f83-8c07-537c7739b761 tempest-VolumesActionsTest-170587690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-186ce9a6-cffd-4828-a058-d404110a8470" returned: 0 in 0.568s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f6baaebf-fe56-4f83-8c07-537c7739b761 tempest-VolumesActionsTest-170587690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-186ce9a6-cffd-4828-a058-d404110a8470 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:45 devstack sudo[94355]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-eebac040-7d16-4ece-aed6-38dcd908a7bf tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007.8977739b-c8d4-404a-8bb6-afc7eef673a6" returned: 0 in 0.324s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:45 devstack sudo[94363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-186ce9a6-cffd-4828-a058-d404110a8470 Jul 16 23:22:45 devstack sudo[94363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-eebac040-7d16-4ece-aed6-38dcd908a7bf tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:46 devstack sudo[94365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007.info Jul 16 23:22:46 devstack sudo[94365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:46 devstack sudo[94363]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f6baaebf-fe56-4f83-8c07-537c7739b761 tempest-VolumesActionsTest-170587690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-186ce9a6-cffd-4828-a058-d404110a8470" returned: 0 in 0.351s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:46 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f6baaebf-fe56-4f83-8c07-537c7739b761 tempest-VolumesActionsTest-170587690 None] Lock "cinder-quobyte-186ce9a6-cffd-4828-a058-d404110a8470" released by "delete_volume" :: held 1.000s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:22:46 devstack sudo[94365]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-eebac040-7d16-4ece-aed6-38dcd908a7bf tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007.info" returned: 0 in 0.389s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:46 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-eebac040-7d16-4ece-aed6-38dcd908a7bf tempest-GroupSnapshotsTest-1525757492 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007.info is being set with open permissions: ugo+rw: NotImplementedError Jul 16 23:22:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-eebac040-7d16-4ece-aed6-38dcd908a7bf tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:46 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e648b90a-a169-4e92-b079-81de806375a9 tempest-VolumesListAdminTestJSON-961640462 None] Acquiring lock "cinder-3109e230-dd74-411b-9741-02ea29369a31-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:22:46 devstack sudo[94371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007.info Jul 16 23:22:46 devstack sudo[94371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:46 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-f6baaebf-fe56-4f83-8c07-537c7739b761 tempest-VolumesActionsTest-170587690 None] Created reservations ['61bfcb9e-6332-4ab5-a8eb-cf02dc6f7927', '3c2c0065-e66d-4a23-a4bf-b260fa142b84', '83d67896-7b50-43a7-87fa-6a1aae5c20b8', 'a1a732d0-41ad-4408-b7e6-a765d215c363'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:22:46 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e648b90a-a169-4e92-b079-81de806375a9 tempest-VolumesListAdminTestJSON-961640462 None] Lock "cinder-3109e230-dd74-411b-9741-02ea29369a31-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:22:46 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e648b90a-a169-4e92-b079-81de806375a9 tempest-VolumesListAdminTestJSON-961640462 None] Acquiring lock "cinder-quobyte-3109e230-dd74-411b-9741-02ea29369a31" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:22:46 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e648b90a-a169-4e92-b079-81de806375a9 tempest-VolumesListAdminTestJSON-961640462 None] Lock "cinder-quobyte-3109e230-dd74-411b-9741-02ea29369a31" acquired by "delete_volume" :: waited 0.026s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:22:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f6baaebf-fe56-4f83-8c07-537c7739b761 tempest-VolumesActionsTest-170587690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f6baaebf-fe56-4f83-8c07-537c7739b761 tempest-VolumesActionsTest-170587690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:46 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f6baaebf-fe56-4f83-8c07-537c7739b761 tempest-VolumesActionsTest-170587690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:22:46 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f6baaebf-fe56-4f83-8c07-537c7739b761 tempest-VolumesActionsTest-170587690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:22:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f6baaebf-fe56-4f83-8c07-537c7739b761 tempest-VolumesActionsTest-170587690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f6baaebf-fe56-4f83-8c07-537c7739b761 tempest-VolumesActionsTest-170587690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:46 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[1757a83d-24c5-4861-884c-51e64aa5f550]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:22:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e648b90a-a169-4e92-b079-81de806375a9 tempest-VolumesListAdminTestJSON-961640462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3109e230-dd74-411b-9741-02ea29369a31 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:46 devstack sudo[94373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:22:46 devstack sudo[94373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:46 devstack sudo[94374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3109e230-dd74-411b-9741-02ea29369a31 Jul 16 23:22:46 devstack sudo[94374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:46 devstack sudo[94371]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-eebac040-7d16-4ece-aed6-38dcd908a7bf tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007.info" returned: 0 in 0.343s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-eebac040-7d16-4ece-aed6-38dcd908a7bf tempest-GroupSnapshotsTest-1525757492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.141s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:46 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-eebac040-7d16-4ece-aed6-38dcd908a7bf tempest-GroupSnapshotsTest-1525757492 None] group_snapshot bb303a8a-46f3-46a0-9a4b-8b1fba02715e: created successfully Jul 16 23:22:46 devstack sudo[94373]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f6baaebf-fe56-4f83-8c07-537c7739b761 tempest-VolumesActionsTest-170587690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.313s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:46 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-f6baaebf-fe56-4f83-8c07-537c7739b761 tempest-VolumesActionsTest-170587690 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:22:46 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-f6baaebf-fe56-4f83-8c07-537c7739b761 tempest-VolumesActionsTest-170587690 None] Deleted volume successfully. Jul 16 23:22:46 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f6baaebf-fe56-4f83-8c07-537c7739b761 tempest-VolumesActionsTest-170587690 None] Lock "cinder-186ce9a6-cffd-4828-a058-d404110a8470-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:22:47 devstack sudo[94374]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e648b90a-a169-4e92-b079-81de806375a9 tempest-VolumesListAdminTestJSON-961640462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3109e230-dd74-411b-9741-02ea29369a31" returned: 0 in 0.445s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e648b90a-a169-4e92-b079-81de806375a9 tempest-VolumesListAdminTestJSON-961640462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3109e230-dd74-411b-9741-02ea29369a31 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:47 devstack sudo[94383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3109e230-dd74-411b-9741-02ea29369a31 Jul 16 23:22:47 devstack sudo[94383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:47 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-fc47216f-1dfe-41c9-ada0-9069d16e69fd tempest-GroupSnapshotsTest-1525757492 None] group_snapshot bb303a8a-46f3-46a0-9a4b-8b1fba02715e: deleting Jul 16 23:22:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-fc47216f-1dfe-41c9-ada0-9069d16e69fd tempest-GroupSnapshotsTest-1525757492 None] group_snapshot bb303a8a-46f3-46a0-9a4b-8b1fba02715e: deleting {{(pid=87607) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 16 23:22:47 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fc47216f-1dfe-41c9-ada0-9069d16e69fd tempest-GroupSnapshotsTest-1525757492 None] Acquiring lock "cinder-quobyte-2e6fb8ae-931e-427f-94d7-ffa806a59007" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:22:47 devstack sudo[94383]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e648b90a-a169-4e92-b079-81de806375a9 tempest-VolumesListAdminTestJSON-961640462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3109e230-dd74-411b-9741-02ea29369a31" returned: 0 in 0.296s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:47 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fc47216f-1dfe-41c9-ada0-9069d16e69fd tempest-GroupSnapshotsTest-1525757492 None] Lock "cinder-quobyte-2e6fb8ae-931e-427f-94d7-ffa806a59007" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:22:47 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fc47216f-1dfe-41c9-ada0-9069d16e69fd tempest-GroupSnapshotsTest-1525757492 None] Acquiring lock "cinder-quobyte-8977739b-c8d4-404a-8bb6-afc7eef673a6" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:22:47 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e648b90a-a169-4e92-b079-81de806375a9 tempest-VolumesListAdminTestJSON-961640462 None] Lock "cinder-quobyte-3109e230-dd74-411b-9741-02ea29369a31" released by "delete_volume" :: held 0.829s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:22:47 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fc47216f-1dfe-41c9-ada0-9069d16e69fd tempest-GroupSnapshotsTest-1525757492 None] Lock "cinder-quobyte-8977739b-c8d4-404a-8bb6-afc7eef673a6" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:22:47 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-fc47216f-1dfe-41c9-ada0-9069d16e69fd tempest-GroupSnapshotsTest-1525757492 None] Deleting offline snapshot 8977739b-c8d4-404a-8bb6-afc7eef673a6 of volume 2e6fb8ae-931e-427f-94d7-ffa806a59007 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:22:47 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-fc47216f-1dfe-41c9-ada0-9069d16e69fd tempest-GroupSnapshotsTest-1525757492 None] snapshot_file for this snap is: volume-2e6fb8ae-931e-427f-94d7-ffa806a59007.8977739b-c8d4-404a-8bb6-afc7eef673a6 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:22:47 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9241c11-66b0-4071-b8eb-089a0e85c7b5]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:22:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fc47216f-1dfe-41c9-ada0-9069d16e69fd tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007.8977739b-c8d4-404a-8bb6-afc7eef673a6 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:47 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-e648b90a-a169-4e92-b079-81de806375a9 tempest-VolumesListAdminTestJSON-961640462 None] Created reservations ['6b2b970f-edb2-4c90-961c-660e7279f61a', '5b745358-fe2e-42c7-86b0-10cba633c50e', '3e400fb1-84e8-4fbc-a3b9-87e410a562c3', '7dd9aff6-b827-45ac-992f-28cf14c0aafd'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:22:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e648b90a-a169-4e92-b079-81de806375a9 tempest-VolumesListAdminTestJSON-961640462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e648b90a-a169-4e92-b079-81de806375a9 tempest-VolumesListAdminTestJSON-961640462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:47 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e648b90a-a169-4e92-b079-81de806375a9 tempest-VolumesListAdminTestJSON-961640462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:22:47 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e648b90a-a169-4e92-b079-81de806375a9 tempest-VolumesListAdminTestJSON-961640462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:22:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e648b90a-a169-4e92-b079-81de806375a9 tempest-VolumesListAdminTestJSON-961640462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e648b90a-a169-4e92-b079-81de806375a9 tempest-VolumesListAdminTestJSON-961640462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:47 devstack sudo[94386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007.8977739b-c8d4-404a-8bb6-afc7eef673a6 Jul 16 23:22:47 devstack sudo[94386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:47 devstack sudo[94388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:22:47 devstack sudo[94388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:47 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-12dec8d5-d83a-4297-b28c-357bae49fb1f tempest-VolumesListAdminTestJSON-961640462 None] Acquiring lock "cinder-0586dcb9-79b8-477a-889e-bcdda9d7234f-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:22:47 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-12dec8d5-d83a-4297-b28c-357bae49fb1f tempest-VolumesListAdminTestJSON-961640462 None] Lock "cinder-0586dcb9-79b8-477a-889e-bcdda9d7234f-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:22:47 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-12dec8d5-d83a-4297-b28c-357bae49fb1f tempest-VolumesListAdminTestJSON-961640462 None] Acquiring lock "cinder-quobyte-0586dcb9-79b8-477a-889e-bcdda9d7234f" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:22:47 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-12dec8d5-d83a-4297-b28c-357bae49fb1f tempest-VolumesListAdminTestJSON-961640462 None] Lock "cinder-quobyte-0586dcb9-79b8-477a-889e-bcdda9d7234f" acquired by "delete_volume" :: waited 0.026s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:22:48 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e357561-c2c1-415f-a007-38afb9b9fb91]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:22:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-12dec8d5-d83a-4297-b28c-357bae49fb1f tempest-VolumesListAdminTestJSON-961640462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0586dcb9-79b8-477a-889e-bcdda9d7234f {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:48 devstack sudo[94388]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e648b90a-a169-4e92-b079-81de806375a9 tempest-VolumesListAdminTestJSON-961640462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.417s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:48 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-e648b90a-a169-4e92-b079-81de806375a9 tempest-VolumesListAdminTestJSON-961640462 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:22:48 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-e648b90a-a169-4e92-b079-81de806375a9 tempest-VolumesListAdminTestJSON-961640462 None] Deleted volume successfully. Jul 16 23:22:48 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e648b90a-a169-4e92-b079-81de806375a9 tempest-VolumesListAdminTestJSON-961640462 None] Lock "cinder-3109e230-dd74-411b-9741-02ea29369a31-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:22:48 devstack sudo[94386]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fc47216f-1dfe-41c9-ada0-9069d16e69fd tempest-GroupSnapshotsTest-1525757492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007.8977739b-c8d4-404a-8bb6-afc7eef673a6" returned: 0 in 0.719s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:48 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-fc47216f-1dfe-41c9-ada0-9069d16e69fd tempest-GroupSnapshotsTest-1525757492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e6fb8ae-931e-427f-94d7-ffa806a59007(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:22:48 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[0778f501-eb9d-45de-8daa-9a514ec0b9b3]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:22:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fc47216f-1dfe-41c9-ada0-9069d16e69fd tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:48 devstack sudo[94392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0586dcb9-79b8-477a-889e-bcdda9d7234f Jul 16 23:22:48 devstack sudo[94392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:48 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ef24552-55a7-4933-bde8-a74753418cb3 tempest-VolumesActionsTest-945510952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:22:48 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1ef24552-55a7-4933-bde8-a74753418cb3 tempest-VolumesActionsTest-945510952 None] Flow 'volume_create_manager' (84b36b76-1ccc-4cee-9ce3-bbe868712128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:22:48 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1ef24552-55a7-4933-bde8-a74753418cb3 tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43fe0488-89ba-4a91-8f48-ecef9e7862d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:48 devstack sudo[94399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007 Jul 16 23:22:48 devstack sudo[94399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:48 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1ef24552-55a7-4933-bde8-a74753418cb3 tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43fe0488-89ba-4a91-8f48-ecef9e7862d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-776964470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f6b4140-2e05-41cd-b827-ae88e04856e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b6831797d7e401cb13e3160cc927031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:22:48Z,use_quota=True,user_id='09da365af4e94489a1407a040f05c1c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:48 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1ef24552-55a7-4933-bde8-a74753418cb3 tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31874246-3a10-44ef-8f0c-589441ce1a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:48 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1ef24552-55a7-4933-bde8-a74753418cb3 tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31874246-3a10-44ef-8f0c-589441ce1a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:48 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1ef24552-55a7-4933-bde8-a74753418cb3 tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3573d8be-7b35-4e4d-aa18-a8afe55f8b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:48 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1ef24552-55a7-4933-bde8-a74753418cb3 tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3573d8be-7b35-4e4d-aa18-a8afe55f8b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f6b4140-2e05-41cd-b827-ae88e04856e6', 'volume_name': 'volume-5f6b4140-2e05-41cd-b827-ae88e04856e6', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:48 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1ef24552-55a7-4933-bde8-a74753418cb3 tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9184f0c3-7aca-4c09-bb1d-ebad3098666e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:48 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1ef24552-55a7-4933-bde8-a74753418cb3 tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9184f0c3-7aca-4c09-bb1d-ebad3098666e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:48 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1ef24552-55a7-4933-bde8-a74753418cb3 tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1a0baaf-6460-4a98-9d37-4fdb5c71037b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:48 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-1ef24552-55a7-4933-bde8-a74753418cb3 tempest-VolumesActionsTest-945510952 None] Volume 5f6b4140-2e05-41cd-b827-ae88e04856e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f6b4140-2e05-41cd-b827-ae88e04856e6', 'volume_size': 1} Jul 16 23:22:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1ef24552-55a7-4933-bde8-a74753418cb3 tempest-VolumesActionsTest-945510952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1ef24552-55a7-4933-bde8-a74753418cb3 tempest-VolumesActionsTest-945510952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:48 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1ef24552-55a7-4933-bde8-a74753418cb3 tempest-VolumesActionsTest-945510952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-776964470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f6b4140-2e05-41cd-b827-ae88e04856e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b6831797d7e401cb13e3160cc927031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:22:48Z,use_quota=True,user_id='09da365af4e94489a1407a040f05c1c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:22:48 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-1ef24552-55a7-4933-bde8-a74753418cb3 tempest-VolumesActionsTest-945510952 None] Creating volume 5f6b4140-2e05-41cd-b827-ae88e04856e6 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:22:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1ef24552-55a7-4933-bde8-a74753418cb3 tempest-VolumesActionsTest-945510952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1ef24552-55a7-4933-bde8-a74753418cb3 tempest-VolumesActionsTest-945510952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:48 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1ef24552-55a7-4933-bde8-a74753418cb3 tempest-VolumesActionsTest-945510952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:22:48 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1ef24552-55a7-4933-bde8-a74753418cb3 tempest-VolumesActionsTest-945510952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:22:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1ef24552-55a7-4933-bde8-a74753418cb3 tempest-VolumesActionsTest-945510952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:48 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1ef24552-55a7-4933-bde8-a74753418cb3 tempest-VolumesActionsTest-945510952 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:22:48 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-1ef24552-55a7-4933-bde8-a74753418cb3 tempest-VolumesActionsTest-945510952 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:22:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1ef24552-55a7-4933-bde8-a74753418cb3 tempest-VolumesActionsTest-945510952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5f6b4140-2e05-41cd-b827-ae88e04856e6 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:48 devstack sudo[94402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5f6b4140-2e05-41cd-b827-ae88e04856e6 1073741824 Jul 16 23:22:48 devstack sudo[94402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:48 devstack sudo[94392]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-12dec8d5-d83a-4297-b28c-357bae49fb1f tempest-VolumesListAdminTestJSON-961640462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0586dcb9-79b8-477a-889e-bcdda9d7234f" returned: 0 in 0.498s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-12dec8d5-d83a-4297-b28c-357bae49fb1f tempest-VolumesListAdminTestJSON-961640462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0586dcb9-79b8-477a-889e-bcdda9d7234f {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:48 devstack sudo[94409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0586dcb9-79b8-477a-889e-bcdda9d7234f Jul 16 23:22:48 devstack sudo[94409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:48 devstack sudo[94399]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fc47216f-1dfe-41c9-ada0-9069d16e69fd tempest-GroupSnapshotsTest-1525757492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007" returned: 0 in 0.438s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fc47216f-1dfe-41c9-ada0-9069d16e69fd tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007.8977739b-c8d4-404a-8bb6-afc7eef673a6 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:48 devstack sudo[94415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007.8977739b-c8d4-404a-8bb6-afc7eef673a6 Jul 16 23:22:48 devstack sudo[94415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:48 devstack sudo[94409]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-12dec8d5-d83a-4297-b28c-357bae49fb1f tempest-VolumesListAdminTestJSON-961640462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0586dcb9-79b8-477a-889e-bcdda9d7234f" returned: 0 in 0.315s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:48 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-12dec8d5-d83a-4297-b28c-357bae49fb1f tempest-VolumesListAdminTestJSON-961640462 None] Lock "cinder-quobyte-0586dcb9-79b8-477a-889e-bcdda9d7234f" released by "delete_volume" :: held 0.891s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:22:48 devstack sudo[94402]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1ef24552-55a7-4933-bde8-a74753418cb3 tempest-VolumesActionsTest-945510952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5f6b4140-2e05-41cd-b827-ae88e04856e6 1073741824" returned: 0 in 0.501s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:48 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-12dec8d5-d83a-4297-b28c-357bae49fb1f tempest-VolumesListAdminTestJSON-961640462 None] Created reservations ['a8dc5bc3-2bbc-422e-8af3-cfcc60ecfe4f', 'b66d7f65-f1be-42ed-9a71-0bb91f3376d9', 'fb7c6a2b-7269-42a5-b13e-d44bf8789334', 'acc13748-d94f-4eab-a4c6-4c3f4b37eafa'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:22:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1ef24552-55a7-4933-bde8-a74753418cb3 tempest-VolumesActionsTest-945510952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5f6b4140-2e05-41cd-b827-ae88e04856e6 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:49 devstack sudo[94425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5f6b4140-2e05-41cd-b827-ae88e04856e6 Jul 16 23:22:49 devstack sudo[94425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-12dec8d5-d83a-4297-b28c-357bae49fb1f tempest-VolumesListAdminTestJSON-961640462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-12dec8d5-d83a-4297-b28c-357bae49fb1f tempest-VolumesListAdminTestJSON-961640462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:49 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-12dec8d5-d83a-4297-b28c-357bae49fb1f tempest-VolumesListAdminTestJSON-961640462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:22:49 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-12dec8d5-d83a-4297-b28c-357bae49fb1f tempest-VolumesListAdminTestJSON-961640462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:22:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-12dec8d5-d83a-4297-b28c-357bae49fb1f tempest-VolumesListAdminTestJSON-961640462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-12dec8d5-d83a-4297-b28c-357bae49fb1f tempest-VolumesListAdminTestJSON-961640462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:49 devstack sudo[94415]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:49 devstack sudo[94427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:22:49 devstack sudo[94427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fc47216f-1dfe-41c9-ada0-9069d16e69fd tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007.8977739b-c8d4-404a-8bb6-afc7eef673a6" returned: 0 in 0.465s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fc47216f-1dfe-41c9-ada0-9069d16e69fd tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007.8977739b-c8d4-404a-8bb6-afc7eef673a6 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:49 devstack sudo[94429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007.8977739b-c8d4-404a-8bb6-afc7eef673a6 Jul 16 23:22:49 devstack sudo[94429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:49 devstack sudo[94425]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1ef24552-55a7-4933-bde8-a74753418cb3 tempest-VolumesActionsTest-945510952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5f6b4140-2e05-41cd-b827-ae88e04856e6" returned: 0 in 0.397s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:49 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1ef24552-55a7-4933-bde8-a74753418cb3 tempest-VolumesActionsTest-945510952 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:22:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1ef24552-55a7-4933-bde8-a74753418cb3 tempest-VolumesActionsTest-945510952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:49 devstack sudo[94429]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:49 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1ef24552-55a7-4933-bde8-a74753418cb3 tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1a0baaf-6460-4a98-9d37-4fdb5c71037b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f6b4140-2e05-41cd-b827-ae88e04856e6', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:49 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1ef24552-55a7-4933-bde8-a74753418cb3 tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3736e6b7-6637-4cee-a157-5fb4c0ae38ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fc47216f-1dfe-41c9-ada0-9069d16e69fd tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007.8977739b-c8d4-404a-8bb6-afc7eef673a6" returned: 0 in 0.307s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:49 devstack sudo[94427]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-12dec8d5-d83a-4297-b28c-357bae49fb1f tempest-VolumesListAdminTestJSON-961640462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.380s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:49 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-12dec8d5-d83a-4297-b28c-357bae49fb1f tempest-VolumesListAdminTestJSON-961640462 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:22:49 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fc47216f-1dfe-41c9-ada0-9069d16e69fd tempest-GroupSnapshotsTest-1525757492 None] Lock "cinder-quobyte-8977739b-c8d4-404a-8bb6-afc7eef673a6" released by "_delete_snapshot" :: held 2.075s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:22:49 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-1ef24552-55a7-4933-bde8-a74753418cb3 tempest-VolumesActionsTest-945510952 None] Volume volume-5f6b4140-2e05-41cd-b827-ae88e04856e6 (5f6b4140-2e05-41cd-b827-ae88e04856e6): created successfully Jul 16 23:22:49 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1ef24552-55a7-4933-bde8-a74753418cb3 tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3736e6b7-6637-4cee-a157-5fb4c0ae38ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:49 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1ef24552-55a7-4933-bde8-a74753418cb3 tempest-VolumesActionsTest-945510952 None] Flow 'volume_create_manager' (84b36b76-1ccc-4cee-9ce3-bbe868712128) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:22:49 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-12dec8d5-d83a-4297-b28c-357bae49fb1f tempest-VolumesListAdminTestJSON-961640462 None] Deleted volume successfully. Jul 16 23:22:49 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fc47216f-1dfe-41c9-ada0-9069d16e69fd tempest-GroupSnapshotsTest-1525757492 None] Lock "cinder-quobyte-2e6fb8ae-931e-427f-94d7-ffa806a59007" released by "delete_snapshot" :: held 2.134s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:22:49 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-1ef24552-55a7-4933-bde8-a74753418cb3 tempest-VolumesActionsTest-945510952 None] Created volume successfully. Jul 16 23:22:49 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-12dec8d5-d83a-4297-b28c-357bae49fb1f tempest-VolumesListAdminTestJSON-961640462 None] Lock "cinder-0586dcb9-79b8-477a-889e-bcdda9d7234f-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:22:49 devstack cinder-volume[87607]: WARNING cinder.quota [None req-fc47216f-1dfe-41c9-ada0-9069d16e69fd tempest-GroupSnapshotsTest-1525757492 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1051279609 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1051279609, it is now deprecated. Please use the default quota class for default quota. Jul 16 23:22:49 devstack cinder-volume[87607]: WARNING cinder.quota [None req-fc47216f-1dfe-41c9-ada0-9069d16e69fd tempest-GroupSnapshotsTest-1525757492 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1051279609 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1051279609, it is now deprecated. Please use the default quota class for default quota. Jul 16 23:22:49 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-fc47216f-1dfe-41c9-ada0-9069d16e69fd tempest-GroupSnapshotsTest-1525757492 None] Created reservations ['ed4cdc05-4296-461f-9b58-21224a6fda80', 'e29d5e86-d2dd-4ecd-86b0-b58ab6f184e0', '50613953-9eb8-4cf6-9781-b594cb1d17cb', 'f8887bfa-eb44-4472-aa34-6634e6e0e6aa'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:22:49 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-fc47216f-1dfe-41c9-ada0-9069d16e69fd tempest-GroupSnapshotsTest-1525757492 None] group_snapshot bb303a8a-46f3-46a0-9a4b-8b1fba02715e: deleted successfully Jul 16 23:22:49 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-9cc07809-b1b4-41e4-9144-6fc75729b264 tempest-GroupSnapshotsTest-1525757492 None] Acquiring lock "cinder-quobyte-2e6fb8ae-931e-427f-94d7-ffa806a59007" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:22:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-9cc07809-b1b4-41e4-9144-6fc75729b264 tempest-GroupSnapshotsTest-1525757492 None] Lock "cinder-quobyte-2e6fb8ae-931e-427f-94d7-ffa806a59007" acquired by "delete_volume" :: waited 0.020s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:22:50 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[516568bd-ffae-43f6-ac9c-a8b3b13a1d4e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:22:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-9cc07809-b1b4-41e4-9144-6fc75729b264 tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:50 devstack sudo[94440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007 Jul 16 23:22:50 devstack sudo[94440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:50 devstack sudo[94440]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-9cc07809-b1b4-41e4-9144-6fc75729b264 tempest-GroupSnapshotsTest-1525757492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007" returned: 0 in 0.496s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-9cc07809-b1b4-41e4-9144-6fc75729b264 tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:50 devstack sudo[94445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007 Jul 16 23:22:50 devstack sudo[94445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-eaf7672c-b906-426f-ac96-1e33b85e94ec tempest-VolumesActionsTest-170587690 None] Acquiring lock "cinder-5f6b4140-2e05-41cd-b827-ae88e04856e6-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:22:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-eaf7672c-b906-426f-ac96-1e33b85e94ec tempest-VolumesActionsTest-170587690 None] Lock "cinder-5f6b4140-2e05-41cd-b827-ae88e04856e6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:22:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-eaf7672c-b906-426f-ac96-1e33b85e94ec tempest-VolumesActionsTest-170587690 None] Acquiring lock "cinder-quobyte-5f6b4140-2e05-41cd-b827-ae88e04856e6" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:22:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-eaf7672c-b906-426f-ac96-1e33b85e94ec tempest-VolumesActionsTest-170587690 None] Lock "cinder-quobyte-5f6b4140-2e05-41cd-b827-ae88e04856e6" acquired by "delete_volume" :: waited 0.020s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:22:50 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[057c1d7d-9a68-4bd7-b431-8aad0f687df0]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:22:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-eaf7672c-b906-426f-ac96-1e33b85e94ec tempest-VolumesActionsTest-170587690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5f6b4140-2e05-41cd-b827-ae88e04856e6 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:50 devstack sudo[94445]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-9cc07809-b1b4-41e4-9144-6fc75729b264 tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e6fb8ae-931e-427f-94d7-ffa806a59007" returned: 0 in 0.297s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-9cc07809-b1b4-41e4-9144-6fc75729b264 tempest-GroupSnapshotsTest-1525757492 None] Lock "cinder-quobyte-2e6fb8ae-931e-427f-94d7-ffa806a59007" released by "delete_volume" :: held 0.863s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:22:50 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-9cc07809-b1b4-41e4-9144-6fc75729b264 tempest-GroupSnapshotsTest-1525757492 None] Created reservations ['78377537-8539-4702-a543-3a0ebe9a629e'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:22:50 devstack sudo[94448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5f6b4140-2e05-41cd-b827-ae88e04856e6 Jul 16 23:22:50 devstack sudo[94448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:50 devstack cinder-volume[87607]: WARNING cinder.quota [None req-9cc07809-b1b4-41e4-9144-6fc75729b264 tempest-GroupSnapshotsTest-1525757492 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1051279609 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1051279609, it is now deprecated. Please use the default quota class for default quota. Jul 16 23:22:51 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-9cc07809-b1b4-41e4-9144-6fc75729b264 tempest-GroupSnapshotsTest-1525757492 None] Created reservations ['bbb62ddd-f4c3-40e6-a4c1-e23f31c8f43a', '6fd5ee63-f7f3-495c-92eb-79379ea9aaa6', 'ce8a8f95-13b2-42dc-a3af-de646896dbed', 'f684a529-f118-4648-bdd5-5922af728965'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:22:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-9cc07809-b1b4-41e4-9144-6fc75729b264 tempest-GroupSnapshotsTest-1525757492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-9cc07809-b1b4-41e4-9144-6fc75729b264 tempest-GroupSnapshotsTest-1525757492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:51 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-9cc07809-b1b4-41e4-9144-6fc75729b264 tempest-GroupSnapshotsTest-1525757492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:22:51 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-9cc07809-b1b4-41e4-9144-6fc75729b264 tempest-GroupSnapshotsTest-1525757492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:22:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-9cc07809-b1b4-41e4-9144-6fc75729b264 tempest-GroupSnapshotsTest-1525757492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-9cc07809-b1b4-41e4-9144-6fc75729b264 tempest-GroupSnapshotsTest-1525757492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:51 devstack sudo[94452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:22:51 devstack sudo[94452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:51 devstack sudo[94448]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-eaf7672c-b906-426f-ac96-1e33b85e94ec tempest-VolumesActionsTest-170587690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5f6b4140-2e05-41cd-b827-ae88e04856e6" returned: 0 in 0.577s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-eaf7672c-b906-426f-ac96-1e33b85e94ec tempest-VolumesActionsTest-170587690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5f6b4140-2e05-41cd-b827-ae88e04856e6 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:51 devstack sudo[94456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5f6b4140-2e05-41cd-b827-ae88e04856e6 Jul 16 23:22:51 devstack sudo[94456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:51 devstack sudo[94452]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-9cc07809-b1b4-41e4-9144-6fc75729b264 tempest-GroupSnapshotsTest-1525757492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.520s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:51 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-9cc07809-b1b4-41e4-9144-6fc75729b264 tempest-GroupSnapshotsTest-1525757492 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:22:51 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-9cc07809-b1b4-41e4-9144-6fc75729b264 tempest-GroupSnapshotsTest-1525757492 None] Delete group completed successfully. Jul 16 23:22:51 devstack sudo[94456]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-eaf7672c-b906-426f-ac96-1e33b85e94ec tempest-VolumesActionsTest-170587690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5f6b4140-2e05-41cd-b827-ae88e04856e6" returned: 0 in 0.545s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:51 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-eaf7672c-b906-426f-ac96-1e33b85e94ec tempest-VolumesActionsTest-170587690 None] Lock "cinder-quobyte-5f6b4140-2e05-41cd-b827-ae88e04856e6" released by "delete_volume" :: held 1.183s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:22:52 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-eaf7672c-b906-426f-ac96-1e33b85e94ec tempest-VolumesActionsTest-170587690 None] Created reservations ['69b1482f-45b5-418a-8e32-5918418e9181', 'c899091a-fea8-45b0-8ba6-6268df562105', '3a8e4270-6e7d-4c98-a604-f842967a478e', 'a3f10733-6237-4d5a-81db-0df1b13d5b91'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:22:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-eaf7672c-b906-426f-ac96-1e33b85e94ec tempest-VolumesActionsTest-170587690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-eaf7672c-b906-426f-ac96-1e33b85e94ec tempest-VolumesActionsTest-170587690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:52 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-eaf7672c-b906-426f-ac96-1e33b85e94ec tempest-VolumesActionsTest-170587690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:22:52 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-eaf7672c-b906-426f-ac96-1e33b85e94ec tempest-VolumesActionsTest-170587690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:22:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-eaf7672c-b906-426f-ac96-1e33b85e94ec tempest-VolumesActionsTest-170587690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-eaf7672c-b906-426f-ac96-1e33b85e94ec tempest-VolumesActionsTest-170587690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:52 devstack sudo[94470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:22:52 devstack sudo[94470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:52 devstack sudo[94470]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-eaf7672c-b906-426f-ac96-1e33b85e94ec tempest-VolumesActionsTest-170587690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.452s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:52 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-eaf7672c-b906-426f-ac96-1e33b85e94ec tempest-VolumesActionsTest-170587690 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:22:52 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-eaf7672c-b906-426f-ac96-1e33b85e94ec tempest-VolumesActionsTest-170587690 None] Deleted volume successfully. Jul 16 23:22:52 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-eaf7672c-b906-426f-ac96-1e33b85e94ec tempest-VolumesActionsTest-170587690 None] Lock "cinder-5f6b4140-2e05-41cd-b827-ae88e04856e6-delete_volume" released by "delete_volume" :: held 1.982s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:22:53 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c95e11b-6585-4745-a867-a256349bdbf5 tempest-VolumesActionsTest-945510952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:22:53 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3c95e11b-6585-4745-a867-a256349bdbf5 tempest-VolumesActionsTest-945510952 None] Flow 'volume_create_manager' (d5cf5ac6-607e-46f7-b736-f3a7d438ad99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:22:53 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3c95e11b-6585-4745-a867-a256349bdbf5 tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab9a8b54-2249-4984-a8d6-ce80c969f8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:53 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3c95e11b-6585-4745-a867-a256349bdbf5 tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab9a8b54-2249-4984-a8d6-ce80c969f8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1566772341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=126b0295-15cb-4a67-a523-399638482fc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b6831797d7e401cb13e3160cc927031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:22:54Z,use_quota=True,user_id='09da365af4e94489a1407a040f05c1c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:53 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3c95e11b-6585-4745-a867-a256349bdbf5 tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ad72278-8f27-4b0c-b74c-04e10ca147ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:53 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3c95e11b-6585-4745-a867-a256349bdbf5 tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ad72278-8f27-4b0c-b74c-04e10ca147ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:53 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3c95e11b-6585-4745-a867-a256349bdbf5 tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45b7e708-6025-4f07-9136-62f695826a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:53 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3c95e11b-6585-4745-a867-a256349bdbf5 tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45b7e708-6025-4f07-9136-62f695826a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '126b0295-15cb-4a67-a523-399638482fc8', 'volume_name': 'volume-126b0295-15cb-4a67-a523-399638482fc8', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:53 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3c95e11b-6585-4745-a867-a256349bdbf5 tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ff49b8c-74c8-48f4-8ba1-e2823fcde4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:53 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3c95e11b-6585-4745-a867-a256349bdbf5 tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ff49b8c-74c8-48f4-8ba1-e2823fcde4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:53 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3c95e11b-6585-4745-a867-a256349bdbf5 tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a082afa-348d-44c0-9ff1-9d11d336e072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:53 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-3c95e11b-6585-4745-a867-a256349bdbf5 tempest-VolumesActionsTest-945510952 None] Volume 126b0295-15cb-4a67-a523-399638482fc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-126b0295-15cb-4a67-a523-399638482fc8', 'volume_size': 1} Jul 16 23:22:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3c95e11b-6585-4745-a867-a256349bdbf5 tempest-VolumesActionsTest-945510952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3c95e11b-6585-4745-a867-a256349bdbf5 tempest-VolumesActionsTest-945510952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:53 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3c95e11b-6585-4745-a867-a256349bdbf5 tempest-VolumesActionsTest-945510952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1566772341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=126b0295-15cb-4a67-a523-399638482fc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b6831797d7e401cb13e3160cc927031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:22:54Z,use_quota=True,user_id='09da365af4e94489a1407a040f05c1c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:22:53 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-3c95e11b-6585-4745-a867-a256349bdbf5 tempest-VolumesActionsTest-945510952 None] Creating volume 126b0295-15cb-4a67-a523-399638482fc8 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:22:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3c95e11b-6585-4745-a867-a256349bdbf5 tempest-VolumesActionsTest-945510952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3c95e11b-6585-4745-a867-a256349bdbf5 tempest-VolumesActionsTest-945510952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:53 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3c95e11b-6585-4745-a867-a256349bdbf5 tempest-VolumesActionsTest-945510952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:22:53 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3c95e11b-6585-4745-a867-a256349bdbf5 tempest-VolumesActionsTest-945510952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:22:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3c95e11b-6585-4745-a867-a256349bdbf5 tempest-VolumesActionsTest-945510952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:53 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3c95e11b-6585-4745-a867-a256349bdbf5 tempest-VolumesActionsTest-945510952 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:22:53 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-3c95e11b-6585-4745-a867-a256349bdbf5 tempest-VolumesActionsTest-945510952 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:22:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3c95e11b-6585-4745-a867-a256349bdbf5 tempest-VolumesActionsTest-945510952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-126b0295-15cb-4a67-a523-399638482fc8 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:53 devstack sudo[94473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-126b0295-15cb-4a67-a523-399638482fc8 1073741824 Jul 16 23:22:53 devstack sudo[94473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:54 devstack sudo[94473]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3c95e11b-6585-4745-a867-a256349bdbf5 tempest-VolumesActionsTest-945510952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-126b0295-15cb-4a67-a523-399638482fc8 1073741824" returned: 0 in 0.645s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3c95e11b-6585-4745-a867-a256349bdbf5 tempest-VolumesActionsTest-945510952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-126b0295-15cb-4a67-a523-399638482fc8 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:54 devstack sudo[94479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-126b0295-15cb-4a67-a523-399638482fc8 Jul 16 23:22:54 devstack sudo[94479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:54 devstack sudo[94479]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3c95e11b-6585-4745-a867-a256349bdbf5 tempest-VolumesActionsTest-945510952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-126b0295-15cb-4a67-a523-399638482fc8" returned: 0 in 0.348s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:54 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3c95e11b-6585-4745-a867-a256349bdbf5 tempest-VolumesActionsTest-945510952 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:22:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3c95e11b-6585-4745-a867-a256349bdbf5 tempest-VolumesActionsTest-945510952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:55 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3c95e11b-6585-4745-a867-a256349bdbf5 tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a082afa-348d-44c0-9ff1-9d11d336e072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-126b0295-15cb-4a67-a523-399638482fc8', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:55 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3c95e11b-6585-4745-a867-a256349bdbf5 tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2430f43c-ba7a-4100-b3f7-3f5f32a8fd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:55 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-3c95e11b-6585-4745-a867-a256349bdbf5 tempest-VolumesActionsTest-945510952 None] Volume volume-126b0295-15cb-4a67-a523-399638482fc8 (126b0295-15cb-4a67-a523-399638482fc8): created successfully Jul 16 23:22:55 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3c95e11b-6585-4745-a867-a256349bdbf5 tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2430f43c-ba7a-4100-b3f7-3f5f32a8fd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:55 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3c95e11b-6585-4745-a867-a256349bdbf5 tempest-VolumesActionsTest-945510952 None] Flow 'volume_create_manager' (d5cf5ac6-607e-46f7-b736-f3a7d438ad99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:22:55 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-3c95e11b-6585-4745-a867-a256349bdbf5 tempest-VolumesActionsTest-945510952 None] Created volume successfully. Jul 16 23:22:56 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d0c0f9b0-204e-4891-9ff4-896698204b39 tempest-VolumesActionsTest-170587690 None] Acquiring lock "cinder-126b0295-15cb-4a67-a523-399638482fc8-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:22:56 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d0c0f9b0-204e-4891-9ff4-896698204b39 tempest-VolumesActionsTest-170587690 None] Lock "cinder-126b0295-15cb-4a67-a523-399638482fc8-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:22:56 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d0c0f9b0-204e-4891-9ff4-896698204b39 tempest-VolumesActionsTest-170587690 None] Acquiring lock "cinder-quobyte-126b0295-15cb-4a67-a523-399638482fc8" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:22:56 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d0c0f9b0-204e-4891-9ff4-896698204b39 tempest-VolumesActionsTest-170587690 None] Lock "cinder-quobyte-126b0295-15cb-4a67-a523-399638482fc8" acquired by "delete_volume" :: waited 0.036s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:22:56 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e9cc5c-6516-4571-a22f-73440c06a765]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:22:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d0c0f9b0-204e-4891-9ff4-896698204b39 tempest-VolumesActionsTest-170587690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-126b0295-15cb-4a67-a523-399638482fc8 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:56 devstack sudo[94482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-126b0295-15cb-4a67-a523-399638482fc8 Jul 16 23:22:56 devstack sudo[94482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:56 devstack sudo[94482]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d0c0f9b0-204e-4891-9ff4-896698204b39 tempest-VolumesActionsTest-170587690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-126b0295-15cb-4a67-a523-399638482fc8" returned: 0 in 0.486s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d0c0f9b0-204e-4891-9ff4-896698204b39 tempest-VolumesActionsTest-170587690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-126b0295-15cb-4a67-a523-399638482fc8 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:56 devstack sudo[94487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-126b0295-15cb-4a67-a523-399638482fc8 Jul 16 23:22:56 devstack sudo[94487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:56 devstack sudo[94487]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d0c0f9b0-204e-4891-9ff4-896698204b39 tempest-VolumesActionsTest-170587690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-126b0295-15cb-4a67-a523-399638482fc8" returned: 0 in 0.273s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:57 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d0c0f9b0-204e-4891-9ff4-896698204b39 tempest-VolumesActionsTest-170587690 None] Lock "cinder-quobyte-126b0295-15cb-4a67-a523-399638482fc8" released by "delete_volume" :: held 0.813s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:22:57 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-d0c0f9b0-204e-4891-9ff4-896698204b39 tempest-VolumesActionsTest-170587690 None] Created reservations ['a45529da-3cf7-4f53-a6fb-44c35eef24ee', 'eef20374-70ca-4fc9-8c11-6975c8645ebc', '18d8626c-96c2-4d14-9ac2-a299a6c6ca05', '755ecd5a-8bef-4483-ba5f-6f5fca5d123f'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:22:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-d0c0f9b0-204e-4891-9ff4-896698204b39 tempest-VolumesActionsTest-170587690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-d0c0f9b0-204e-4891-9ff4-896698204b39 tempest-VolumesActionsTest-170587690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:57 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-d0c0f9b0-204e-4891-9ff4-896698204b39 tempest-VolumesActionsTest-170587690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:22:57 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-d0c0f9b0-204e-4891-9ff4-896698204b39 tempest-VolumesActionsTest-170587690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:22:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-d0c0f9b0-204e-4891-9ff4-896698204b39 tempest-VolumesActionsTest-170587690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d0c0f9b0-204e-4891-9ff4-896698204b39 tempest-VolumesActionsTest-170587690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:57 devstack sudo[94490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:22:57 devstack sudo[94490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:57 devstack sudo[94490]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d0c0f9b0-204e-4891-9ff4-896698204b39 tempest-VolumesActionsTest-170587690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.299s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:57 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-d0c0f9b0-204e-4891-9ff4-896698204b39 tempest-VolumesActionsTest-170587690 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:22:57 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-d0c0f9b0-204e-4891-9ff4-896698204b39 tempest-VolumesActionsTest-170587690 None] Deleted volume successfully. Jul 16 23:22:57 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d0c0f9b0-204e-4891-9ff4-896698204b39 tempest-VolumesActionsTest-170587690 None] Lock "cinder-126b0295-15cb-4a67-a523-399638482fc8-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-01ac06a2-221f-43ef-a097-3bf19e4d658b tempest-VolumesTransfersTest-1823450635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-01ac06a2-221f-43ef-a097-3bf19e4d658b tempest-VolumesTransfersTest-1823450635 None] Flow 'volume_create_manager' (4abd745c-fa5e-4741-9900-c89f60716936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-01ac06a2-221f-43ef-a097-3bf19e4d658b tempest-VolumesTransfersTest-1823450635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65290c11-8e96-47c8-a75b-c1321b396751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-01ac06a2-221f-43ef-a097-3bf19e4d658b tempest-VolumesTransfersTest-1823450635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65290c11-8e96-47c8-a75b-c1321b396751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1333713512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fa20fac-11b6-46f6-85f3-84cc0e92a29f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d4ce369322b46dd94b92ab4ea68ab4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:22:58Z,use_quota=True,user_id='a2e8081aa17d456c90bd1dcaf410d6f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-01ac06a2-221f-43ef-a097-3bf19e4d658b tempest-VolumesTransfersTest-1823450635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f359eb-6f1d-4310-bf87-6bda2aa0a911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-01ac06a2-221f-43ef-a097-3bf19e4d658b tempest-VolumesTransfersTest-1823450635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f359eb-6f1d-4310-bf87-6bda2aa0a911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-01ac06a2-221f-43ef-a097-3bf19e4d658b tempest-VolumesTransfersTest-1823450635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3c8b29c-023c-4b28-af8a-c5ead30e4533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-01ac06a2-221f-43ef-a097-3bf19e4d658b tempest-VolumesTransfersTest-1823450635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3c8b29c-023c-4b28-af8a-c5ead30e4533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fa20fac-11b6-46f6-85f3-84cc0e92a29f', 'volume_name': 'volume-6fa20fac-11b6-46f6-85f3-84cc0e92a29f', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-01ac06a2-221f-43ef-a097-3bf19e4d658b tempest-VolumesTransfersTest-1823450635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df33d99a-1e1b-4334-9e84-2f3715c46af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-01ac06a2-221f-43ef-a097-3bf19e4d658b tempest-VolumesTransfersTest-1823450635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df33d99a-1e1b-4334-9e84-2f3715c46af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-01ac06a2-221f-43ef-a097-3bf19e4d658b tempest-VolumesTransfersTest-1823450635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2aadd6b-14cd-4ddf-a964-a28261fca26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:58 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-01ac06a2-221f-43ef-a097-3bf19e4d658b tempest-VolumesTransfersTest-1823450635 None] Volume 6fa20fac-11b6-46f6-85f3-84cc0e92a29f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fa20fac-11b6-46f6-85f3-84cc0e92a29f', 'volume_size': 1} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-01ac06a2-221f-43ef-a097-3bf19e4d658b tempest-VolumesTransfersTest-1823450635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-01ac06a2-221f-43ef-a097-3bf19e4d658b tempest-VolumesTransfersTest-1823450635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-01ac06a2-221f-43ef-a097-3bf19e4d658b tempest-VolumesTransfersTest-1823450635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1333713512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fa20fac-11b6-46f6-85f3-84cc0e92a29f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d4ce369322b46dd94b92ab4ea68ab4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:22:58Z,use_quota=True,user_id='a2e8081aa17d456c90bd1dcaf410d6f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-01ac06a2-221f-43ef-a097-3bf19e4d658b tempest-VolumesTransfersTest-1823450635 None] Creating volume 6fa20fac-11b6-46f6-85f3-84cc0e92a29f {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-01ac06a2-221f-43ef-a097-3bf19e4d658b tempest-VolumesTransfersTest-1823450635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-01ac06a2-221f-43ef-a097-3bf19e4d658b tempest-VolumesTransfersTest-1823450635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-01ac06a2-221f-43ef-a097-3bf19e4d658b tempest-VolumesTransfersTest-1823450635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-01ac06a2-221f-43ef-a097-3bf19e4d658b tempest-VolumesTransfersTest-1823450635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-01ac06a2-221f-43ef-a097-3bf19e4d658b tempest-VolumesTransfersTest-1823450635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-01ac06a2-221f-43ef-a097-3bf19e4d658b tempest-VolumesTransfersTest-1823450635 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:22:58 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-01ac06a2-221f-43ef-a097-3bf19e4d658b tempest-VolumesTransfersTest-1823450635 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-01ac06a2-221f-43ef-a097-3bf19e4d658b tempest-VolumesTransfersTest-1823450635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6fa20fac-11b6-46f6-85f3-84cc0e92a29f 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:58 devstack sudo[94495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6fa20fac-11b6-46f6-85f3-84cc0e92a29f 1073741824 Jul 16 23:22:58 devstack sudo[94495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2301198-fc90-4b7c-b687-75d05613ef1f tempest-VolumesActionsTest-945510952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c2301198-fc90-4b7c-b687-75d05613ef1f tempest-VolumesActionsTest-945510952 None] Flow 'volume_create_manager' (b94da2bf-b0fc-4d75-aa10-78ab2bff8db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c2301198-fc90-4b7c-b687-75d05613ef1f tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aca1241-85cc-45b8-be84-4164c056dd8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c2301198-fc90-4b7c-b687-75d05613ef1f tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aca1241-85cc-45b8-be84-4164c056dd8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-208767490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5f702fb-1e38-4683-a20a-8544c9f85808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b6831797d7e401cb13e3160cc927031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:22:58Z,use_quota=True,user_id='09da365af4e94489a1407a040f05c1c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c2301198-fc90-4b7c-b687-75d05613ef1f tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee95a372-6f77-4238-932d-46de6e5203bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c2301198-fc90-4b7c-b687-75d05613ef1f tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee95a372-6f77-4238-932d-46de6e5203bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c2301198-fc90-4b7c-b687-75d05613ef1f tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e13bbde-a18e-409a-b26b-73f21b4fff81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c2301198-fc90-4b7c-b687-75d05613ef1f tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e13bbde-a18e-409a-b26b-73f21b4fff81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5f702fb-1e38-4683-a20a-8544c9f85808', 'volume_name': 'volume-b5f702fb-1e38-4683-a20a-8544c9f85808', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c2301198-fc90-4b7c-b687-75d05613ef1f tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccb70d84-c580-4faa-be09-7dc91b1e035f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c2301198-fc90-4b7c-b687-75d05613ef1f tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccb70d84-c580-4faa-be09-7dc91b1e035f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c2301198-fc90-4b7c-b687-75d05613ef1f tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4315cc34-6d2f-4ef3-b17d-d848886d96c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:58 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-c2301198-fc90-4b7c-b687-75d05613ef1f tempest-VolumesActionsTest-945510952 None] Volume b5f702fb-1e38-4683-a20a-8544c9f85808: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5f702fb-1e38-4683-a20a-8544c9f85808', 'volume_size': 1} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c2301198-fc90-4b7c-b687-75d05613ef1f tempest-VolumesActionsTest-945510952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:58 devstack sudo[94495]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-01ac06a2-221f-43ef-a097-3bf19e4d658b tempest-VolumesTransfersTest-1823450635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6fa20fac-11b6-46f6-85f3-84cc0e92a29f 1073741824" returned: 0 in 0.478s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-01ac06a2-221f-43ef-a097-3bf19e4d658b tempest-VolumesTransfersTest-1823450635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6fa20fac-11b6-46f6-85f3-84cc0e92a29f {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:58 devstack sudo[94502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6fa20fac-11b6-46f6-85f3-84cc0e92a29f Jul 16 23:22:58 devstack sudo[94502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:58 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-0a50cb48-d274-49f6-a51a-e2c18316f1c8 tempest-GroupSnapshotsV319Test-633253461 None] Group tempest-GroupSnapshotsV319Test-Group-1259614192: creating Jul 16 23:22:58 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-0a50cb48-d274-49f6-a51a-e2c18316f1c8 tempest-GroupSnapshotsV319Test-633253461 None] Group tempest-GroupSnapshotsV319Test-Group-1259614192: created successfully Jul 16 23:22:58 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-0a50cb48-d274-49f6-a51a-e2c18316f1c8 tempest-GroupSnapshotsV319Test-633253461 None] Create group completed successfully. Jul 16 23:22:58 devstack sudo[94502]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-01ac06a2-221f-43ef-a097-3bf19e4d658b tempest-VolumesTransfersTest-1823450635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6fa20fac-11b6-46f6-85f3-84cc0e92a29f" returned: 0 in 0.265s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-01ac06a2-221f-43ef-a097-3bf19e4d658b tempest-VolumesTransfersTest-1823450635 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-01ac06a2-221f-43ef-a097-3bf19e4d658b tempest-VolumesTransfersTest-1823450635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c2301198-fc90-4b7c-b687-75d05613ef1f tempest-VolumesActionsTest-945510952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.673s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-c2301198-fc90-4b7c-b687-75d05613ef1f tempest-VolumesActionsTest-945510952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-208767490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5f702fb-1e38-4683-a20a-8544c9f85808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b6831797d7e401cb13e3160cc927031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:22:58Z,use_quota=True,user_id='09da365af4e94489a1407a040f05c1c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-c2301198-fc90-4b7c-b687-75d05613ef1f tempest-VolumesActionsTest-945510952 None] Creating volume b5f702fb-1e38-4683-a20a-8544c9f85808 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c2301198-fc90-4b7c-b687-75d05613ef1f tempest-VolumesActionsTest-945510952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c2301198-fc90-4b7c-b687-75d05613ef1f tempest-VolumesActionsTest-945510952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-c2301198-fc90-4b7c-b687-75d05613ef1f tempest-VolumesActionsTest-945510952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-c2301198-fc90-4b7c-b687-75d05613ef1f tempest-VolumesActionsTest-945510952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c2301198-fc90-4b7c-b687-75d05613ef1f tempest-VolumesActionsTest-945510952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-c2301198-fc90-4b7c-b687-75d05613ef1f tempest-VolumesActionsTest-945510952 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:22:58 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-c2301198-fc90-4b7c-b687-75d05613ef1f tempest-VolumesActionsTest-945510952 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c2301198-fc90-4b7c-b687-75d05613ef1f tempest-VolumesActionsTest-945510952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b5f702fb-1e38-4683-a20a-8544c9f85808 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-01ac06a2-221f-43ef-a097-3bf19e4d658b tempest-VolumesTransfersTest-1823450635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2aadd6b-14cd-4ddf-a964-a28261fca26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fa20fac-11b6-46f6-85f3-84cc0e92a29f', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:58 devstack sudo[94505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b5f702fb-1e38-4683-a20a-8544c9f85808 1073741824 Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-01ac06a2-221f-43ef-a097-3bf19e4d658b tempest-VolumesTransfersTest-1823450635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f25b4851-f125-4c75-a3ae-7d33585649a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:58 devstack sudo[94505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:58 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-01ac06a2-221f-43ef-a097-3bf19e4d658b tempest-VolumesTransfersTest-1823450635 None] Volume volume-6fa20fac-11b6-46f6-85f3-84cc0e92a29f (6fa20fac-11b6-46f6-85f3-84cc0e92a29f): created successfully Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-01ac06a2-221f-43ef-a097-3bf19e4d658b tempest-VolumesTransfersTest-1823450635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f25b4851-f125-4c75-a3ae-7d33585649a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-01ac06a2-221f-43ef-a097-3bf19e4d658b tempest-VolumesTransfersTest-1823450635 None] Flow 'volume_create_manager' (4abd745c-fa5e-4741-9900-c89f60716936) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:22:58 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-01ac06a2-221f-43ef-a097-3bf19e4d658b tempest-VolumesTransfersTest-1823450635 None] Created volume successfully. Jul 16 23:22:59 devstack sudo[94505]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c2301198-fc90-4b7c-b687-75d05613ef1f tempest-VolumesActionsTest-945510952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b5f702fb-1e38-4683-a20a-8544c9f85808 1073741824" returned: 0 in 0.397s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c2301198-fc90-4b7c-b687-75d05613ef1f tempest-VolumesActionsTest-945510952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b5f702fb-1e38-4683-a20a-8544c9f85808 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:22:59 devstack sudo[94510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b5f702fb-1e38-4683-a20a-8544c9f85808 Jul 16 23:22:59 devstack sudo[94510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:22:59 devstack sudo[94510]: pam_unix(sudo:session): session closed for user root Jul 16 23:22:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c2301198-fc90-4b7c-b687-75d05613ef1f tempest-VolumesActionsTest-945510952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b5f702fb-1e38-4683-a20a-8544c9f85808" returned: 0 in 0.263s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:22:59 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-c2301198-fc90-4b7c-b687-75d05613ef1f tempest-VolumesActionsTest-945510952 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:22:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c2301198-fc90-4b7c-b687-75d05613ef1f tempest-VolumesActionsTest-945510952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:22:59 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c2301198-fc90-4b7c-b687-75d05613ef1f tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4315cc34-6d2f-4ef3-b17d-d848886d96c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5f702fb-1e38-4683-a20a-8544c9f85808', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:59 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c2301198-fc90-4b7c-b687-75d05613ef1f tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (093f24aa-cb5e-46e0-a3a0-aa0a27fb0355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:22:59 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-c2301198-fc90-4b7c-b687-75d05613ef1f tempest-VolumesActionsTest-945510952 None] Volume volume-b5f702fb-1e38-4683-a20a-8544c9f85808 (b5f702fb-1e38-4683-a20a-8544c9f85808): created successfully Jul 16 23:22:59 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c2301198-fc90-4b7c-b687-75d05613ef1f tempest-VolumesActionsTest-945510952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (093f24aa-cb5e-46e0-a3a0-aa0a27fb0355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:22:59 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c2301198-fc90-4b7c-b687-75d05613ef1f tempest-VolumesActionsTest-945510952 None] Flow 'volume_create_manager' (b94da2bf-b0fc-4d75-aa10-78ab2bff8db8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:22:59 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-c2301198-fc90-4b7c-b687-75d05613ef1f tempest-VolumesActionsTest-945510952 None] Created volume successfully. Jul 16 23:23:00 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-88af7a20-86a9-4c60-abb6-ed2fe837bc57 tempest-GroupSnapshotsV319Test-633253461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:23:00 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-88af7a20-86a9-4c60-abb6-ed2fe837bc57 tempest-GroupSnapshotsV319Test-633253461 None] Flow 'volume_create_manager' (5ba7ab77-c274-491a-9ce4-8cb04f06bcd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:23:00 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-88af7a20-86a9-4c60-abb6-ed2fe837bc57 tempest-GroupSnapshotsV319Test-633253461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93e56172-0ab9-4579-aef9-1192c962d016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:00 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-88af7a20-86a9-4c60-abb6-ed2fe837bc57 tempest-GroupSnapshotsV319Test-633253461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93e56172-0ab9-4579-aef9-1192c962d016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:23:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1708326297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=43f780f6-06de-4446-831c-bea923650314,host='devstack@QuobyteHD#QuobyteHD',id=117c6c51-a15a-41fe-8481-d5e07a112660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6b00432bb39434f83d7c18025ccca47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:23:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:23:00Z,use_quota=True,user_id='8512488e4cf24d8683b9aca9d221668d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3066a936-c388-4a37-b017-1b587b485a93),volume_type_id=3066a936-c388-4a37-b017-1b587b485a93)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:00 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-88af7a20-86a9-4c60-abb6-ed2fe837bc57 tempest-GroupSnapshotsV319Test-633253461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (304dc336-51d6-4f2f-a522-10272114dc05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:00 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-88af7a20-86a9-4c60-abb6-ed2fe837bc57 tempest-GroupSnapshotsV319Test-633253461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (304dc336-51d6-4f2f-a522-10272114dc05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:00 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-88af7a20-86a9-4c60-abb6-ed2fe837bc57 tempest-GroupSnapshotsV319Test-633253461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26dde182-a9dd-448e-8c33-046ecaf1d5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:00 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-88af7a20-86a9-4c60-abb6-ed2fe837bc57 tempest-GroupSnapshotsV319Test-633253461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26dde182-a9dd-448e-8c33-046ecaf1d5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '117c6c51-a15a-41fe-8481-d5e07a112660', 'volume_name': 'volume-117c6c51-a15a-41fe-8481-d5e07a112660', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:00 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-88af7a20-86a9-4c60-abb6-ed2fe837bc57 tempest-GroupSnapshotsV319Test-633253461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21c10777-f98d-48b3-908c-5366db5f480b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:00 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-88af7a20-86a9-4c60-abb6-ed2fe837bc57 tempest-GroupSnapshotsV319Test-633253461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21c10777-f98d-48b3-908c-5366db5f480b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:00 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-88af7a20-86a9-4c60-abb6-ed2fe837bc57 tempest-GroupSnapshotsV319Test-633253461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e782d00-825f-49d4-8de3-b8df61e7159b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:00 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-88af7a20-86a9-4c60-abb6-ed2fe837bc57 tempest-GroupSnapshotsV319Test-633253461 None] Volume 117c6c51-a15a-41fe-8481-d5e07a112660: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-117c6c51-a15a-41fe-8481-d5e07a112660', 'volume_size': 1} Jul 16 23:23:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-88af7a20-86a9-4c60-abb6-ed2fe837bc57 tempest-GroupSnapshotsV319Test-633253461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:23:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-88af7a20-86a9-4c60-abb6-ed2fe837bc57 tempest-GroupSnapshotsV319Test-633253461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:23:00 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-88af7a20-86a9-4c60-abb6-ed2fe837bc57 tempest-GroupSnapshotsV319Test-633253461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=43f780f6-06de-4446-831c-bea923650314,created_at=2026-07-16T21:23:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1708326297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=43f780f6-06de-4446-831c-bea923650314,host='devstack@QuobyteHD#QuobyteHD',id=117c6c51-a15a-41fe-8481-d5e07a112660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6b00432bb39434f83d7c18025ccca47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:23:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:23:00Z,use_quota=True,user_id='8512488e4cf24d8683b9aca9d221668d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3066a936-c388-4a37-b017-1b587b485a93),volume_type_id=3066a936-c388-4a37-b017-1b587b485a93)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:23:00 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-88af7a20-86a9-4c60-abb6-ed2fe837bc57 tempest-GroupSnapshotsV319Test-633253461 None] Creating volume 117c6c51-a15a-41fe-8481-d5e07a112660 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:23:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-88af7a20-86a9-4c60-abb6-ed2fe837bc57 tempest-GroupSnapshotsV319Test-633253461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:23:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-88af7a20-86a9-4c60-abb6-ed2fe837bc57 tempest-GroupSnapshotsV319Test-633253461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:23:00 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-88af7a20-86a9-4c60-abb6-ed2fe837bc57 tempest-GroupSnapshotsV319Test-633253461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:23:00 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-88af7a20-86a9-4c60-abb6-ed2fe837bc57 tempest-GroupSnapshotsV319Test-633253461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:23:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-88af7a20-86a9-4c60-abb6-ed2fe837bc57 tempest-GroupSnapshotsV319Test-633253461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:23:00 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-88af7a20-86a9-4c60-abb6-ed2fe837bc57 tempest-GroupSnapshotsV319Test-633253461 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:23:00 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-88af7a20-86a9-4c60-abb6-ed2fe837bc57 tempest-GroupSnapshotsV319Test-633253461 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:23:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-88af7a20-86a9-4c60-abb6-ed2fe837bc57 tempest-GroupSnapshotsV319Test-633253461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:00 devstack sudo[94513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660 1073741824 Jul 16 23:23:00 devstack sudo[94513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:00 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-5aed658e-15c0-45d2-9fac-f2c273b87d28 tempest-VolumesActionsTest-945510952 None] Acquiring lock "cinder-b5f702fb-1e38-4683-a20a-8544c9f85808-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:23:00 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-8a1debb1-44db-419b-8e1b-88cf2ee0f43d tempest-VolumesTransfersTest-1779751367 None] Transfer volume completed successfully. Jul 16 23:23:00 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-5aed658e-15c0-45d2-9fac-f2c273b87d28 tempest-VolumesActionsTest-945510952 None] Lock "cinder-b5f702fb-1e38-4683-a20a-8544c9f85808-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:23:00 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-5aed658e-15c0-45d2-9fac-f2c273b87d28 tempest-VolumesActionsTest-945510952 None] Acquiring lock "cinder-quobyte-b5f702fb-1e38-4683-a20a-8544c9f85808" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:23:00 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-5aed658e-15c0-45d2-9fac-f2c273b87d28 tempest-VolumesActionsTest-945510952 None] Lock "cinder-quobyte-b5f702fb-1e38-4683-a20a-8544c9f85808" acquired by "delete_volume" :: waited 0.019s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:23:00 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab9c48d-f5fd-4036-9280-8102b996d98c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:23:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5aed658e-15c0-45d2-9fac-f2c273b87d28 tempest-VolumesActionsTest-945510952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b5f702fb-1e38-4683-a20a-8544c9f85808 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:01 devstack sudo[94513]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-88af7a20-86a9-4c60-abb6-ed2fe837bc57 tempest-GroupSnapshotsV319Test-633253461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660 1073741824" returned: 0 in 0.548s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-88af7a20-86a9-4c60-abb6-ed2fe837bc57 tempest-GroupSnapshotsV319Test-633253461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:01 devstack sudo[94520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660 Jul 16 23:23:01 devstack sudo[94520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:01 devstack sudo[94519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b5f702fb-1e38-4683-a20a-8544c9f85808 Jul 16 23:23:01 devstack sudo[94519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:01 devstack sudo[94520]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-88af7a20-86a9-4c60-abb6-ed2fe837bc57 tempest-GroupSnapshotsV319Test-633253461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660" returned: 0 in 0.312s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:01 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-88af7a20-86a9-4c60-abb6-ed2fe837bc57 tempest-GroupSnapshotsV319Test-633253461 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:23:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-88af7a20-86a9-4c60-abb6-ed2fe837bc57 tempest-GroupSnapshotsV319Test-633253461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:23:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-88af7a20-86a9-4c60-abb6-ed2fe837bc57 tempest-GroupSnapshotsV319Test-633253461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e782d00-825f-49d4-8de3-b8df61e7159b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-117c6c51-a15a-41fe-8481-d5e07a112660', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-88af7a20-86a9-4c60-abb6-ed2fe837bc57 tempest-GroupSnapshotsV319Test-633253461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce62788f-8750-4fc1-b43d-b02a3bdaa1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:01 devstack sudo[94519]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5aed658e-15c0-45d2-9fac-f2c273b87d28 tempest-VolumesActionsTest-945510952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b5f702fb-1e38-4683-a20a-8544c9f85808" returned: 0 in 0.423s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5aed658e-15c0-45d2-9fac-f2c273b87d28 tempest-VolumesActionsTest-945510952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b5f702fb-1e38-4683-a20a-8544c9f85808 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:01 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-88af7a20-86a9-4c60-abb6-ed2fe837bc57 tempest-GroupSnapshotsV319Test-633253461 None] Volume volume-117c6c51-a15a-41fe-8481-d5e07a112660 (117c6c51-a15a-41fe-8481-d5e07a112660): created successfully Jul 16 23:23:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-88af7a20-86a9-4c60-abb6-ed2fe837bc57 tempest-GroupSnapshotsV319Test-633253461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce62788f-8750-4fc1-b43d-b02a3bdaa1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-88af7a20-86a9-4c60-abb6-ed2fe837bc57 tempest-GroupSnapshotsV319Test-633253461 None] Flow 'volume_create_manager' (5ba7ab77-c274-491a-9ce4-8cb04f06bcd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:23:01 devstack sudo[94528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b5f702fb-1e38-4683-a20a-8544c9f85808 Jul 16 23:23:01 devstack sudo[94528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:01 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-88af7a20-86a9-4c60-abb6-ed2fe837bc57 tempest-GroupSnapshotsV319Test-633253461 None] Created volume successfully. Jul 16 23:23:01 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-68d595bb-de00-4783-a17c-0436a16a8543 tempest-VolumesTransfersTest-1348236661 None] Acquiring lock "cinder-6fa20fac-11b6-46f6-85f3-84cc0e92a29f-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:23:01 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-68d595bb-de00-4783-a17c-0436a16a8543 tempest-VolumesTransfersTest-1348236661 None] Lock "cinder-6fa20fac-11b6-46f6-85f3-84cc0e92a29f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:23:01 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-68d595bb-de00-4783-a17c-0436a16a8543 tempest-VolumesTransfersTest-1348236661 None] Acquiring lock "cinder-quobyte-6fa20fac-11b6-46f6-85f3-84cc0e92a29f" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:23:01 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-68d595bb-de00-4783-a17c-0436a16a8543 tempest-VolumesTransfersTest-1348236661 None] Lock "cinder-quobyte-6fa20fac-11b6-46f6-85f3-84cc0e92a29f" acquired by "delete_volume" :: waited 0.023s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:23:01 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddb5f8f-975f-4f41-82ed-9dc9ea938c66]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:23:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-68d595bb-de00-4783-a17c-0436a16a8543 tempest-VolumesTransfersTest-1348236661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6fa20fac-11b6-46f6-85f3-84cc0e92a29f {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:01 devstack sudo[94528]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5aed658e-15c0-45d2-9fac-f2c273b87d28 tempest-VolumesActionsTest-945510952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b5f702fb-1e38-4683-a20a-8544c9f85808" returned: 0 in 0.325s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:01 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-5aed658e-15c0-45d2-9fac-f2c273b87d28 tempest-VolumesActionsTest-945510952 None] Lock "cinder-quobyte-b5f702fb-1e38-4683-a20a-8544c9f85808" released by "delete_volume" :: held 0.803s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:23:01 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-5aed658e-15c0-45d2-9fac-f2c273b87d28 tempest-VolumesActionsTest-945510952 None] Created reservations ['575f2914-218d-41bf-916b-8b3793ea7b21', '71ee4e37-efc1-4594-870e-863785516446', '8c3699a2-1489-4b60-b82e-e8a8f5b00be4', 'c33ca548-3597-4aef-87d5-5c7d7e440eaf'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:23:01 devstack sudo[94531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6fa20fac-11b6-46f6-85f3-84cc0e92a29f Jul 16 23:23:01 devstack sudo[94531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:01 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-aa055c45-3c8a-420f-a6a6-4d249a3822a5 tempest-GroupSnapshotsV319Test-633253461 None] GroupSnapshot 8c3197f0-9af1-40d1-8142-fc6ebfbca94a: creating. Jul 16 23:23:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5aed658e-15c0-45d2-9fac-f2c273b87d28 tempest-VolumesActionsTest-945510952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:23:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5aed658e-15c0-45d2-9fac-f2c273b87d28 tempest-VolumesActionsTest-945510952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:23:01 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-5aed658e-15c0-45d2-9fac-f2c273b87d28 tempest-VolumesActionsTest-945510952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:23:01 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-5aed658e-15c0-45d2-9fac-f2c273b87d28 tempest-VolumesActionsTest-945510952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:23:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5aed658e-15c0-45d2-9fac-f2c273b87d28 tempest-VolumesActionsTest-945510952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:23:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5aed658e-15c0-45d2-9fac-f2c273b87d28 tempest-VolumesActionsTest-945510952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-aa055c45-3c8a-420f-a6a6-4d249a3822a5 tempest-GroupSnapshotsV319Test-633253461 None] Group snapshot 8c3197f0-9af1-40d1-8142-fc6ebfbca94a: creating. {{(pid=87607) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 16 23:23:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-aa055c45-3c8a-420f-a6a6-4d249a3822a5 tempest-GroupSnapshotsV319Test-633253461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:23:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-aa055c45-3c8a-420f-a6a6-4d249a3822a5 tempest-GroupSnapshotsV319Test-633253461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:23:01 devstack sudo[94533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:23:01 devstack sudo[94533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:01 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-aa055c45-3c8a-420f-a6a6-4d249a3822a5 tempest-GroupSnapshotsV319Test-633253461 None] Creating offline snapshot 7607a5ca-d46f-4afe-801e-2be547cf9eb9 of volume 117c6c51-a15a-41fe-8481-d5e07a112660 {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:23:02 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc63b56-d2c8-4650-a714-14262ba4b42c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:23:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-aa055c45-3c8a-420f-a6a6-4d249a3822a5 tempest-GroupSnapshotsV319Test-633253461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:02 devstack sudo[94531]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-68d595bb-de00-4783-a17c-0436a16a8543 tempest-VolumesTransfersTest-1348236661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6fa20fac-11b6-46f6-85f3-84cc0e92a29f" returned: 0 in 0.422s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-68d595bb-de00-4783-a17c-0436a16a8543 tempest-VolumesTransfersTest-1348236661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6fa20fac-11b6-46f6-85f3-84cc0e92a29f {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:02 devstack sudo[94535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660 Jul 16 23:23:02 devstack sudo[94535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:02 devstack sudo[94539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6fa20fac-11b6-46f6-85f3-84cc0e92a29f Jul 16 23:23:02 devstack sudo[94539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:02 devstack sudo[94533]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5aed658e-15c0-45d2-9fac-f2c273b87d28 tempest-VolumesActionsTest-945510952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.301s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:02 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-5aed658e-15c0-45d2-9fac-f2c273b87d28 tempest-VolumesActionsTest-945510952 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:23:02 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-5aed658e-15c0-45d2-9fac-f2c273b87d28 tempest-VolumesActionsTest-945510952 None] Deleted volume successfully. Jul 16 23:23:02 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-5aed658e-15c0-45d2-9fac-f2c273b87d28 tempest-VolumesActionsTest-945510952 None] Lock "cinder-b5f702fb-1e38-4683-a20a-8544c9f85808-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:23:02 devstack sudo[94539]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-68d595bb-de00-4783-a17c-0436a16a8543 tempest-VolumesTransfersTest-1348236661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6fa20fac-11b6-46f6-85f3-84cc0e92a29f" returned: 0 in 0.278s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:02 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-68d595bb-de00-4783-a17c-0436a16a8543 tempest-VolumesTransfersTest-1348236661 None] Lock "cinder-quobyte-6fa20fac-11b6-46f6-85f3-84cc0e92a29f" released by "delete_volume" :: held 0.746s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:23:02 devstack sudo[94535]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-aa055c45-3c8a-420f-a6a6-4d249a3822a5 tempest-GroupSnapshotsV319Test-633253461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660" returned: 0 in 0.426s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-aa055c45-3c8a-420f-a6a6-4d249a3822a5 tempest-GroupSnapshotsV319Test-633253461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660.7607a5ca-d46f-4afe-801e-2be547cf9eb9 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:02 devstack sudo[94547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660.7607a5ca-d46f-4afe-801e-2be547cf9eb9 1G Jul 16 23:23:02 devstack sudo[94547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:02 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-68d595bb-de00-4783-a17c-0436a16a8543 tempest-VolumesTransfersTest-1348236661 None] Created reservations ['f654afe8-aab5-4079-bf19-3440125dc1f4', 'd25116a8-9bc2-446a-bae7-b252106c535b', '0e108cf2-9f13-44b3-b1f1-1269ec17def2', '72722ead-3341-4e90-855e-d40b8f1e3718'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:23:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-68d595bb-de00-4783-a17c-0436a16a8543 tempest-VolumesTransfersTest-1348236661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:23:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-68d595bb-de00-4783-a17c-0436a16a8543 tempest-VolumesTransfersTest-1348236661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:23:02 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-68d595bb-de00-4783-a17c-0436a16a8543 tempest-VolumesTransfersTest-1348236661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:23:02 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-68d595bb-de00-4783-a17c-0436a16a8543 tempest-VolumesTransfersTest-1348236661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:23:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-68d595bb-de00-4783-a17c-0436a16a8543 tempest-VolumesTransfersTest-1348236661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:23:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-68d595bb-de00-4783-a17c-0436a16a8543 tempest-VolumesTransfersTest-1348236661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:02 devstack sudo[94550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:23:02 devstack sudo[94550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:02 devstack sudo[94550]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-68d595bb-de00-4783-a17c-0436a16a8543 tempest-VolumesTransfersTest-1348236661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.327s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:02 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-68d595bb-de00-4783-a17c-0436a16a8543 tempest-VolumesTransfersTest-1348236661 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:23:02 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-68d595bb-de00-4783-a17c-0436a16a8543 tempest-VolumesTransfersTest-1348236661 None] Deleted volume successfully. Jul 16 23:23:03 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-68d595bb-de00-4783-a17c-0436a16a8543 tempest-VolumesTransfersTest-1348236661 None] Lock "cinder-6fa20fac-11b6-46f6-85f3-84cc0e92a29f-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:23:03 devstack sudo[94547]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-aa055c45-3c8a-420f-a6a6-4d249a3822a5 tempest-GroupSnapshotsV319Test-633253461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660.7607a5ca-d46f-4afe-801e-2be547cf9eb9 1G" returned: 0 in 0.632s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-aa055c45-3c8a-420f-a6a6-4d249a3822a5 tempest-GroupSnapshotsV319Test-633253461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-117c6c51-a15a-41fe-8481-d5e07a112660 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660.7607a5ca-d46f-4afe-801e-2be547cf9eb9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:03 devstack sudo[94556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-117c6c51-a15a-41fe-8481-d5e07a112660 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660.7607a5ca-d46f-4afe-801e-2be547cf9eb9 Jul 16 23:23:03 devstack sudo[94556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:03 devstack sudo[94556]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-aa055c45-3c8a-420f-a6a6-4d249a3822a5 tempest-GroupSnapshotsV319Test-633253461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-117c6c51-a15a-41fe-8481-d5e07a112660 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660.7607a5ca-d46f-4afe-801e-2be547cf9eb9" returned: 0 in 0.456s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:03 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-aa055c45-3c8a-420f-a6a6-4d249a3822a5 tempest-GroupSnapshotsV319Test-633253461 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660.7607a5ca-d46f-4afe-801e-2be547cf9eb9 is being set with open permissions: ugo+rw: NotImplementedError Jul 16 23:23:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-aa055c45-3c8a-420f-a6a6-4d249a3822a5 tempest-GroupSnapshotsV319Test-633253461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660.7607a5ca-d46f-4afe-801e-2be547cf9eb9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:03 devstack sudo[94561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660.7607a5ca-d46f-4afe-801e-2be547cf9eb9 Jul 16 23:23:03 devstack sudo[94561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:03 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad921f06-3873-432e-ba5a-b6229bc66e2d tempest-VolumesTransfersTest-1823450635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:23:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ad921f06-3873-432e-ba5a-b6229bc66e2d tempest-VolumesTransfersTest-1823450635 None] Flow 'volume_create_manager' (2bc9abdd-a1dd-4f3f-8f44-c996562d44f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:23:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ad921f06-3873-432e-ba5a-b6229bc66e2d tempest-VolumesTransfersTest-1823450635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2378087a-0e30-4ced-8268-d188f9b482f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ad921f06-3873-432e-ba5a-b6229bc66e2d tempest-VolumesTransfersTest-1823450635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2378087a-0e30-4ced-8268-d188f9b482f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2134327469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea1296d-3197-4d39-8fae-6e3835caef6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d4ce369322b46dd94b92ab4ea68ab4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:23:04Z,use_quota=True,user_id='a2e8081aa17d456c90bd1dcaf410d6f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ad921f06-3873-432e-ba5a-b6229bc66e2d tempest-VolumesTransfersTest-1823450635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dfd50ac-3534-41c7-852b-77441be5221c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ad921f06-3873-432e-ba5a-b6229bc66e2d tempest-VolumesTransfersTest-1823450635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dfd50ac-3534-41c7-852b-77441be5221c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ad921f06-3873-432e-ba5a-b6229bc66e2d tempest-VolumesTransfersTest-1823450635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af1375d8-7074-4009-8cf6-c53fe9c7cab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ad921f06-3873-432e-ba5a-b6229bc66e2d tempest-VolumesTransfersTest-1823450635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af1375d8-7074-4009-8cf6-c53fe9c7cab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eea1296d-3197-4d39-8fae-6e3835caef6a', 'volume_name': 'volume-eea1296d-3197-4d39-8fae-6e3835caef6a', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ad921f06-3873-432e-ba5a-b6229bc66e2d tempest-VolumesTransfersTest-1823450635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e660a7c0-e209-4206-b314-24d237ac75e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ad921f06-3873-432e-ba5a-b6229bc66e2d tempest-VolumesTransfersTest-1823450635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e660a7c0-e209-4206-b314-24d237ac75e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ad921f06-3873-432e-ba5a-b6229bc66e2d tempest-VolumesTransfersTest-1823450635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (859e56f8-5d09-4826-bf2e-bfa8b76cf8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:03 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-ad921f06-3873-432e-ba5a-b6229bc66e2d tempest-VolumesTransfersTest-1823450635 None] Volume eea1296d-3197-4d39-8fae-6e3835caef6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eea1296d-3197-4d39-8fae-6e3835caef6a', 'volume_size': 1} Jul 16 23:23:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ad921f06-3873-432e-ba5a-b6229bc66e2d tempest-VolumesTransfersTest-1823450635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:23:03 devstack sudo[94561]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-aa055c45-3c8a-420f-a6a6-4d249a3822a5 tempest-GroupSnapshotsV319Test-633253461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660.7607a5ca-d46f-4afe-801e-2be547cf9eb9" returned: 0 in 0.312s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-aa055c45-3c8a-420f-a6a6-4d249a3822a5 tempest-GroupSnapshotsV319Test-633253461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:03 devstack sudo[94564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660.info Jul 16 23:23:03 devstack sudo[94564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:04 devstack sudo[94564]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-aa055c45-3c8a-420f-a6a6-4d249a3822a5 tempest-GroupSnapshotsV319Test-633253461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660.info" returned: 0 in 0.300s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:04 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-aa055c45-3c8a-420f-a6a6-4d249a3822a5 tempest-GroupSnapshotsV319Test-633253461 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660.info is being set with open permissions: ugo+rw: NotImplementedError Jul 16 23:23:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-aa055c45-3c8a-420f-a6a6-4d249a3822a5 tempest-GroupSnapshotsV319Test-633253461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:04 devstack sudo[94568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660.info Jul 16 23:23:04 devstack sudo[94568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:04 devstack sudo[94568]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-aa055c45-3c8a-420f-a6a6-4d249a3822a5 tempest-GroupSnapshotsV319Test-633253461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660.info" returned: 0 in 0.260s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-aa055c45-3c8a-420f-a6a6-4d249a3822a5 tempest-GroupSnapshotsV319Test-633253461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.475s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:23:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ad921f06-3873-432e-ba5a-b6229bc66e2d tempest-VolumesTransfersTest-1823450635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.779s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:23:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ad921f06-3873-432e-ba5a-b6229bc66e2d tempest-VolumesTransfersTest-1823450635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2134327469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea1296d-3197-4d39-8fae-6e3835caef6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d4ce369322b46dd94b92ab4ea68ab4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:23:04Z,use_quota=True,user_id='a2e8081aa17d456c90bd1dcaf410d6f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:23:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-ad921f06-3873-432e-ba5a-b6229bc66e2d tempest-VolumesTransfersTest-1823450635 None] Creating volume eea1296d-3197-4d39-8fae-6e3835caef6a {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:23:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ad921f06-3873-432e-ba5a-b6229bc66e2d tempest-VolumesTransfersTest-1823450635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:23:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ad921f06-3873-432e-ba5a-b6229bc66e2d tempest-VolumesTransfersTest-1823450635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:23:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ad921f06-3873-432e-ba5a-b6229bc66e2d tempest-VolumesTransfersTest-1823450635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:23:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ad921f06-3873-432e-ba5a-b6229bc66e2d tempest-VolumesTransfersTest-1823450635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:23:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ad921f06-3873-432e-ba5a-b6229bc66e2d tempest-VolumesTransfersTest-1823450635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:23:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ad921f06-3873-432e-ba5a-b6229bc66e2d tempest-VolumesTransfersTest-1823450635 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:23:04 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-ad921f06-3873-432e-ba5a-b6229bc66e2d tempest-VolumesTransfersTest-1823450635 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:23:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ad921f06-3873-432e-ba5a-b6229bc66e2d tempest-VolumesTransfersTest-1823450635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-eea1296d-3197-4d39-8fae-6e3835caef6a 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:04 devstack sudo[94571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-eea1296d-3197-4d39-8fae-6e3835caef6a 1073741824 Jul 16 23:23:04 devstack sudo[94571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:04 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-aa055c45-3c8a-420f-a6a6-4d249a3822a5 tempest-GroupSnapshotsV319Test-633253461 None] group_snapshot 8c3197f0-9af1-40d1-8142-fc6ebfbca94a: created successfully Jul 16 23:23:05 devstack sudo[94571]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ad921f06-3873-432e-ba5a-b6229bc66e2d tempest-VolumesTransfersTest-1823450635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-eea1296d-3197-4d39-8fae-6e3835caef6a 1073741824" returned: 0 in 0.567s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ad921f06-3873-432e-ba5a-b6229bc66e2d tempest-VolumesTransfersTest-1823450635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-eea1296d-3197-4d39-8fae-6e3835caef6a {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:05 devstack sudo[94580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-eea1296d-3197-4d39-8fae-6e3835caef6a Jul 16 23:23:05 devstack sudo[94580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:05 devstack sudo[94580]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ad921f06-3873-432e-ba5a-b6229bc66e2d tempest-VolumesTransfersTest-1823450635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-eea1296d-3197-4d39-8fae-6e3835caef6a" returned: 0 in 0.391s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:05 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ad921f06-3873-432e-ba5a-b6229bc66e2d tempest-VolumesTransfersTest-1823450635 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:23:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ad921f06-3873-432e-ba5a-b6229bc66e2d tempest-VolumesTransfersTest-1823450635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:23:05 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ad921f06-3873-432e-ba5a-b6229bc66e2d tempest-VolumesTransfersTest-1823450635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (859e56f8-5d09-4826-bf2e-bfa8b76cf8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eea1296d-3197-4d39-8fae-6e3835caef6a', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:05 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ad921f06-3873-432e-ba5a-b6229bc66e2d tempest-VolumesTransfersTest-1823450635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd2b0760-88b2-4c13-942d-564af1791b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:05 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-ad921f06-3873-432e-ba5a-b6229bc66e2d tempest-VolumesTransfersTest-1823450635 None] Volume volume-eea1296d-3197-4d39-8fae-6e3835caef6a (eea1296d-3197-4d39-8fae-6e3835caef6a): created successfully Jul 16 23:23:05 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ad921f06-3873-432e-ba5a-b6229bc66e2d tempest-VolumesTransfersTest-1823450635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd2b0760-88b2-4c13-942d-564af1791b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:05 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ad921f06-3873-432e-ba5a-b6229bc66e2d tempest-VolumesTransfersTest-1823450635 None] Flow 'volume_create_manager' (2bc9abdd-a1dd-4f3f-8f44-c996562d44f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:23:05 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-ad921f06-3873-432e-ba5a-b6229bc66e2d tempest-VolumesTransfersTest-1823450635 None] Created volume successfully. Jul 16 23:23:05 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-40a0408f-a281-4328-ba75-decaca6a29f7 tempest-GroupSnapshotsV319Test-633253461 None] group_snapshot 8c3197f0-9af1-40d1-8142-fc6ebfbca94a: deleting Jul 16 23:23:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-40a0408f-a281-4328-ba75-decaca6a29f7 tempest-GroupSnapshotsV319Test-633253461 None] group_snapshot 8c3197f0-9af1-40d1-8142-fc6ebfbca94a: deleting {{(pid=87607) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 16 23:23:06 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-40a0408f-a281-4328-ba75-decaca6a29f7 tempest-GroupSnapshotsV319Test-633253461 None] Acquiring lock "cinder-quobyte-117c6c51-a15a-41fe-8481-d5e07a112660" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:23:06 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-40a0408f-a281-4328-ba75-decaca6a29f7 tempest-GroupSnapshotsV319Test-633253461 None] Lock "cinder-quobyte-117c6c51-a15a-41fe-8481-d5e07a112660" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:23:06 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-40a0408f-a281-4328-ba75-decaca6a29f7 tempest-GroupSnapshotsV319Test-633253461 None] Acquiring lock "cinder-quobyte-7607a5ca-d46f-4afe-801e-2be547cf9eb9" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:23:06 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-40a0408f-a281-4328-ba75-decaca6a29f7 tempest-GroupSnapshotsV319Test-633253461 None] Lock "cinder-quobyte-7607a5ca-d46f-4afe-801e-2be547cf9eb9" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:23:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-40a0408f-a281-4328-ba75-decaca6a29f7 tempest-GroupSnapshotsV319Test-633253461 None] Deleting offline snapshot 7607a5ca-d46f-4afe-801e-2be547cf9eb9 of volume 117c6c51-a15a-41fe-8481-d5e07a112660 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:23:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-40a0408f-a281-4328-ba75-decaca6a29f7 tempest-GroupSnapshotsV319Test-633253461 None] snapshot_file for this snap is: volume-117c6c51-a15a-41fe-8481-d5e07a112660.7607a5ca-d46f-4afe-801e-2be547cf9eb9 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:23:06 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[2455f7ac-86fe-4404-87c7-46629ed7075e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:23:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-40a0408f-a281-4328-ba75-decaca6a29f7 tempest-GroupSnapshotsV319Test-633253461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660.7607a5ca-d46f-4afe-801e-2be547cf9eb9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:06 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ddd7ac47-1ac0-4248-8dc7-6320c422e1c1 tempest-VolumesTransfersTest-1348236661 None] Acquiring lock "cinder-eea1296d-3197-4d39-8fae-6e3835caef6a-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:23:06 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ddd7ac47-1ac0-4248-8dc7-6320c422e1c1 tempest-VolumesTransfersTest-1348236661 None] Lock "cinder-eea1296d-3197-4d39-8fae-6e3835caef6a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:23:06 devstack sudo[94604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660.7607a5ca-d46f-4afe-801e-2be547cf9eb9 Jul 16 23:23:06 devstack sudo[94604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:06 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ddd7ac47-1ac0-4248-8dc7-6320c422e1c1 tempest-VolumesTransfersTest-1348236661 None] Acquiring lock "cinder-quobyte-eea1296d-3197-4d39-8fae-6e3835caef6a" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:23:06 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ddd7ac47-1ac0-4248-8dc7-6320c422e1c1 tempest-VolumesTransfersTest-1348236661 None] Lock "cinder-quobyte-eea1296d-3197-4d39-8fae-6e3835caef6a" acquired by "delete_volume" :: waited 0.022s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:23:06 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5117041-3ded-426c-98bb-d8ce841cb9fa]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:23:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ddd7ac47-1ac0-4248-8dc7-6320c422e1c1 tempest-VolumesTransfersTest-1348236661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-eea1296d-3197-4d39-8fae-6e3835caef6a {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:06 devstack sudo[94606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-eea1296d-3197-4d39-8fae-6e3835caef6a Jul 16 23:23:06 devstack sudo[94606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:06 devstack sudo[94604]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-40a0408f-a281-4328-ba75-decaca6a29f7 tempest-GroupSnapshotsV319Test-633253461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660.7607a5ca-d46f-4afe-801e-2be547cf9eb9" returned: 0 in 0.768s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-40a0408f-a281-4328-ba75-decaca6a29f7 tempest-GroupSnapshotsV319Test-633253461 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-117c6c51-a15a-41fe-8481-d5e07a112660(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:23:06 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea81c52-1e75-4b2f-8ca4-4e1c2f965e68]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:23:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-40a0408f-a281-4328-ba75-decaca6a29f7 tempest-GroupSnapshotsV319Test-633253461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:07 devstack sudo[94606]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ddd7ac47-1ac0-4248-8dc7-6320c422e1c1 tempest-VolumesTransfersTest-1348236661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-eea1296d-3197-4d39-8fae-6e3835caef6a" returned: 0 in 0.574s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ddd7ac47-1ac0-4248-8dc7-6320c422e1c1 tempest-VolumesTransfersTest-1348236661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-eea1296d-3197-4d39-8fae-6e3835caef6a {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:07 devstack sudo[94617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-eea1296d-3197-4d39-8fae-6e3835caef6a Jul 16 23:23:07 devstack sudo[94617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:07 devstack sudo[94615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660 Jul 16 23:23:07 devstack sudo[94615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:07 devstack sudo[94617]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ddd7ac47-1ac0-4248-8dc7-6320c422e1c1 tempest-VolumesTransfersTest-1348236661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-eea1296d-3197-4d39-8fae-6e3835caef6a" returned: 0 in 0.405s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:07 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ddd7ac47-1ac0-4248-8dc7-6320c422e1c1 tempest-VolumesTransfersTest-1348236661 None] Lock "cinder-quobyte-eea1296d-3197-4d39-8fae-6e3835caef6a" released by "delete_volume" :: held 1.050s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:23:07 devstack sudo[94615]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-40a0408f-a281-4328-ba75-decaca6a29f7 tempest-GroupSnapshotsV319Test-633253461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660" returned: 0 in 0.520s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-40a0408f-a281-4328-ba75-decaca6a29f7 tempest-GroupSnapshotsV319Test-633253461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660.7607a5ca-d46f-4afe-801e-2be547cf9eb9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:07 devstack sudo[94626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660.7607a5ca-d46f-4afe-801e-2be547cf9eb9 Jul 16 23:23:07 devstack sudo[94626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:07 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-ddd7ac47-1ac0-4248-8dc7-6320c422e1c1 tempest-VolumesTransfersTest-1348236661 None] Created reservations ['5a7ee2be-ffbe-491a-907c-4b2f332db4d1', 'bad218a9-dd58-4608-abcf-9b6a3fe71230', '4958e343-468a-486b-97fe-d8210f2d54fd', '42b679bd-2d40-4be3-8d25-43e0ef0423bd'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:23:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ddd7ac47-1ac0-4248-8dc7-6320c422e1c1 tempest-VolumesTransfersTest-1348236661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:23:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ddd7ac47-1ac0-4248-8dc7-6320c422e1c1 tempest-VolumesTransfersTest-1348236661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:23:07 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ddd7ac47-1ac0-4248-8dc7-6320c422e1c1 tempest-VolumesTransfersTest-1348236661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:23:07 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ddd7ac47-1ac0-4248-8dc7-6320c422e1c1 tempest-VolumesTransfersTest-1348236661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:23:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ddd7ac47-1ac0-4248-8dc7-6320c422e1c1 tempest-VolumesTransfersTest-1348236661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:23:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ddd7ac47-1ac0-4248-8dc7-6320c422e1c1 tempest-VolumesTransfersTest-1348236661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:07 devstack sudo[94628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:23:07 devstack sudo[94628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:08 devstack sudo[94628]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:08 devstack sudo[94626]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ddd7ac47-1ac0-4248-8dc7-6320c422e1c1 tempest-VolumesTransfersTest-1348236661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.289s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:08 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-ddd7ac47-1ac0-4248-8dc7-6320c422e1c1 tempest-VolumesTransfersTest-1348236661 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:23:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-40a0408f-a281-4328-ba75-decaca6a29f7 tempest-GroupSnapshotsV319Test-633253461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660.7607a5ca-d46f-4afe-801e-2be547cf9eb9" returned: 0 in 0.550s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-40a0408f-a281-4328-ba75-decaca6a29f7 tempest-GroupSnapshotsV319Test-633253461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660.7607a5ca-d46f-4afe-801e-2be547cf9eb9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:08 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-ddd7ac47-1ac0-4248-8dc7-6320c422e1c1 tempest-VolumesTransfersTest-1348236661 None] Deleted volume successfully. Jul 16 23:23:08 devstack sudo[94634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660.7607a5ca-d46f-4afe-801e-2be547cf9eb9 Jul 16 23:23:08 devstack sudo[94634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:08 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ddd7ac47-1ac0-4248-8dc7-6320c422e1c1 tempest-VolumesTransfersTest-1348236661 None] Lock "cinder-eea1296d-3197-4d39-8fae-6e3835caef6a-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:23:08 devstack sudo[94634]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-40a0408f-a281-4328-ba75-decaca6a29f7 tempest-GroupSnapshotsV319Test-633253461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660.7607a5ca-d46f-4afe-801e-2be547cf9eb9" returned: 0 in 0.269s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:08 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-40a0408f-a281-4328-ba75-decaca6a29f7 tempest-GroupSnapshotsV319Test-633253461 None] Lock "cinder-quobyte-7607a5ca-d46f-4afe-801e-2be547cf9eb9" released by "_delete_snapshot" :: held 2.258s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:23:08 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-40a0408f-a281-4328-ba75-decaca6a29f7 tempest-GroupSnapshotsV319Test-633253461 None] Lock "cinder-quobyte-117c6c51-a15a-41fe-8481-d5e07a112660" released by "delete_snapshot" :: held 2.299s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:23:08 devstack cinder-volume[87607]: WARNING cinder.quota [None req-40a0408f-a281-4328-ba75-decaca6a29f7 tempest-GroupSnapshotsV319Test-633253461 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-985363521 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-985363521, it is now deprecated. Please use the default quota class for default quota. Jul 16 23:23:08 devstack cinder-volume[87607]: WARNING cinder.quota [None req-40a0408f-a281-4328-ba75-decaca6a29f7 tempest-GroupSnapshotsV319Test-633253461 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-985363521 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-985363521, it is now deprecated. Please use the default quota class for default quota. Jul 16 23:23:08 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-40a0408f-a281-4328-ba75-decaca6a29f7 tempest-GroupSnapshotsV319Test-633253461 None] Created reservations ['eb85d0ca-fd00-4805-aa0d-5c960a295404', 'bcbaf2af-694e-4190-b30b-eea7ee544346', 'f719dc0b-6d4c-4dc8-b893-9b3b4816b915', '794ef4d2-b9e9-4414-9640-34e2af9e0df2'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:23:08 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-40a0408f-a281-4328-ba75-decaca6a29f7 tempest-GroupSnapshotsV319Test-633253461 None] group_snapshot 8c3197f0-9af1-40d1-8142-fc6ebfbca94a: deleted successfully Jul 16 23:23:09 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ca52e592-5758-4a7f-af35-d6dfbccb875e tempest-GroupSnapshotsV319Test-633253461 None] Acquiring lock "cinder-quobyte-117c6c51-a15a-41fe-8481-d5e07a112660" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:23:09 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ca52e592-5758-4a7f-af35-d6dfbccb875e tempest-GroupSnapshotsV319Test-633253461 None] Lock "cinder-quobyte-117c6c51-a15a-41fe-8481-d5e07a112660" acquired by "delete_volume" :: waited 0.033s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:23:09 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5b4f8f-908c-4ce7-9555-95c58734f0de]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:23:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca52e592-5758-4a7f-af35-d6dfbccb875e tempest-GroupSnapshotsV319Test-633253461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:10 devstack sudo[94639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660 Jul 16 23:23:10 devstack sudo[94639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:10 devstack sudo[94639]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca52e592-5758-4a7f-af35-d6dfbccb875e tempest-GroupSnapshotsV319Test-633253461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660" returned: 0 in 0.415s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca52e592-5758-4a7f-af35-d6dfbccb875e tempest-GroupSnapshotsV319Test-633253461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:10 devstack sudo[94644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660 Jul 16 23:23:10 devstack sudo[94644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:10 devstack sudo[94644]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca52e592-5758-4a7f-af35-d6dfbccb875e tempest-GroupSnapshotsV319Test-633253461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-117c6c51-a15a-41fe-8481-d5e07a112660" returned: 0 in 0.303s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:10 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ca52e592-5758-4a7f-af35-d6dfbccb875e tempest-GroupSnapshotsV319Test-633253461 None] Lock "cinder-quobyte-117c6c51-a15a-41fe-8481-d5e07a112660" released by "delete_volume" :: held 0.800s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:23:10 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-ca52e592-5758-4a7f-af35-d6dfbccb875e tempest-GroupSnapshotsV319Test-633253461 None] Created reservations ['3f817a0c-1cbf-49d4-a3c8-beb771365ad2'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:23:10 devstack cinder-volume[87607]: WARNING cinder.quota [None req-ca52e592-5758-4a7f-af35-d6dfbccb875e tempest-GroupSnapshotsV319Test-633253461 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-985363521 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-985363521, it is now deprecated. Please use the default quota class for default quota. Jul 16 23:23:10 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-ca52e592-5758-4a7f-af35-d6dfbccb875e tempest-GroupSnapshotsV319Test-633253461 None] Created reservations ['e3b8dde0-da6c-41cc-9050-8b9effb915a7', '3931dcd2-444a-4a84-9fd3-98c9f99c0803', 'f200992e-6fb9-4dca-9e7e-fbdcdf7c639b', '0c35c20f-5e4f-4a63-8c36-f55ea5bb4b8f'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:23:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca52e592-5758-4a7f-af35-d6dfbccb875e tempest-GroupSnapshotsV319Test-633253461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:23:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca52e592-5758-4a7f-af35-d6dfbccb875e tempest-GroupSnapshotsV319Test-633253461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:23:10 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca52e592-5758-4a7f-af35-d6dfbccb875e tempest-GroupSnapshotsV319Test-633253461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:23:10 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca52e592-5758-4a7f-af35-d6dfbccb875e tempest-GroupSnapshotsV319Test-633253461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:23:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca52e592-5758-4a7f-af35-d6dfbccb875e tempest-GroupSnapshotsV319Test-633253461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:23:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca52e592-5758-4a7f-af35-d6dfbccb875e tempest-GroupSnapshotsV319Test-633253461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:10 devstack sudo[94647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:23:10 devstack sudo[94647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:11 devstack sudo[94647]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca52e592-5758-4a7f-af35-d6dfbccb875e tempest-GroupSnapshotsV319Test-633253461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.331s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:11 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-ca52e592-5758-4a7f-af35-d6dfbccb875e tempest-GroupSnapshotsV319Test-633253461 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:23:11 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-ca52e592-5758-4a7f-af35-d6dfbccb875e tempest-GroupSnapshotsV319Test-633253461 None] Delete group completed successfully. Jul 16 23:23:19 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9d66415-6bc2-44dd-9854-d68cc3a7ce1d tempest-VolumesTransfersV357Test-1047171645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:23:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f9d66415-6bc2-44dd-9854-d68cc3a7ce1d tempest-VolumesTransfersV357Test-1047171645 None] Flow 'volume_create_manager' (74c37c8d-ab41-40d6-bbd4-21bc00bee166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:23:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f9d66415-6bc2-44dd-9854-d68cc3a7ce1d tempest-VolumesTransfersV357Test-1047171645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (432663f2-d8c5-4caa-8faf-0b7494a3a385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f9d66415-6bc2-44dd-9854-d68cc3a7ce1d tempest-VolumesTransfersV357Test-1047171645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (432663f2-d8c5-4caa-8faf-0b7494a3a385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1301476291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=362e8368-faa8-48ad-93f9-0ead177807e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1821b1172ba347b58613b251e53477dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:23:19Z,use_quota=True,user_id='3aa9d9b035fd4513bb2269b843877127',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f9d66415-6bc2-44dd-9854-d68cc3a7ce1d tempest-VolumesTransfersV357Test-1047171645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (089e0aca-3933-4907-8307-711d2a662dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f9d66415-6bc2-44dd-9854-d68cc3a7ce1d tempest-VolumesTransfersV357Test-1047171645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (089e0aca-3933-4907-8307-711d2a662dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f9d66415-6bc2-44dd-9854-d68cc3a7ce1d tempest-VolumesTransfersV357Test-1047171645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3aeea75-126a-4194-901c-e7d4b1ed9048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f9d66415-6bc2-44dd-9854-d68cc3a7ce1d tempest-VolumesTransfersV357Test-1047171645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3aeea75-126a-4194-901c-e7d4b1ed9048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '362e8368-faa8-48ad-93f9-0ead177807e6', 'volume_name': 'volume-362e8368-faa8-48ad-93f9-0ead177807e6', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f9d66415-6bc2-44dd-9854-d68cc3a7ce1d tempest-VolumesTransfersV357Test-1047171645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdc35fde-7848-4d8c-b244-c69da33e8108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f9d66415-6bc2-44dd-9854-d68cc3a7ce1d tempest-VolumesTransfersV357Test-1047171645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdc35fde-7848-4d8c-b244-c69da33e8108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f9d66415-6bc2-44dd-9854-d68cc3a7ce1d tempest-VolumesTransfersV357Test-1047171645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95476cb8-a44e-4db3-af0d-75a686b9e6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:19 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-f9d66415-6bc2-44dd-9854-d68cc3a7ce1d tempest-VolumesTransfersV357Test-1047171645 None] Volume 362e8368-faa8-48ad-93f9-0ead177807e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-362e8368-faa8-48ad-93f9-0ead177807e6', 'volume_size': 1} Jul 16 23:23:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f9d66415-6bc2-44dd-9854-d68cc3a7ce1d tempest-VolumesTransfersV357Test-1047171645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:23:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f9d66415-6bc2-44dd-9854-d68cc3a7ce1d tempest-VolumesTransfersV357Test-1047171645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:23:19 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f9d66415-6bc2-44dd-9854-d68cc3a7ce1d tempest-VolumesTransfersV357Test-1047171645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1301476291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=362e8368-faa8-48ad-93f9-0ead177807e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1821b1172ba347b58613b251e53477dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:23:19Z,use_quota=True,user_id='3aa9d9b035fd4513bb2269b843877127',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:23:19 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-f9d66415-6bc2-44dd-9854-d68cc3a7ce1d tempest-VolumesTransfersV357Test-1047171645 None] Creating volume 362e8368-faa8-48ad-93f9-0ead177807e6 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:23:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f9d66415-6bc2-44dd-9854-d68cc3a7ce1d tempest-VolumesTransfersV357Test-1047171645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:23:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f9d66415-6bc2-44dd-9854-d68cc3a7ce1d tempest-VolumesTransfersV357Test-1047171645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:23:19 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f9d66415-6bc2-44dd-9854-d68cc3a7ce1d tempest-VolumesTransfersV357Test-1047171645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:23:19 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f9d66415-6bc2-44dd-9854-d68cc3a7ce1d tempest-VolumesTransfersV357Test-1047171645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:23:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f9d66415-6bc2-44dd-9854-d68cc3a7ce1d tempest-VolumesTransfersV357Test-1047171645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:23:19 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f9d66415-6bc2-44dd-9854-d68cc3a7ce1d tempest-VolumesTransfersV357Test-1047171645 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:23:19 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-f9d66415-6bc2-44dd-9854-d68cc3a7ce1d tempest-VolumesTransfersV357Test-1047171645 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:23:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f9d66415-6bc2-44dd-9854-d68cc3a7ce1d tempest-VolumesTransfersV357Test-1047171645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-362e8368-faa8-48ad-93f9-0ead177807e6 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:19 devstack sudo[94677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-362e8368-faa8-48ad-93f9-0ead177807e6 1073741824 Jul 16 23:23:19 devstack sudo[94677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:20 devstack sudo[94677]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f9d66415-6bc2-44dd-9854-d68cc3a7ce1d tempest-VolumesTransfersV357Test-1047171645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-362e8368-faa8-48ad-93f9-0ead177807e6 1073741824" returned: 0 in 0.963s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f9d66415-6bc2-44dd-9854-d68cc3a7ce1d tempest-VolumesTransfersV357Test-1047171645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-362e8368-faa8-48ad-93f9-0ead177807e6 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:20 devstack sudo[94734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-362e8368-faa8-48ad-93f9-0ead177807e6 Jul 16 23:23:20 devstack sudo[94734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:21 devstack sudo[94734]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f9d66415-6bc2-44dd-9854-d68cc3a7ce1d tempest-VolumesTransfersV357Test-1047171645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-362e8368-faa8-48ad-93f9-0ead177807e6" returned: 0 in 0.575s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:21 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f9d66415-6bc2-44dd-9854-d68cc3a7ce1d tempest-VolumesTransfersV357Test-1047171645 None] <== create_volume: return (1648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:23:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f9d66415-6bc2-44dd-9854-d68cc3a7ce1d tempest-VolumesTransfersV357Test-1047171645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.650s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:23:21 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f9d66415-6bc2-44dd-9854-d68cc3a7ce1d tempest-VolumesTransfersV357Test-1047171645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95476cb8-a44e-4db3-af0d-75a686b9e6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-362e8368-faa8-48ad-93f9-0ead177807e6', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:21 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f9d66415-6bc2-44dd-9854-d68cc3a7ce1d tempest-VolumesTransfersV357Test-1047171645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fff4763f-b9c1-4c98-aa1a-18fc57dbb04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:21 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-f9d66415-6bc2-44dd-9854-d68cc3a7ce1d tempest-VolumesTransfersV357Test-1047171645 None] Volume volume-362e8368-faa8-48ad-93f9-0ead177807e6 (362e8368-faa8-48ad-93f9-0ead177807e6): created successfully Jul 16 23:23:21 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f9d66415-6bc2-44dd-9854-d68cc3a7ce1d tempest-VolumesTransfersV357Test-1047171645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fff4763f-b9c1-4c98-aa1a-18fc57dbb04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:21 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f9d66415-6bc2-44dd-9854-d68cc3a7ce1d tempest-VolumesTransfersV357Test-1047171645 None] Flow 'volume_create_manager' (74c37c8d-ab41-40d6-bbd4-21bc00bee166) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:23:21 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-f9d66415-6bc2-44dd-9854-d68cc3a7ce1d tempest-VolumesTransfersV357Test-1047171645 None] Created volume successfully. Jul 16 23:23:22 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-b498b8dd-6bd6-4f54-91d6-767e7a0d0cd2 tempest-VolumesTransfersV357Test-916856034 None] Transfer volume completed successfully. Jul 16 23:23:23 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b6f939f1-ca14-4851-9eb2-f39f200621c7 tempest-VolumesTransfersV357Test-333754756 None] Acquiring lock "cinder-362e8368-faa8-48ad-93f9-0ead177807e6-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:23:23 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b6f939f1-ca14-4851-9eb2-f39f200621c7 tempest-VolumesTransfersV357Test-333754756 None] Lock "cinder-362e8368-faa8-48ad-93f9-0ead177807e6-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:23:23 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b6f939f1-ca14-4851-9eb2-f39f200621c7 tempest-VolumesTransfersV357Test-333754756 None] Acquiring lock "cinder-quobyte-362e8368-faa8-48ad-93f9-0ead177807e6" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:23:23 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b6f939f1-ca14-4851-9eb2-f39f200621c7 tempest-VolumesTransfersV357Test-333754756 None] Lock "cinder-quobyte-362e8368-faa8-48ad-93f9-0ead177807e6" acquired by "delete_volume" :: waited 0.025s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:23:23 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fae367-b2cc-46e8-ad18-20d2b935606b]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:23:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b6f939f1-ca14-4851-9eb2-f39f200621c7 tempest-VolumesTransfersV357Test-333754756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-362e8368-faa8-48ad-93f9-0ead177807e6 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:24 devstack sudo[94755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-362e8368-faa8-48ad-93f9-0ead177807e6 Jul 16 23:23:24 devstack sudo[94755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:24 devstack sudo[94755]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b6f939f1-ca14-4851-9eb2-f39f200621c7 tempest-VolumesTransfersV357Test-333754756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-362e8368-faa8-48ad-93f9-0ead177807e6" returned: 0 in 0.561s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b6f939f1-ca14-4851-9eb2-f39f200621c7 tempest-VolumesTransfersV357Test-333754756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-362e8368-faa8-48ad-93f9-0ead177807e6 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:24 devstack sudo[94760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-362e8368-faa8-48ad-93f9-0ead177807e6 Jul 16 23:23:24 devstack sudo[94760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:24 devstack sudo[94760]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b6f939f1-ca14-4851-9eb2-f39f200621c7 tempest-VolumesTransfersV357Test-333754756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-362e8368-faa8-48ad-93f9-0ead177807e6" returned: 0 in 0.410s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:24 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b6f939f1-ca14-4851-9eb2-f39f200621c7 tempest-VolumesTransfersV357Test-333754756 None] Lock "cinder-quobyte-362e8368-faa8-48ad-93f9-0ead177807e6" released by "delete_volume" :: held 1.088s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:23:25 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-b6f939f1-ca14-4851-9eb2-f39f200621c7 tempest-VolumesTransfersV357Test-333754756 None] Created reservations ['8ff4a2bc-ea81-4754-aa11-c5ae72c488c3', '9a0e7afc-4529-4968-b336-b852f400011a', '16df1bc0-7934-4feb-a752-6480fbebd9bb', '4e9c88de-0a30-4a10-b71c-bcd8e8dd2048'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:23:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b6f939f1-ca14-4851-9eb2-f39f200621c7 tempest-VolumesTransfersV357Test-333754756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:23:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b6f939f1-ca14-4851-9eb2-f39f200621c7 tempest-VolumesTransfersV357Test-333754756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:23:25 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-b6f939f1-ca14-4851-9eb2-f39f200621c7 tempest-VolumesTransfersV357Test-333754756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:23:25 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-b6f939f1-ca14-4851-9eb2-f39f200621c7 tempest-VolumesTransfersV357Test-333754756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:23:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b6f939f1-ca14-4851-9eb2-f39f200621c7 tempest-VolumesTransfersV357Test-333754756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:23:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b6f939f1-ca14-4851-9eb2-f39f200621c7 tempest-VolumesTransfersV357Test-333754756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:25 devstack sudo[94763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:23:25 devstack sudo[94763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:25 devstack sudo[94763]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b6f939f1-ca14-4851-9eb2-f39f200621c7 tempest-VolumesTransfersV357Test-333754756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.351s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:25 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-b6f939f1-ca14-4851-9eb2-f39f200621c7 tempest-VolumesTransfersV357Test-333754756 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:23:25 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-b6f939f1-ca14-4851-9eb2-f39f200621c7 tempest-VolumesTransfersV357Test-333754756 None] Deleted volume successfully. Jul 16 23:23:25 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b6f939f1-ca14-4851-9eb2-f39f200621c7 tempest-VolumesTransfersV357Test-333754756 None] Lock "cinder-362e8368-faa8-48ad-93f9-0ead177807e6-delete_volume" released by "delete_volume" :: held 1.855s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:23:27 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfcd1187-92eb-492a-b306-6b9f794e1eb7 tempest-VolumesCloneTest-2079031590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:23:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bfcd1187-92eb-492a-b306-6b9f794e1eb7 tempest-VolumesCloneTest-2079031590 None] Flow 'volume_create_manager' (ac748275-b4c0-4a71-b823-9ff0c78c8af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:23:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bfcd1187-92eb-492a-b306-6b9f794e1eb7 tempest-VolumesCloneTest-2079031590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d1dc419-05bf-41e4-bf58-455841b40fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bfcd1187-92eb-492a-b306-6b9f794e1eb7 tempest-VolumesCloneTest-2079031590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d1dc419-05bf-41e4-bf58-455841b40fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1788149050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c3f4ea9-050b-4a49-8350-ef4ec0732c83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a5fb87a97aa4818a255fc7c908aa31d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:23:27Z,use_quota=True,user_id='ae58258d951f4aaf9b2313855f33f703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bfcd1187-92eb-492a-b306-6b9f794e1eb7 tempest-VolumesCloneTest-2079031590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b0d5923-c9cd-4bf3-a4ec-4e69ca92b0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bfcd1187-92eb-492a-b306-6b9f794e1eb7 tempest-VolumesCloneTest-2079031590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b0d5923-c9cd-4bf3-a4ec-4e69ca92b0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bfcd1187-92eb-492a-b306-6b9f794e1eb7 tempest-VolumesCloneTest-2079031590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d713bf2c-fee2-427e-b8a6-55f492e60995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bfcd1187-92eb-492a-b306-6b9f794e1eb7 tempest-VolumesCloneTest-2079031590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d713bf2c-fee2-427e-b8a6-55f492e60995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c3f4ea9-050b-4a49-8350-ef4ec0732c83', 'volume_name': 'volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bfcd1187-92eb-492a-b306-6b9f794e1eb7 tempest-VolumesCloneTest-2079031590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02175ff9-1afa-4d93-b29a-e189ab3deeb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bfcd1187-92eb-492a-b306-6b9f794e1eb7 tempest-VolumesCloneTest-2079031590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02175ff9-1afa-4d93-b29a-e189ab3deeb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bfcd1187-92eb-492a-b306-6b9f794e1eb7 tempest-VolumesCloneTest-2079031590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d11cd10-9493-4d5b-b930-d9ddd524620e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:27 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-bfcd1187-92eb-492a-b306-6b9f794e1eb7 tempest-VolumesCloneTest-2079031590 None] Volume 5c3f4ea9-050b-4a49-8350-ef4ec0732c83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83', 'volume_size': 1} Jul 16 23:23:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bfcd1187-92eb-492a-b306-6b9f794e1eb7 tempest-VolumesCloneTest-2079031590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:23:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bfcd1187-92eb-492a-b306-6b9f794e1eb7 tempest-VolumesCloneTest-2079031590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:23:27 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-bfcd1187-92eb-492a-b306-6b9f794e1eb7 tempest-VolumesCloneTest-2079031590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1788149050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c3f4ea9-050b-4a49-8350-ef4ec0732c83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a5fb87a97aa4818a255fc7c908aa31d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:23:27Z,use_quota=True,user_id='ae58258d951f4aaf9b2313855f33f703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:23:27 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-bfcd1187-92eb-492a-b306-6b9f794e1eb7 tempest-VolumesCloneTest-2079031590 None] Creating volume 5c3f4ea9-050b-4a49-8350-ef4ec0732c83 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:23:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bfcd1187-92eb-492a-b306-6b9f794e1eb7 tempest-VolumesCloneTest-2079031590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:23:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bfcd1187-92eb-492a-b306-6b9f794e1eb7 tempest-VolumesCloneTest-2079031590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:23:27 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-bfcd1187-92eb-492a-b306-6b9f794e1eb7 tempest-VolumesCloneTest-2079031590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:23:27 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-bfcd1187-92eb-492a-b306-6b9f794e1eb7 tempest-VolumesCloneTest-2079031590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:23:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bfcd1187-92eb-492a-b306-6b9f794e1eb7 tempest-VolumesCloneTest-2079031590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:23:27 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-bfcd1187-92eb-492a-b306-6b9f794e1eb7 tempest-VolumesCloneTest-2079031590 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:23:27 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-bfcd1187-92eb-492a-b306-6b9f794e1eb7 tempest-VolumesCloneTest-2079031590 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:23:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bfcd1187-92eb-492a-b306-6b9f794e1eb7 tempest-VolumesCloneTest-2079031590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:27 devstack sudo[94768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83 1073741824 Jul 16 23:23:27 devstack sudo[94768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:27 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-3efa37af-6b2f-45d4-a113-9c370111dbb3 tempest-VolumesTransfersV357Test-1047171645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:23:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3efa37af-6b2f-45d4-a113-9c370111dbb3 tempest-VolumesTransfersV357Test-1047171645 None] Flow 'volume_create_manager' (8b75070b-27eb-4b68-9469-3143ecf58302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:23:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3efa37af-6b2f-45d4-a113-9c370111dbb3 tempest-VolumesTransfersV357Test-1047171645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d58012-0520-4986-8667-004a5df7766d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3efa37af-6b2f-45d4-a113-9c370111dbb3 tempest-VolumesTransfersV357Test-1047171645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d58012-0520-4986-8667-004a5df7766d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1005728843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aa10be0-6e5b-4617-9c1e-7067d940e5c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1821b1172ba347b58613b251e53477dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:23:27Z,use_quota=True,user_id='3aa9d9b035fd4513bb2269b843877127',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3efa37af-6b2f-45d4-a113-9c370111dbb3 tempest-VolumesTransfersV357Test-1047171645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29747b8e-cf68-4196-a49b-ce3ab009a37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3efa37af-6b2f-45d4-a113-9c370111dbb3 tempest-VolumesTransfersV357Test-1047171645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29747b8e-cf68-4196-a49b-ce3ab009a37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3efa37af-6b2f-45d4-a113-9c370111dbb3 tempest-VolumesTransfersV357Test-1047171645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f103be96-661c-4461-a038-5c3973067a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3efa37af-6b2f-45d4-a113-9c370111dbb3 tempest-VolumesTransfersV357Test-1047171645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f103be96-661c-4461-a038-5c3973067a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1aa10be0-6e5b-4617-9c1e-7067d940e5c2', 'volume_name': 'volume-1aa10be0-6e5b-4617-9c1e-7067d940e5c2', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3efa37af-6b2f-45d4-a113-9c370111dbb3 tempest-VolumesTransfersV357Test-1047171645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c431dcac-137c-4ff1-bd2d-d53523294e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3efa37af-6b2f-45d4-a113-9c370111dbb3 tempest-VolumesTransfersV357Test-1047171645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c431dcac-137c-4ff1-bd2d-d53523294e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3efa37af-6b2f-45d4-a113-9c370111dbb3 tempest-VolumesTransfersV357Test-1047171645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a0e8e27-c5bd-451b-9926-c73807220d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:27 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-3efa37af-6b2f-45d4-a113-9c370111dbb3 tempest-VolumesTransfersV357Test-1047171645 None] Volume 1aa10be0-6e5b-4617-9c1e-7067d940e5c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1aa10be0-6e5b-4617-9c1e-7067d940e5c2', 'volume_size': 1} Jul 16 23:23:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3efa37af-6b2f-45d4-a113-9c370111dbb3 tempest-VolumesTransfersV357Test-1047171645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:23:27 devstack sudo[94768]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bfcd1187-92eb-492a-b306-6b9f794e1eb7 tempest-VolumesCloneTest-2079031590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83 1073741824" returned: 0 in 0.581s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bfcd1187-92eb-492a-b306-6b9f794e1eb7 tempest-VolumesCloneTest-2079031590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:27 devstack sudo[94774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83 Jul 16 23:23:27 devstack sudo[94774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:28 devstack sudo[94774]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bfcd1187-92eb-492a-b306-6b9f794e1eb7 tempest-VolumesCloneTest-2079031590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83" returned: 0 in 0.290s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:28 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-bfcd1187-92eb-492a-b306-6b9f794e1eb7 tempest-VolumesCloneTest-2079031590 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:23:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bfcd1187-92eb-492a-b306-6b9f794e1eb7 tempest-VolumesCloneTest-2079031590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:23:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3efa37af-6b2f-45d4-a113-9c370111dbb3 tempest-VolumesTransfersV357Test-1047171645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.762s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:23:28 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3efa37af-6b2f-45d4-a113-9c370111dbb3 tempest-VolumesTransfersV357Test-1047171645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1005728843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aa10be0-6e5b-4617-9c1e-7067d940e5c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1821b1172ba347b58613b251e53477dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:23:27Z,use_quota=True,user_id='3aa9d9b035fd4513bb2269b843877127',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:23:28 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-3efa37af-6b2f-45d4-a113-9c370111dbb3 tempest-VolumesTransfersV357Test-1047171645 None] Creating volume 1aa10be0-6e5b-4617-9c1e-7067d940e5c2 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:23:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3efa37af-6b2f-45d4-a113-9c370111dbb3 tempest-VolumesTransfersV357Test-1047171645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:23:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3efa37af-6b2f-45d4-a113-9c370111dbb3 tempest-VolumesTransfersV357Test-1047171645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:23:28 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3efa37af-6b2f-45d4-a113-9c370111dbb3 tempest-VolumesTransfersV357Test-1047171645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:23:28 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3efa37af-6b2f-45d4-a113-9c370111dbb3 tempest-VolumesTransfersV357Test-1047171645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:23:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3efa37af-6b2f-45d4-a113-9c370111dbb3 tempest-VolumesTransfersV357Test-1047171645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:23:28 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3efa37af-6b2f-45d4-a113-9c370111dbb3 tempest-VolumesTransfersV357Test-1047171645 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:23:28 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-3efa37af-6b2f-45d4-a113-9c370111dbb3 tempest-VolumesTransfersV357Test-1047171645 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:23:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3efa37af-6b2f-45d4-a113-9c370111dbb3 tempest-VolumesTransfersV357Test-1047171645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1aa10be0-6e5b-4617-9c1e-7067d940e5c2 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:28 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bfcd1187-92eb-492a-b306-6b9f794e1eb7 tempest-VolumesCloneTest-2079031590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d11cd10-9493-4d5b-b930-d9ddd524620e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:28 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bfcd1187-92eb-492a-b306-6b9f794e1eb7 tempest-VolumesCloneTest-2079031590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fa6c473-17df-483a-a450-9f62e56f1e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:28 devstack sudo[94777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1aa10be0-6e5b-4617-9c1e-7067d940e5c2 1073741824 Jul 16 23:23:28 devstack sudo[94777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:28 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-bfcd1187-92eb-492a-b306-6b9f794e1eb7 tempest-VolumesCloneTest-2079031590 None] Volume volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83 (5c3f4ea9-050b-4a49-8350-ef4ec0732c83): created successfully Jul 16 23:23:28 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bfcd1187-92eb-492a-b306-6b9f794e1eb7 tempest-VolumesCloneTest-2079031590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fa6c473-17df-483a-a450-9f62e56f1e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:28 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bfcd1187-92eb-492a-b306-6b9f794e1eb7 tempest-VolumesCloneTest-2079031590 None] Flow 'volume_create_manager' (ac748275-b4c0-4a71-b823-9ff0c78c8af6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:23:28 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-bfcd1187-92eb-492a-b306-6b9f794e1eb7 tempest-VolumesCloneTest-2079031590 None] Created volume successfully. Jul 16 23:23:28 devstack sudo[94777]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3efa37af-6b2f-45d4-a113-9c370111dbb3 tempest-VolumesTransfersV357Test-1047171645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1aa10be0-6e5b-4617-9c1e-7067d940e5c2 1073741824" returned: 0 in 0.499s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3efa37af-6b2f-45d4-a113-9c370111dbb3 tempest-VolumesTransfersV357Test-1047171645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1aa10be0-6e5b-4617-9c1e-7067d940e5c2 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:28 devstack sudo[94783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1aa10be0-6e5b-4617-9c1e-7067d940e5c2 Jul 16 23:23:28 devstack sudo[94783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:29 devstack sudo[94783]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3efa37af-6b2f-45d4-a113-9c370111dbb3 tempest-VolumesTransfersV357Test-1047171645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1aa10be0-6e5b-4617-9c1e-7067d940e5c2" returned: 0 in 0.397s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:29 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3efa37af-6b2f-45d4-a113-9c370111dbb3 tempest-VolumesTransfersV357Test-1047171645 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:23:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3efa37af-6b2f-45d4-a113-9c370111dbb3 tempest-VolumesTransfersV357Test-1047171645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:23:29 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3efa37af-6b2f-45d4-a113-9c370111dbb3 tempest-VolumesTransfersV357Test-1047171645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a0e8e27-c5bd-451b-9926-c73807220d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aa10be0-6e5b-4617-9c1e-7067d940e5c2', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:29 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3efa37af-6b2f-45d4-a113-9c370111dbb3 tempest-VolumesTransfersV357Test-1047171645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46e2a10d-b3a3-4cae-9a88-164f2a6939b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:29 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-3efa37af-6b2f-45d4-a113-9c370111dbb3 tempest-VolumesTransfersV357Test-1047171645 None] Volume volume-1aa10be0-6e5b-4617-9c1e-7067d940e5c2 (1aa10be0-6e5b-4617-9c1e-7067d940e5c2): created successfully Jul 16 23:23:29 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3efa37af-6b2f-45d4-a113-9c370111dbb3 tempest-VolumesTransfersV357Test-1047171645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46e2a10d-b3a3-4cae-9a88-164f2a6939b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:29 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3efa37af-6b2f-45d4-a113-9c370111dbb3 tempest-VolumesTransfersV357Test-1047171645 None] Flow 'volume_create_manager' (8b75070b-27eb-4b68-9469-3143ecf58302) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:23:29 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-3efa37af-6b2f-45d4-a113-9c370111dbb3 tempest-VolumesTransfersV357Test-1047171645 None] Created volume successfully. Jul 16 23:23:29 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:23:29 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Flow 'volume_create_manager' (33f6ed04-2d5c-4070-82ed-85a63cb44db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:23:29 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0350fbf6-3b82-4c0c-825d-41008fa6f07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:29 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0350fbf6-3b82-4c0c-825d-41008fa6f07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1236676498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=004f9ee6-f4c4-441b-bf13-1fca4281ac77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a5fb87a97aa4818a255fc7c908aa31d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:23:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=5c3f4ea9-050b-4a49-8350-ef4ec0732c83,status='creating',terminated_at=None,updated_at=2026-07-16T21:23:29Z,use_quota=True,user_id='ae58258d951f4aaf9b2313855f33f703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:29 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44b987cd-62d8-4b26-acb7-501fe870a3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:29 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44b987cd-62d8-4b26-acb7-501fe870a3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:29 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df5ae310-0a2c-4579-831f-e96b24e1e85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:29 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df5ae310-0a2c-4579-831f-e96b24e1e85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '004f9ee6-f4c4-441b-bf13-1fca4281ac77', 'volume_name': 'volume-004f9ee6-f4c4-441b-bf13-1fca4281ac77', 'volume_size': 2, 'source_volid': '5c3f4ea9-050b-4a49-8350-ef4ec0732c83', 'source_volstatus': 'available'}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:29 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1727c4ce-ba69-4fbe-b747-a64be06df768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:29 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1727c4ce-ba69-4fbe-b747-a64be06df768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:29 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32f60902-9062-4ec9-a93e-189b4d5ad137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:29 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Volume 004f9ee6-f4c4-441b-bf13-1fca4281ac77: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-004f9ee6-f4c4-441b-bf13-1fca4281ac77', 'volume_size': 2, 'source_volid': '5c3f4ea9-050b-4a49-8350-ef4ec0732c83', 'source_volstatus': 'available'} Jul 16 23:23:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:23:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:23:29 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Cloning volume 5c3f4ea9-050b-4a49-8350-ef4ec0732c83 to volume 004f9ee6-f4c4-441b-bf13-1fca4281ac77 Jul 16 23:23:29 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Creating offline snapshot eef541e4-c7c4-4654-91a5-495d7b427814 of volume 5c3f4ea9-050b-4a49-8350-ef4ec0732c83 {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:23:29 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[4937f717-302e-4184-bf6e-f3716df1e9ea]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:23:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:29 devstack sudo[94786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83 Jul 16 23:23:29 devstack sudo[94786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:30 devstack sudo[94786]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83" returned: 0 in 0.409s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83.eef541e4-c7c4-4654-91a5-495d7b427814 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:30 devstack sudo[94792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83.eef541e4-c7c4-4654-91a5-495d7b427814 1G Jul 16 23:23:30 devstack sudo[94792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:30 devstack sudo[94792]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83.eef541e4-c7c4-4654-91a5-495d7b427814 1G" returned: 0 in 0.493s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83.eef541e4-c7c4-4654-91a5-495d7b427814 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:30 devstack sudo[94798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83.eef541e4-c7c4-4654-91a5-495d7b427814 Jul 16 23:23:30 devstack sudo[94798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:30 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-9f74b4ce-70ea-408e-ac33-b183e18bd61d tempest-VolumesTransfersV357Test-333754756 None] Acquiring lock "cinder-1aa10be0-6e5b-4617-9c1e-7067d940e5c2-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:23:30 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-9f74b4ce-70ea-408e-ac33-b183e18bd61d tempest-VolumesTransfersV357Test-333754756 None] Lock "cinder-1aa10be0-6e5b-4617-9c1e-7067d940e5c2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:23:30 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-9f74b4ce-70ea-408e-ac33-b183e18bd61d tempest-VolumesTransfersV357Test-333754756 None] Acquiring lock "cinder-quobyte-1aa10be0-6e5b-4617-9c1e-7067d940e5c2" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:23:30 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-9f74b4ce-70ea-408e-ac33-b183e18bd61d tempest-VolumesTransfersV357Test-333754756 None] Lock "cinder-quobyte-1aa10be0-6e5b-4617-9c1e-7067d940e5c2" acquired by "delete_volume" :: waited 0.027s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:23:30 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7cf162-1c66-4703-ac72-e2699a9fe8f7]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:23:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-9f74b4ce-70ea-408e-ac33-b183e18bd61d tempest-VolumesTransfersV357Test-333754756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1aa10be0-6e5b-4617-9c1e-7067d940e5c2 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:31 devstack sudo[94798]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83.eef541e4-c7c4-4654-91a5-495d7b427814" returned: 0 in 0.446s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:31 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83.eef541e4-c7c4-4654-91a5-495d7b427814 is being set with open permissions: ugo+rw Jul 16 23:23:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83.eef541e4-c7c4-4654-91a5-495d7b427814 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:31 devstack sudo[94804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83.eef541e4-c7c4-4654-91a5-495d7b427814 Jul 16 23:23:31 devstack sudo[94804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:31 devstack sudo[94803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1aa10be0-6e5b-4617-9c1e-7067d940e5c2 Jul 16 23:23:31 devstack sudo[94803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:31 devstack sudo[94804]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83.eef541e4-c7c4-4654-91a5-495d7b427814" returned: 0 in 0.338s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:31 devstack sudo[94803]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-9f74b4ce-70ea-408e-ac33-b183e18bd61d tempest-VolumesTransfersV357Test-333754756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1aa10be0-6e5b-4617-9c1e-7067d940e5c2" returned: 0 in 0.534s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-9f74b4ce-70ea-408e-ac33-b183e18bd61d tempest-VolumesTransfersV357Test-333754756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1aa10be0-6e5b-4617-9c1e-7067d940e5c2 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:31 devstack sudo[94823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83.info Jul 16 23:23:31 devstack sudo[94823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:31 devstack sudo[94833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1aa10be0-6e5b-4617-9c1e-7067d940e5c2 Jul 16 23:23:31 devstack sudo[94833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:31 devstack sudo[94823]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83.info" returned: 0 in 0.375s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:31 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83.info is being set with open permissions: ugo+rw Jul 16 23:23:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:31 devstack sudo[94851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83.info Jul 16 23:23:31 devstack sudo[94851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:31 devstack sudo[94833]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-9f74b4ce-70ea-408e-ac33-b183e18bd61d tempest-VolumesTransfersV357Test-333754756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1aa10be0-6e5b-4617-9c1e-7067d940e5c2" returned: 0 in 0.415s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:31 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-9f74b4ce-70ea-408e-ac33-b183e18bd61d tempest-VolumesTransfersV357Test-333754756 None] Lock "cinder-quobyte-1aa10be0-6e5b-4617-9c1e-7067d940e5c2" released by "delete_volume" :: held 1.015s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:23:32 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-9f74b4ce-70ea-408e-ac33-b183e18bd61d tempest-VolumesTransfersV357Test-333754756 None] Created reservations ['8123b7f3-da63-465a-a16b-26e1dd110231', '2c190e15-93cf-4885-8a9a-f6848180aa57', '932392c6-6704-4156-855a-bf61738e8f2c', '8037dfda-c452-4d7b-a591-4138339c4579'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:23:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-9f74b4ce-70ea-408e-ac33-b183e18bd61d tempest-VolumesTransfersV357Test-333754756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:23:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-9f74b4ce-70ea-408e-ac33-b183e18bd61d tempest-VolumesTransfersV357Test-333754756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:23:32 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-9f74b4ce-70ea-408e-ac33-b183e18bd61d tempest-VolumesTransfersV357Test-333754756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:23:32 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-9f74b4ce-70ea-408e-ac33-b183e18bd61d tempest-VolumesTransfersV357Test-333754756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:23:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-9f74b4ce-70ea-408e-ac33-b183e18bd61d tempest-VolumesTransfersV357Test-333754756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:23:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-9f74b4ce-70ea-408e-ac33-b183e18bd61d tempest-VolumesTransfersV357Test-333754756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:32 devstack sudo[94855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:23:32 devstack sudo[94855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:32 devstack sudo[94851]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83.info" returned: 0 in 0.582s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:32 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Acquiring lock "cinder-quobyte-004f9ee6-f4c4-441b-bf13-1fca4281ac77" by "_copy_volume_from_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:23:32 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Lock "cinder-quobyte-004f9ee6-f4c4-441b-bf13-1fca4281ac77" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:23:32 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] snapshot: eef541e4-c7c4-4654-91a5-495d7b427814, volume: 004f9ee6-f4c4-441b-bf13-1fca4281ac77, {{(pid=87607) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 16 23:23:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:23:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:23:32 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:23:32 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:23:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:23:32 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[2103e93c-564b-4ab4-83b4-d33151c27018]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:23:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83.eef541e4-c7c4-4654-91a5-495d7b427814 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:32 devstack sudo[94855]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:32 devstack sudo[94858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83.eef541e4-c7c4-4654-91a5-495d7b427814 Jul 16 23:23:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-9f74b4ce-70ea-408e-ac33-b183e18bd61d tempest-VolumesTransfersV357Test-333754756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.408s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:32 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-9f74b4ce-70ea-408e-ac33-b183e18bd61d tempest-VolumesTransfersV357Test-333754756 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:23:32 devstack sudo[94858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:32 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-9f74b4ce-70ea-408e-ac33-b183e18bd61d tempest-VolumesTransfersV357Test-333754756 None] Deleted volume successfully. Jul 16 23:23:32 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-9f74b4ce-70ea-408e-ac33-b183e18bd61d tempest-VolumesTransfersV357Test-333754756 None] Lock "cinder-1aa10be0-6e5b-4617-9c1e-7067d940e5c2-delete_volume" released by "delete_volume" :: held 1.910s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:23:33 devstack sudo[94858]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83.eef541e4-c7c4-4654-91a5-495d7b427814" returned: 0 in 0.490s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:33 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:23:33 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83 {{(pid=87607) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 16 23:23:33 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Creating direct copy from snapshot {{(pid=87607) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 16 23:23:33 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e81e768-5509-4ba8-8109-369103a2dab1]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:23:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:33 devstack sudo[94864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83 Jul 16 23:23:33 devstack sudo[94864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:33 devstack sudo[94864]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83" returned: 0 in 0.427s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:33 devstack cinder-volume[87607]: DEBUG cinder.utils [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Path /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-004f9ee6-f4c4-441b-bf13-1fca4281ac77 not found in is_blk_device check {{(pid=87607) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 16 23:23:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-004f9ee6-f4c4-441b-bf13-1fca4281ac77 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:33 devstack sudo[94869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-004f9ee6-f4c4-441b-bf13-1fca4281ac77 Jul 16 23:23:33 devstack sudo[94869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:39 devstack sudo[94869]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-004f9ee6-f4c4-441b-bf13-1fca4281ac77" returned: 0 in 5.593s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:39 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab86e94-ae67-4eb6-b0ce-3a9ea40188ca]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:23:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:39 devstack sudo[94898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83 Jul 16 23:23:39 devstack sudo[94898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:39 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:SELECT=163,cinder:UPDATE=216,cinder:INSERT=50,cinder:DELETE=9 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:23:39 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-ee11dced-8aaf-4e69-a9bc-7083d987116d tempest-GroupsTest-1636606751 None] Group tempest-Group1-685938304: creating Jul 16 23:23:39 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:UPDATE=201,cinder:SELECT=153,cinder:INSERT=48,cinder:DELETE=19 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:23:39 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-ee11dced-8aaf-4e69-a9bc-7083d987116d tempest-GroupsTest-1636606751 None] Group tempest-Group1-685938304: created successfully Jul 16 23:23:39 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-ee11dced-8aaf-4e69-a9bc-7083d987116d tempest-GroupsTest-1636606751 None] Create group completed successfully. Jul 16 23:23:39 devstack cinder-volume[87607]: DEBUG oslo_service.periodic_task [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:23:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:23:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:23:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:23:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:23:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:23:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:39 devstack sudo[94900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:23:39 devstack sudo[94900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:39 devstack sudo[94898]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83" returned: 0 in 0.633s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:39 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Image conversion details: src /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83, size 1024.00 MB, duration 5.60 sec, destination /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-004f9ee6-f4c4-441b-bf13-1fca4281ac77 {{(pid=87607) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 23:23:39 devstack cinder-volume[87607]: INFO cinder.image.image_utils [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Converted 1024.00 MB image at 182.99 MB/s Jul 16 23:23:39 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-004f9ee6-f4c4-441b-bf13-1fca4281ac77 is being set with open permissions: ugo+rw Jul 16 23:23:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-004f9ee6-f4c4-441b-bf13-1fca4281ac77 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:39 devstack sudo[94900]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.305s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:39 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:23:39 devstack cinder-volume[87607]: DEBUG oslo_service.periodic_task [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running periodic task VolumeManager._thread_info {{(pid=87607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:23:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] thread count: 8 {{(pid=87607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 23:23:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] thread info: [<_MainThread(MainThread, started 139090403627136)>, , , , , , , ] {{(pid=87607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 23:23:39 devstack sudo[94906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-004f9ee6-f4c4-441b-bf13-1fca4281ac77 Jul 16 23:23:39 devstack sudo[94906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:40 devstack sudo[94906]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-004f9ee6-f4c4-441b-bf13-1fca4281ac77" returned: 0 in 0.253s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:40 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Lock "cinder-quobyte-004f9ee6-f4c4-441b-bf13-1fca4281ac77" released by "_copy_volume_from_snapshot" :: held 7.536s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:23:40 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Acquiring lock "cinder-quobyte-eef541e4-c7c4-4654-91a5-495d7b427814" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:23:40 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Lock "cinder-quobyte-eef541e4-c7c4-4654-91a5-495d7b427814" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:23:40 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Deleting offline snapshot eef541e4-c7c4-4654-91a5-495d7b427814 of volume 5c3f4ea9-050b-4a49-8350-ef4ec0732c83 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:23:40 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] snapshot_file for this snap is: volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83.eef541e4-c7c4-4654-91a5-495d7b427814 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:23:40 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4624d8c-1e38-49b8-9927-0a4fadb002c0]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:23:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83.eef541e4-c7c4-4654-91a5-495d7b427814 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:40 devstack sudo[94909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83.eef541e4-c7c4-4654-91a5-495d7b427814 Jul 16 23:23:40 devstack sudo[94909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:40 devstack sudo[94909]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83.eef541e4-c7c4-4654-91a5-495d7b427814" returned: 0 in 0.494s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:40 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:23:40 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[75da7e60-00f0-48ae-a73f-3a14dbaf610e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:23:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:40 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-760d1ed3-45ad-489a-81c8-a0e597a3be3e tempest-GroupsTest-1636606751 None] Group tempest-Group2-353643598: creating Jul 16 23:23:40 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-760d1ed3-45ad-489a-81c8-a0e597a3be3e tempest-GroupsTest-1636606751 None] Group tempest-Group2-353643598: created successfully Jul 16 23:23:40 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-760d1ed3-45ad-489a-81c8-a0e597a3be3e tempest-GroupsTest-1636606751 None] Create group completed successfully. Jul 16 23:23:40 devstack sudo[94914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83 Jul 16 23:23:40 devstack sudo[94914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:41 devstack sudo[94914]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83" returned: 0 in 0.438s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83.eef541e4-c7c4-4654-91a5-495d7b427814 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:41 devstack sudo[94919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83.eef541e4-c7c4-4654-91a5-495d7b427814 Jul 16 23:23:41 devstack sudo[94919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:41 devstack sudo[94919]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83.eef541e4-c7c4-4654-91a5-495d7b427814" returned: 0 in 0.412s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83.eef541e4-c7c4-4654-91a5-495d7b427814 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:41 devstack sudo[94925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83.eef541e4-c7c4-4654-91a5-495d7b427814 Jul 16 23:23:41 devstack sudo[94925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:41 devstack sudo[94925]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83.eef541e4-c7c4-4654-91a5-495d7b427814" returned: 0 in 0.317s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:41 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Lock "cinder-quobyte-eef541e4-c7c4-4654-91a5-495d7b427814" released by "_delete_snapshot" :: held 1.797s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:23:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.234s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:23:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32f60902-9062-4ec9-a93e-189b4d5ad137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-004f9ee6-f4c4-441b-bf13-1fca4281ac77', 'volume_size': 2, 'source_volid': '5c3f4ea9-050b-4a49-8350-ef4ec0732c83', 'source_volstatus': 'available'}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cd57eee-ce0d-42da-906b-eb0a8dd72b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:41 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Volume volume-004f9ee6-f4c4-441b-bf13-1fca4281ac77 (004f9ee6-f4c4-441b-bf13-1fca4281ac77): created successfully Jul 16 23:23:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cd57eee-ce0d-42da-906b-eb0a8dd72b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Flow 'volume_create_manager' (33f6ed04-2d5c-4070-82ed-85a63cb44db6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:23:41 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-acf0f200-dbf3-4666-96c7-cb83b807e74c tempest-VolumesCloneTest-2079031590 None] Created volume successfully. Jul 16 23:23:42 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-d41b85a9-692a-4a1d-9ee9-1d95589fa482 tempest-GroupsTest-1636606751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:23:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d41b85a9-692a-4a1d-9ee9-1d95589fa482 tempest-GroupsTest-1636606751 None] Flow 'volume_create_manager' (25f7d063-ef10-40fa-8347-507a676f4211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:23:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d41b85a9-692a-4a1d-9ee9-1d95589fa482 tempest-GroupsTest-1636606751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7510aeff-c6db-4015-99ce-af925678d42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d41b85a9-692a-4a1d-9ee9-1d95589fa482 tempest-GroupsTest-1636606751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7510aeff-c6db-4015-99ce-af925678d42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-973808403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=17463015-940e-4808-9cd7-b8d0b99f4380,host='devstack@QuobyteHD#QuobyteHD',id=99d3e7ff-d9a9-4a88-86d5-4a165c8a5a7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8142d2f3386348d48b3e77a20f0d93bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:23:42Z,use_quota=True,user_id='a7ef9dc0236a4b708a5bbf3412bbe555',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(020aa149-0902-4c77-8341-da363f714f16),volume_type_id=020aa149-0902-4c77-8341-da363f714f16)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d41b85a9-692a-4a1d-9ee9-1d95589fa482 tempest-GroupsTest-1636606751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66e6fa08-54af-48dd-a8a1-8708f4498651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d41b85a9-692a-4a1d-9ee9-1d95589fa482 tempest-GroupsTest-1636606751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66e6fa08-54af-48dd-a8a1-8708f4498651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d41b85a9-692a-4a1d-9ee9-1d95589fa482 tempest-GroupsTest-1636606751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (982c4226-4a8c-4067-ab34-9e2528d1e2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d41b85a9-692a-4a1d-9ee9-1d95589fa482 tempest-GroupsTest-1636606751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (982c4226-4a8c-4067-ab34-9e2528d1e2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99d3e7ff-d9a9-4a88-86d5-4a165c8a5a7a', 'volume_name': 'volume-99d3e7ff-d9a9-4a88-86d5-4a165c8a5a7a', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d41b85a9-692a-4a1d-9ee9-1d95589fa482 tempest-GroupsTest-1636606751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a6c9bb0-bbd0-483b-a879-773ffde74851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d41b85a9-692a-4a1d-9ee9-1d95589fa482 tempest-GroupsTest-1636606751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a6c9bb0-bbd0-483b-a879-773ffde74851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d41b85a9-692a-4a1d-9ee9-1d95589fa482 tempest-GroupsTest-1636606751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f5f9cc5-4061-496d-8a2d-5c02e0012ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:42 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-d41b85a9-692a-4a1d-9ee9-1d95589fa482 tempest-GroupsTest-1636606751 None] Volume 99d3e7ff-d9a9-4a88-86d5-4a165c8a5a7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99d3e7ff-d9a9-4a88-86d5-4a165c8a5a7a', 'volume_size': 1} Jul 16 23:23:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-d41b85a9-692a-4a1d-9ee9-1d95589fa482 tempest-GroupsTest-1636606751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:23:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-d41b85a9-692a-4a1d-9ee9-1d95589fa482 tempest-GroupsTest-1636606751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:23:42 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-d41b85a9-692a-4a1d-9ee9-1d95589fa482 tempest-GroupsTest-1636606751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=17463015-940e-4808-9cd7-b8d0b99f4380,created_at=2026-07-16T21:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-973808403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=17463015-940e-4808-9cd7-b8d0b99f4380,host='devstack@QuobyteHD#QuobyteHD',id=99d3e7ff-d9a9-4a88-86d5-4a165c8a5a7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8142d2f3386348d48b3e77a20f0d93bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:23:42Z,use_quota=True,user_id='a7ef9dc0236a4b708a5bbf3412bbe555',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(020aa149-0902-4c77-8341-da363f714f16),volume_type_id=020aa149-0902-4c77-8341-da363f714f16)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:23:42 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-d41b85a9-692a-4a1d-9ee9-1d95589fa482 tempest-GroupsTest-1636606751 None] Creating volume 99d3e7ff-d9a9-4a88-86d5-4a165c8a5a7a {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:23:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-d41b85a9-692a-4a1d-9ee9-1d95589fa482 tempest-GroupsTest-1636606751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:23:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-d41b85a9-692a-4a1d-9ee9-1d95589fa482 tempest-GroupsTest-1636606751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:23:42 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-d41b85a9-692a-4a1d-9ee9-1d95589fa482 tempest-GroupsTest-1636606751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:23:42 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-d41b85a9-692a-4a1d-9ee9-1d95589fa482 tempest-GroupsTest-1636606751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:23:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-d41b85a9-692a-4a1d-9ee9-1d95589fa482 tempest-GroupsTest-1636606751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:23:42 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-d41b85a9-692a-4a1d-9ee9-1d95589fa482 tempest-GroupsTest-1636606751 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:23:42 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-d41b85a9-692a-4a1d-9ee9-1d95589fa482 tempest-GroupsTest-1636606751 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:23:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d41b85a9-692a-4a1d-9ee9-1d95589fa482 tempest-GroupsTest-1636606751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-99d3e7ff-d9a9-4a88-86d5-4a165c8a5a7a 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:42 devstack sudo[94928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-99d3e7ff-d9a9-4a88-86d5-4a165c8a5a7a 1073741824 Jul 16 23:23:42 devstack sudo[94928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:42 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-78cd2c0b-2036-4391-8d45-2a9e17e9be8e tempest-VolumesCloneTest-2079031590 None] Acquiring lock "cinder-004f9ee6-f4c4-441b-bf13-1fca4281ac77-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:23:42 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-78cd2c0b-2036-4391-8d45-2a9e17e9be8e tempest-VolumesCloneTest-2079031590 None] Lock "cinder-004f9ee6-f4c4-441b-bf13-1fca4281ac77-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:23:43 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-78cd2c0b-2036-4391-8d45-2a9e17e9be8e tempest-VolumesCloneTest-2079031590 None] Acquiring lock "cinder-quobyte-004f9ee6-f4c4-441b-bf13-1fca4281ac77" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:23:43 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-78cd2c0b-2036-4391-8d45-2a9e17e9be8e tempest-VolumesCloneTest-2079031590 None] Lock "cinder-quobyte-004f9ee6-f4c4-441b-bf13-1fca4281ac77" acquired by "delete_volume" :: waited 0.023s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:23:43 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1586c5-758e-41f1-bde0-6a62a3a5a240]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:23:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-78cd2c0b-2036-4391-8d45-2a9e17e9be8e tempest-VolumesCloneTest-2079031590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-004f9ee6-f4c4-441b-bf13-1fca4281ac77 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:43 devstack sudo[94928]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d41b85a9-692a-4a1d-9ee9-1d95589fa482 tempest-GroupsTest-1636606751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-99d3e7ff-d9a9-4a88-86d5-4a165c8a5a7a 1073741824" returned: 0 in 0.615s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d41b85a9-692a-4a1d-9ee9-1d95589fa482 tempest-GroupsTest-1636606751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-99d3e7ff-d9a9-4a88-86d5-4a165c8a5a7a {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:43 devstack sudo[94934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-004f9ee6-f4c4-441b-bf13-1fca4281ac77 Jul 16 23:23:43 devstack sudo[94934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:43 devstack sudo[94936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-99d3e7ff-d9a9-4a88-86d5-4a165c8a5a7a Jul 16 23:23:43 devstack sudo[94936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:43 devstack sudo[94936]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d41b85a9-692a-4a1d-9ee9-1d95589fa482 tempest-GroupsTest-1636606751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-99d3e7ff-d9a9-4a88-86d5-4a165c8a5a7a" returned: 0 in 0.351s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-d41b85a9-692a-4a1d-9ee9-1d95589fa482 tempest-GroupsTest-1636606751 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:23:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-d41b85a9-692a-4a1d-9ee9-1d95589fa482 tempest-GroupsTest-1636606751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:23:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d41b85a9-692a-4a1d-9ee9-1d95589fa482 tempest-GroupsTest-1636606751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f5f9cc5-4061-496d-8a2d-5c02e0012ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99d3e7ff-d9a9-4a88-86d5-4a165c8a5a7a', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d41b85a9-692a-4a1d-9ee9-1d95589fa482 tempest-GroupsTest-1636606751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1feb58a1-0544-48ce-8ae9-bbec0e84ae52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:43 devstack sudo[94934]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-78cd2c0b-2036-4391-8d45-2a9e17e9be8e tempest-VolumesCloneTest-2079031590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-004f9ee6-f4c4-441b-bf13-1fca4281ac77" returned: 0 in 0.550s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-78cd2c0b-2036-4391-8d45-2a9e17e9be8e tempest-VolumesCloneTest-2079031590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-004f9ee6-f4c4-441b-bf13-1fca4281ac77 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:43 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-d41b85a9-692a-4a1d-9ee9-1d95589fa482 tempest-GroupsTest-1636606751 None] Volume volume-99d3e7ff-d9a9-4a88-86d5-4a165c8a5a7a (99d3e7ff-d9a9-4a88-86d5-4a165c8a5a7a): created successfully Jul 16 23:23:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d41b85a9-692a-4a1d-9ee9-1d95589fa482 tempest-GroupsTest-1636606751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1feb58a1-0544-48ce-8ae9-bbec0e84ae52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d41b85a9-692a-4a1d-9ee9-1d95589fa482 tempest-GroupsTest-1636606751 None] Flow 'volume_create_manager' (25f7d063-ef10-40fa-8347-507a676f4211) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:23:43 devstack sudo[94942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-004f9ee6-f4c4-441b-bf13-1fca4281ac77 Jul 16 23:23:43 devstack sudo[94942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:43 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-d41b85a9-692a-4a1d-9ee9-1d95589fa482 tempest-GroupsTest-1636606751 None] Created volume successfully. Jul 16 23:23:43 devstack sudo[94942]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-78cd2c0b-2036-4391-8d45-2a9e17e9be8e tempest-VolumesCloneTest-2079031590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-004f9ee6-f4c4-441b-bf13-1fca4281ac77" returned: 0 in 0.271s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:43 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-78cd2c0b-2036-4391-8d45-2a9e17e9be8e tempest-VolumesCloneTest-2079031590 None] Lock "cinder-quobyte-004f9ee6-f4c4-441b-bf13-1fca4281ac77" released by "delete_volume" :: held 0.872s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:23:43 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-78cd2c0b-2036-4391-8d45-2a9e17e9be8e tempest-VolumesCloneTest-2079031590 None] Created reservations ['e1179cbb-d977-4063-bb3a-d318fb0ec86d', '3c7d94a1-4f6c-40f6-b2fb-a5524336cd4c', '21eb352a-9725-4887-9bcd-189c61bbcd3b', '291ac3dc-5c0d-41bc-9a05-7eb06dbffb66'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:23:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-78cd2c0b-2036-4391-8d45-2a9e17e9be8e tempest-VolumesCloneTest-2079031590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:23:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-78cd2c0b-2036-4391-8d45-2a9e17e9be8e tempest-VolumesCloneTest-2079031590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:23:44 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-78cd2c0b-2036-4391-8d45-2a9e17e9be8e tempest-VolumesCloneTest-2079031590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:23:44 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-78cd2c0b-2036-4391-8d45-2a9e17e9be8e tempest-VolumesCloneTest-2079031590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:23:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-78cd2c0b-2036-4391-8d45-2a9e17e9be8e tempest-VolumesCloneTest-2079031590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:23:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-78cd2c0b-2036-4391-8d45-2a9e17e9be8e tempest-VolumesCloneTest-2079031590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:44 devstack sudo[94946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:23:44 devstack sudo[94946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:44 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fe999515-96f1-4204-b205-7e7c22343fb7 tempest-VolumesCloneTest-2079031590 None] Acquiring lock "cinder-5c3f4ea9-050b-4a49-8350-ef4ec0732c83-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:23:44 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fe999515-96f1-4204-b205-7e7c22343fb7 tempest-VolumesCloneTest-2079031590 None] Lock "cinder-5c3f4ea9-050b-4a49-8350-ef4ec0732c83-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:23:44 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fe999515-96f1-4204-b205-7e7c22343fb7 tempest-VolumesCloneTest-2079031590 None] Acquiring lock "cinder-quobyte-5c3f4ea9-050b-4a49-8350-ef4ec0732c83" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:23:44 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fe999515-96f1-4204-b205-7e7c22343fb7 tempest-VolumesCloneTest-2079031590 None] Lock "cinder-quobyte-5c3f4ea9-050b-4a49-8350-ef4ec0732c83" acquired by "delete_volume" :: waited 0.024s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:23:44 devstack sudo[94946]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:44 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2df763e-eaf9-433f-a675-09fc78334371]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:23:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fe999515-96f1-4204-b205-7e7c22343fb7 tempest-VolumesCloneTest-2079031590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-78cd2c0b-2036-4391-8d45-2a9e17e9be8e tempest-VolumesCloneTest-2079031590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.292s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:44 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-78cd2c0b-2036-4391-8d45-2a9e17e9be8e tempest-VolumesCloneTest-2079031590 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:23:44 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-78cd2c0b-2036-4391-8d45-2a9e17e9be8e tempest-VolumesCloneTest-2079031590 None] Deleted volume successfully. Jul 16 23:23:44 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-78cd2c0b-2036-4391-8d45-2a9e17e9be8e tempest-VolumesCloneTest-2079031590 None] Lock "cinder-004f9ee6-f4c4-441b-bf13-1fca4281ac77-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:23:44 devstack sudo[94949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83 Jul 16 23:23:44 devstack sudo[94949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:44 devstack sudo[94949]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fe999515-96f1-4204-b205-7e7c22343fb7 tempest-VolumesCloneTest-2079031590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83" returned: 0 in 0.399s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fe999515-96f1-4204-b205-7e7c22343fb7 tempest-VolumesCloneTest-2079031590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:44 devstack sudo[94954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83 Jul 16 23:23:44 devstack sudo[94954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:44 devstack sudo[94954]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fe999515-96f1-4204-b205-7e7c22343fb7 tempest-VolumesCloneTest-2079031590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c3f4ea9-050b-4a49-8350-ef4ec0732c83" returned: 0 in 0.277s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:45 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fe999515-96f1-4204-b205-7e7c22343fb7 tempest-VolumesCloneTest-2079031590 None] Lock "cinder-quobyte-5c3f4ea9-050b-4a49-8350-ef4ec0732c83" released by "delete_volume" :: held 0.745s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:23:45 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-fe999515-96f1-4204-b205-7e7c22343fb7 tempest-VolumesCloneTest-2079031590 None] Created reservations ['8341b39f-2fbd-4efb-92df-93caa14b0195', '26270724-01e2-4009-85ca-be43887ac70a', 'a85044b7-8e01-4b09-ac5f-1b9e7d8542cd', '185d85af-3983-4b06-9d68-ef02b77f5ee4'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:23:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-fe999515-96f1-4204-b205-7e7c22343fb7 tempest-VolumesCloneTest-2079031590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:23:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-fe999515-96f1-4204-b205-7e7c22343fb7 tempest-VolumesCloneTest-2079031590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:23:45 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-fe999515-96f1-4204-b205-7e7c22343fb7 tempest-VolumesCloneTest-2079031590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:23:45 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-fe999515-96f1-4204-b205-7e7c22343fb7 tempest-VolumesCloneTest-2079031590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:23:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-fe999515-96f1-4204-b205-7e7c22343fb7 tempest-VolumesCloneTest-2079031590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:23:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fe999515-96f1-4204-b205-7e7c22343fb7 tempest-VolumesCloneTest-2079031590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:45 devstack sudo[94957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:23:45 devstack sudo[94957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:45 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-39a5aeab-9cb3-49c9-9019-d2ca795c1c72 tempest-GroupsTest-1636606751 None] Acquiring lock "cinder-quobyte-99d3e7ff-d9a9-4a88-86d5-4a165c8a5a7a" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:23:45 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-39a5aeab-9cb3-49c9-9019-d2ca795c1c72 tempest-GroupsTest-1636606751 None] Lock "cinder-quobyte-99d3e7ff-d9a9-4a88-86d5-4a165c8a5a7a" acquired by "delete_volume" :: waited 0.026s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:23:45 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[6637e327-23ce-4b8a-8a7f-c233109638d3]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:23:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-39a5aeab-9cb3-49c9-9019-d2ca795c1c72 tempest-GroupsTest-1636606751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-99d3e7ff-d9a9-4a88-86d5-4a165c8a5a7a {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:45 devstack sudo[94957]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fe999515-96f1-4204-b205-7e7c22343fb7 tempest-VolumesCloneTest-2079031590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.428s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:45 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-fe999515-96f1-4204-b205-7e7c22343fb7 tempest-VolumesCloneTest-2079031590 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:23:45 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-fe999515-96f1-4204-b205-7e7c22343fb7 tempest-VolumesCloneTest-2079031590 None] Deleted volume successfully. Jul 16 23:23:45 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fe999515-96f1-4204-b205-7e7c22343fb7 tempest-VolumesCloneTest-2079031590 None] Lock "cinder-5c3f4ea9-050b-4a49-8350-ef4ec0732c83-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:23:45 devstack sudo[94962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-99d3e7ff-d9a9-4a88-86d5-4a165c8a5a7a Jul 16 23:23:45 devstack sudo[94962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:46 devstack sudo[94962]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-39a5aeab-9cb3-49c9-9019-d2ca795c1c72 tempest-GroupsTest-1636606751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-99d3e7ff-d9a9-4a88-86d5-4a165c8a5a7a" returned: 0 in 0.598s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-39a5aeab-9cb3-49c9-9019-d2ca795c1c72 tempest-GroupsTest-1636606751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-99d3e7ff-d9a9-4a88-86d5-4a165c8a5a7a {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:46 devstack sudo[94967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-99d3e7ff-d9a9-4a88-86d5-4a165c8a5a7a Jul 16 23:23:46 devstack sudo[94967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:46 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-9880ff54-5e39-40c9-8c96-1a7d200f64ff tempest-AttachVolumeTestJSON-886512989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:23:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-9880ff54-5e39-40c9-8c96-1a7d200f64ff tempest-AttachVolumeTestJSON-886512989 None] Flow 'volume_create_manager' (3f960200-2874-45ee-ada5-219ad671a2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:23:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-9880ff54-5e39-40c9-8c96-1a7d200f64ff tempest-AttachVolumeTestJSON-886512989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (094206ed-7b5b-45c4-aabe-2de4ef523c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-9880ff54-5e39-40c9-8c96-1a7d200f64ff tempest-AttachVolumeTestJSON-886512989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (094206ed-7b5b-45c4-aabe-2de4ef523c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:23:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1541062865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c887a43-5d47-43c7-ac18-a80d34851988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f3ab8578d9c45a992334f8e308a7da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:23:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:23:46Z,use_quota=True,user_id='f25c9557a8864126a12ef4fe1cd177c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-9880ff54-5e39-40c9-8c96-1a7d200f64ff tempest-AttachVolumeTestJSON-886512989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddd228cc-064c-4a84-b657-690f31e56601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-9880ff54-5e39-40c9-8c96-1a7d200f64ff tempest-AttachVolumeTestJSON-886512989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddd228cc-064c-4a84-b657-690f31e56601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-9880ff54-5e39-40c9-8c96-1a7d200f64ff tempest-AttachVolumeTestJSON-886512989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eee234c-0f45-424c-b113-5c9cceace557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-9880ff54-5e39-40c9-8c96-1a7d200f64ff tempest-AttachVolumeTestJSON-886512989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eee234c-0f45-424c-b113-5c9cceace557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c887a43-5d47-43c7-ac18-a80d34851988', 'volume_name': 'volume-1c887a43-5d47-43c7-ac18-a80d34851988', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:46 devstack sudo[94967]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-9880ff54-5e39-40c9-8c96-1a7d200f64ff tempest-AttachVolumeTestJSON-886512989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec6640bf-0595-4753-a922-8e80f56ae55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-9880ff54-5e39-40c9-8c96-1a7d200f64ff tempest-AttachVolumeTestJSON-886512989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec6640bf-0595-4753-a922-8e80f56ae55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-9880ff54-5e39-40c9-8c96-1a7d200f64ff tempest-AttachVolumeTestJSON-886512989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eafdf9a3-6b7e-4304-8980-d29af34dc42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:46 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-9880ff54-5e39-40c9-8c96-1a7d200f64ff tempest-AttachVolumeTestJSON-886512989 None] Volume 1c887a43-5d47-43c7-ac18-a80d34851988: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c887a43-5d47-43c7-ac18-a80d34851988', 'volume_size': 1} Jul 16 23:23:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-9880ff54-5e39-40c9-8c96-1a7d200f64ff tempest-AttachVolumeTestJSON-886512989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:23:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-9880ff54-5e39-40c9-8c96-1a7d200f64ff tempest-AttachVolumeTestJSON-886512989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:23:46 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-9880ff54-5e39-40c9-8c96-1a7d200f64ff tempest-AttachVolumeTestJSON-886512989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:23:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1541062865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c887a43-5d47-43c7-ac18-a80d34851988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f3ab8578d9c45a992334f8e308a7da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:23:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:23:46Z,use_quota=True,user_id='f25c9557a8864126a12ef4fe1cd177c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:23:46 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-9880ff54-5e39-40c9-8c96-1a7d200f64ff tempest-AttachVolumeTestJSON-886512989 None] Creating volume 1c887a43-5d47-43c7-ac18-a80d34851988 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:23:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-9880ff54-5e39-40c9-8c96-1a7d200f64ff tempest-AttachVolumeTestJSON-886512989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:23:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-9880ff54-5e39-40c9-8c96-1a7d200f64ff tempest-AttachVolumeTestJSON-886512989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:23:46 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-9880ff54-5e39-40c9-8c96-1a7d200f64ff tempest-AttachVolumeTestJSON-886512989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:23:46 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-9880ff54-5e39-40c9-8c96-1a7d200f64ff tempest-AttachVolumeTestJSON-886512989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:23:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-9880ff54-5e39-40c9-8c96-1a7d200f64ff tempest-AttachVolumeTestJSON-886512989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:23:46 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-9880ff54-5e39-40c9-8c96-1a7d200f64ff tempest-AttachVolumeTestJSON-886512989 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:23:46 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-9880ff54-5e39-40c9-8c96-1a7d200f64ff tempest-AttachVolumeTestJSON-886512989 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:23:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-9880ff54-5e39-40c9-8c96-1a7d200f64ff tempest-AttachVolumeTestJSON-886512989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1c887a43-5d47-43c7-ac18-a80d34851988 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-39a5aeab-9cb3-49c9-9019-d2ca795c1c72 tempest-GroupsTest-1636606751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-99d3e7ff-d9a9-4a88-86d5-4a165c8a5a7a" returned: 0 in 0.492s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:46 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-39a5aeab-9cb3-49c9-9019-d2ca795c1c72 tempest-GroupsTest-1636606751 None] Lock "cinder-quobyte-99d3e7ff-d9a9-4a88-86d5-4a165c8a5a7a" released by "delete_volume" :: held 1.156s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:23:46 devstack sudo[94972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1c887a43-5d47-43c7-ac18-a80d34851988 1073741824 Jul 16 23:23:46 devstack sudo[94972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:46 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-39a5aeab-9cb3-49c9-9019-d2ca795c1c72 tempest-GroupsTest-1636606751 None] Created reservations ['3b480161-e607-4b51-a381-db86ea4f8ca8'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:23:46 devstack cinder-volume[87607]: WARNING cinder.quota [None req-39a5aeab-9cb3-49c9-9019-d2ca795c1c72 tempest-GroupsTest-1636606751 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-147357598 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-147357598, it is now deprecated. Please use the default quota class for default quota. Jul 16 23:23:46 devstack cinder-volume[87607]: WARNING cinder.quota [None req-39a5aeab-9cb3-49c9-9019-d2ca795c1c72 tempest-GroupsTest-1636606751 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-147357598 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-147357598, it is now deprecated. Please use the default quota class for default quota. Jul 16 23:23:46 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-39a5aeab-9cb3-49c9-9019-d2ca795c1c72 tempest-GroupsTest-1636606751 None] Created reservations ['0ca716fd-5f37-42ff-900c-026f4da66408', 'a162f402-ad21-4139-8227-2f1c62ff66a8', '9d663e8b-4cd7-458a-b86f-5d5bb2571f8c', '0be1ad5d-178b-4bfb-a5aa-24da0a2e016c'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:23:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-39a5aeab-9cb3-49c9-9019-d2ca795c1c72 tempest-GroupsTest-1636606751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:23:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-39a5aeab-9cb3-49c9-9019-d2ca795c1c72 tempest-GroupsTest-1636606751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:23:46 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-39a5aeab-9cb3-49c9-9019-d2ca795c1c72 tempest-GroupsTest-1636606751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:23:46 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-39a5aeab-9cb3-49c9-9019-d2ca795c1c72 tempest-GroupsTest-1636606751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:23:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-39a5aeab-9cb3-49c9-9019-d2ca795c1c72 tempest-GroupsTest-1636606751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:23:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-39a5aeab-9cb3-49c9-9019-d2ca795c1c72 tempest-GroupsTest-1636606751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:46 devstack sudo[94977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:23:46 devstack sudo[94977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:47 devstack sudo[94972]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-9880ff54-5e39-40c9-8c96-1a7d200f64ff tempest-AttachVolumeTestJSON-886512989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1c887a43-5d47-43c7-ac18-a80d34851988 1073741824" returned: 0 in 0.607s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-9880ff54-5e39-40c9-8c96-1a7d200f64ff tempest-AttachVolumeTestJSON-886512989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1c887a43-5d47-43c7-ac18-a80d34851988 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:47 devstack sudo[94981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1c887a43-5d47-43c7-ac18-a80d34851988 Jul 16 23:23:47 devstack sudo[94981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:47 devstack sudo[94977]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-39a5aeab-9cb3-49c9-9019-d2ca795c1c72 tempest-GroupsTest-1636606751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.357s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:47 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-39a5aeab-9cb3-49c9-9019-d2ca795c1c72 tempest-GroupsTest-1636606751 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:23:47 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-39a5aeab-9cb3-49c9-9019-d2ca795c1c72 tempest-GroupsTest-1636606751 None] Delete group completed successfully. Jul 16 23:23:47 devstack sudo[94981]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-9880ff54-5e39-40c9-8c96-1a7d200f64ff tempest-AttachVolumeTestJSON-886512989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1c887a43-5d47-43c7-ac18-a80d34851988" returned: 0 in 0.299s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:47 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-9880ff54-5e39-40c9-8c96-1a7d200f64ff tempest-AttachVolumeTestJSON-886512989 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:23:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-9880ff54-5e39-40c9-8c96-1a7d200f64ff tempest-AttachVolumeTestJSON-886512989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:23:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-9880ff54-5e39-40c9-8c96-1a7d200f64ff tempest-AttachVolumeTestJSON-886512989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eafdf9a3-6b7e-4304-8980-d29af34dc42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c887a43-5d47-43c7-ac18-a80d34851988', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-9880ff54-5e39-40c9-8c96-1a7d200f64ff tempest-AttachVolumeTestJSON-886512989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71ec3153-f0e3-4641-99fc-4834453aa13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:47 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-9880ff54-5e39-40c9-8c96-1a7d200f64ff tempest-AttachVolumeTestJSON-886512989 None] Volume volume-1c887a43-5d47-43c7-ac18-a80d34851988 (1c887a43-5d47-43c7-ac18-a80d34851988): created successfully Jul 16 23:23:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-9880ff54-5e39-40c9-8c96-1a7d200f64ff tempest-AttachVolumeTestJSON-886512989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71ec3153-f0e3-4641-99fc-4834453aa13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-9880ff54-5e39-40c9-8c96-1a7d200f64ff tempest-AttachVolumeTestJSON-886512989 None] Flow 'volume_create_manager' (3f960200-2874-45ee-ada5-219ad671a2db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:23:47 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-9880ff54-5e39-40c9-8c96-1a7d200f64ff tempest-AttachVolumeTestJSON-886512989 None] Created volume successfully. Jul 16 23:23:48 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-f4a26303-c18b-4ae7-8976-8b1bd873aac6 tempest-GroupsTest-1636606751 None] Created reservations ['bbd95bf3-84da-459a-a0fe-5e4f3e4a5d3b'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:23:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f4a26303-c18b-4ae7-8976-8b1bd873aac6 tempest-GroupsTest-1636606751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:23:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f4a26303-c18b-4ae7-8976-8b1bd873aac6 tempest-GroupsTest-1636606751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:23:48 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f4a26303-c18b-4ae7-8976-8b1bd873aac6 tempest-GroupsTest-1636606751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:23:48 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f4a26303-c18b-4ae7-8976-8b1bd873aac6 tempest-GroupsTest-1636606751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:23:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f4a26303-c18b-4ae7-8976-8b1bd873aac6 tempest-GroupsTest-1636606751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:23:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f4a26303-c18b-4ae7-8976-8b1bd873aac6 tempest-GroupsTest-1636606751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:48 devstack sudo[94984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:23:48 devstack sudo[94984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:48 devstack sudo[94984]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f4a26303-c18b-4ae7-8976-8b1bd873aac6 tempest-GroupsTest-1636606751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.288s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:48 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-f4a26303-c18b-4ae7-8976-8b1bd873aac6 tempest-GroupsTest-1636606751 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:23:48 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-f4a26303-c18b-4ae7-8976-8b1bd873aac6 tempest-GroupsTest-1636606751 None] Delete group completed successfully. Jul 16 23:23:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-24825ce2-a2f7-428d-b666-9fcf7d057011 req-91621fab-3376-468d-a835-1ea304c63af5 tempest-AttachVolumeTestJSON-886512989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:23:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-24825ce2-a2f7-428d-b666-9fcf7d057011 req-91621fab-3376-468d-a835-1ea304c63af5 tempest-AttachVolumeTestJSON-886512989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:23:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-24825ce2-a2f7-428d-b666-9fcf7d057011 req-91621fab-3376-468d-a835-1ea304c63af5 tempest-AttachVolumeTestJSON-886512989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:23:49 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-24825ce2-a2f7-428d-b666-9fcf7d057011 req-91621fab-3376-468d-a835-1ea304c63af5 tempest-AttachVolumeTestJSON-886512989 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72', 'name': 'volume-1c887a43-5d47-43c7-ac18-a80d34851988', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f946ca5e-a653-46b2-ae40-8cd13c1ef7f0', 'enforce_multipath': True} {{(pid=87607) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 23:23:49 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-24825ce2-a2f7-428d-b666-9fcf7d057011 req-91621fab-3376-468d-a835-1ea304c63af5 tempest-AttachVolumeTestJSON-886512989 None] attachment_update completed successfully. Jul 16 23:23:50 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-badb50a4-73ea-4f27-a12e-0c954d1fb9db tempest-GroupsTest-1636606751 None] Group tempest-GroupsTest-Group-252801058: creating Jul 16 23:23:50 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-badb50a4-73ea-4f27-a12e-0c954d1fb9db tempest-GroupsTest-1636606751 None] Group tempest-GroupsTest-Group-252801058: created successfully Jul 16 23:23:50 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-badb50a4-73ea-4f27-a12e-0c954d1fb9db tempest-GroupsTest-1636606751 None] Create group completed successfully. Jul 16 23:23:51 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd013d3b-86ff-4efb-8130-1a04eb26e3c8 tempest-GroupsTest-1636606751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:23:51 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-dd013d3b-86ff-4efb-8130-1a04eb26e3c8 tempest-GroupsTest-1636606751 None] Flow 'volume_create_manager' (c4a86340-5a0d-4e8d-ba1d-560e1c7fb877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:23:51 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-dd013d3b-86ff-4efb-8130-1a04eb26e3c8 tempest-GroupsTest-1636606751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43756e5a-3353-4ef3-a2cf-491b06c1c660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:52 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-dd013d3b-86ff-4efb-8130-1a04eb26e3c8 tempest-GroupsTest-1636606751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43756e5a-3353-4ef3-a2cf-491b06c1c660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1485395245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=571b2547-e2e7-472b-8a6d-4a32141af329,host='devstack@QuobyteHD#QuobyteHD',id=2884e301-e370-4748-826a-4397c2a030ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8142d2f3386348d48b3e77a20f0d93bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:23:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:23:52Z,use_quota=True,user_id='a7ef9dc0236a4b708a5bbf3412bbe555',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1899adbd-811f-497a-bf74-e140815e685f),volume_type_id=1899adbd-811f-497a-bf74-e140815e685f)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:52 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-dd013d3b-86ff-4efb-8130-1a04eb26e3c8 tempest-GroupsTest-1636606751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c3e4d95-37de-4e02-93b2-3ed423aeb9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:52 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-dd013d3b-86ff-4efb-8130-1a04eb26e3c8 tempest-GroupsTest-1636606751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c3e4d95-37de-4e02-93b2-3ed423aeb9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:52 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-dd013d3b-86ff-4efb-8130-1a04eb26e3c8 tempest-GroupsTest-1636606751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c6cfe0-33a0-4278-bb79-f4a1d31badf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:52 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-dd013d3b-86ff-4efb-8130-1a04eb26e3c8 tempest-GroupsTest-1636606751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c6cfe0-33a0-4278-bb79-f4a1d31badf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2884e301-e370-4748-826a-4397c2a030ea', 'volume_name': 'volume-2884e301-e370-4748-826a-4397c2a030ea', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:52 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-dd013d3b-86ff-4efb-8130-1a04eb26e3c8 tempest-GroupsTest-1636606751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0826895b-6ef7-4fa4-88df-0dba1773f22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:52 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-dd013d3b-86ff-4efb-8130-1a04eb26e3c8 tempest-GroupsTest-1636606751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0826895b-6ef7-4fa4-88df-0dba1773f22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:52 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-dd013d3b-86ff-4efb-8130-1a04eb26e3c8 tempest-GroupsTest-1636606751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c76d0e-07bd-40c4-b553-ad77d97e36cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:52 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-dd013d3b-86ff-4efb-8130-1a04eb26e3c8 tempest-GroupsTest-1636606751 None] Volume 2884e301-e370-4748-826a-4397c2a030ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2884e301-e370-4748-826a-4397c2a030ea', 'volume_size': 1} Jul 16 23:23:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-dd013d3b-86ff-4efb-8130-1a04eb26e3c8 tempest-GroupsTest-1636606751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:23:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-dd013d3b-86ff-4efb-8130-1a04eb26e3c8 tempest-GroupsTest-1636606751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:23:52 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-dd013d3b-86ff-4efb-8130-1a04eb26e3c8 tempest-GroupsTest-1636606751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=571b2547-e2e7-472b-8a6d-4a32141af329,created_at=2026-07-16T21:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1485395245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=571b2547-e2e7-472b-8a6d-4a32141af329,host='devstack@QuobyteHD#QuobyteHD',id=2884e301-e370-4748-826a-4397c2a030ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8142d2f3386348d48b3e77a20f0d93bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:23:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:23:52Z,use_quota=True,user_id='a7ef9dc0236a4b708a5bbf3412bbe555',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1899adbd-811f-497a-bf74-e140815e685f),volume_type_id=1899adbd-811f-497a-bf74-e140815e685f)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:23:52 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-dd013d3b-86ff-4efb-8130-1a04eb26e3c8 tempest-GroupsTest-1636606751 None] Creating volume 2884e301-e370-4748-826a-4397c2a030ea {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:23:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-dd013d3b-86ff-4efb-8130-1a04eb26e3c8 tempest-GroupsTest-1636606751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:23:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-dd013d3b-86ff-4efb-8130-1a04eb26e3c8 tempest-GroupsTest-1636606751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:23:52 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-dd013d3b-86ff-4efb-8130-1a04eb26e3c8 tempest-GroupsTest-1636606751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:23:52 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-dd013d3b-86ff-4efb-8130-1a04eb26e3c8 tempest-GroupsTest-1636606751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:23:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-dd013d3b-86ff-4efb-8130-1a04eb26e3c8 tempest-GroupsTest-1636606751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:23:52 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-dd013d3b-86ff-4efb-8130-1a04eb26e3c8 tempest-GroupsTest-1636606751 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:23:52 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-dd013d3b-86ff-4efb-8130-1a04eb26e3c8 tempest-GroupsTest-1636606751 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:23:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-dd013d3b-86ff-4efb-8130-1a04eb26e3c8 tempest-GroupsTest-1636606751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2884e301-e370-4748-826a-4397c2a030ea 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:52 devstack sudo[95390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2884e301-e370-4748-826a-4397c2a030ea 1073741824 Jul 16 23:23:52 devstack sudo[95390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:52 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ff1f5d8-bdc2-47fe-95f6-9ead743a4a7d tempest-AttachVolumeTestJSON-886512989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:23:52 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5ff1f5d8-bdc2-47fe-95f6-9ead743a4a7d tempest-AttachVolumeTestJSON-886512989 None] Flow 'volume_create_manager' (a621fac3-9a6a-499a-9eb9-d7c5e0430983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:23:52 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5ff1f5d8-bdc2-47fe-95f6-9ead743a4a7d tempest-AttachVolumeTestJSON-886512989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1937aa44-06b6-42eb-b759-2b8afdd99b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:52 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5ff1f5d8-bdc2-47fe-95f6-9ead743a4a7d tempest-AttachVolumeTestJSON-886512989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1937aa44-06b6-42eb-b759-2b8afdd99b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:23:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1211496750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cefe325-f8ae-4419-83ad-9e8d7e332fdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f3ab8578d9c45a992334f8e308a7da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:23:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:23:52Z,use_quota=True,user_id='f25c9557a8864126a12ef4fe1cd177c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:52 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5ff1f5d8-bdc2-47fe-95f6-9ead743a4a7d tempest-AttachVolumeTestJSON-886512989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efbd82db-90ca-4340-b135-8f9d32d5ce78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:52 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5ff1f5d8-bdc2-47fe-95f6-9ead743a4a7d tempest-AttachVolumeTestJSON-886512989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efbd82db-90ca-4340-b135-8f9d32d5ce78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:52 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5ff1f5d8-bdc2-47fe-95f6-9ead743a4a7d tempest-AttachVolumeTestJSON-886512989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa2dae95-6e92-47dc-86c0-3443c035cd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:52 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5ff1f5d8-bdc2-47fe-95f6-9ead743a4a7d tempest-AttachVolumeTestJSON-886512989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa2dae95-6e92-47dc-86c0-3443c035cd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cefe325-f8ae-4419-83ad-9e8d7e332fdb', 'volume_name': 'volume-9cefe325-f8ae-4419-83ad-9e8d7e332fdb', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:52 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5ff1f5d8-bdc2-47fe-95f6-9ead743a4a7d tempest-AttachVolumeTestJSON-886512989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f3d49e8-7154-43fc-b621-7d1bc5f9a1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:52 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5ff1f5d8-bdc2-47fe-95f6-9ead743a4a7d tempest-AttachVolumeTestJSON-886512989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f3d49e8-7154-43fc-b621-7d1bc5f9a1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:52 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5ff1f5d8-bdc2-47fe-95f6-9ead743a4a7d tempest-AttachVolumeTestJSON-886512989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec336994-0753-40c3-97bd-2062f3a67fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:52 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-5ff1f5d8-bdc2-47fe-95f6-9ead743a4a7d tempest-AttachVolumeTestJSON-886512989 None] Volume 9cefe325-f8ae-4419-83ad-9e8d7e332fdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cefe325-f8ae-4419-83ad-9e8d7e332fdb', 'volume_size': 1} Jul 16 23:23:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5ff1f5d8-bdc2-47fe-95f6-9ead743a4a7d tempest-AttachVolumeTestJSON-886512989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:23:52 devstack sudo[95390]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-dd013d3b-86ff-4efb-8130-1a04eb26e3c8 tempest-GroupsTest-1636606751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2884e301-e370-4748-826a-4397c2a030ea 1073741824" returned: 0 in 0.770s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-dd013d3b-86ff-4efb-8130-1a04eb26e3c8 tempest-GroupsTest-1636606751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2884e301-e370-4748-826a-4397c2a030ea {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:52 devstack sudo[95405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2884e301-e370-4748-826a-4397c2a030ea Jul 16 23:23:52 devstack sudo[95405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:53 devstack sudo[95405]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-dd013d3b-86ff-4efb-8130-1a04eb26e3c8 tempest-GroupsTest-1636606751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2884e301-e370-4748-826a-4397c2a030ea" returned: 0 in 0.371s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:53 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-dd013d3b-86ff-4efb-8130-1a04eb26e3c8 tempest-GroupsTest-1636606751 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:23:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-dd013d3b-86ff-4efb-8130-1a04eb26e3c8 tempest-GroupsTest-1636606751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:23:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5ff1f5d8-bdc2-47fe-95f6-9ead743a4a7d tempest-AttachVolumeTestJSON-886512989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.538s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:23:53 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-5ff1f5d8-bdc2-47fe-95f6-9ead743a4a7d tempest-AttachVolumeTestJSON-886512989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:23:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1211496750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cefe325-f8ae-4419-83ad-9e8d7e332fdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f3ab8578d9c45a992334f8e308a7da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:23:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:23:52Z,use_quota=True,user_id='f25c9557a8864126a12ef4fe1cd177c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:23:53 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-5ff1f5d8-bdc2-47fe-95f6-9ead743a4a7d tempest-AttachVolumeTestJSON-886512989 None] Creating volume 9cefe325-f8ae-4419-83ad-9e8d7e332fdb {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:23:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5ff1f5d8-bdc2-47fe-95f6-9ead743a4a7d tempest-AttachVolumeTestJSON-886512989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:23:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5ff1f5d8-bdc2-47fe-95f6-9ead743a4a7d tempest-AttachVolumeTestJSON-886512989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:23:53 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-5ff1f5d8-bdc2-47fe-95f6-9ead743a4a7d tempest-AttachVolumeTestJSON-886512989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:23:53 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-5ff1f5d8-bdc2-47fe-95f6-9ead743a4a7d tempest-AttachVolumeTestJSON-886512989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:23:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5ff1f5d8-bdc2-47fe-95f6-9ead743a4a7d tempest-AttachVolumeTestJSON-886512989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:23:53 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-5ff1f5d8-bdc2-47fe-95f6-9ead743a4a7d tempest-AttachVolumeTestJSON-886512989 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:23:53 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-5ff1f5d8-bdc2-47fe-95f6-9ead743a4a7d tempest-AttachVolumeTestJSON-886512989 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:23:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5ff1f5d8-bdc2-47fe-95f6-9ead743a4a7d tempest-AttachVolumeTestJSON-886512989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9cefe325-f8ae-4419-83ad-9e8d7e332fdb 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:53 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-dd013d3b-86ff-4efb-8130-1a04eb26e3c8 tempest-GroupsTest-1636606751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c76d0e-07bd-40c4-b553-ad77d97e36cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2884e301-e370-4748-826a-4397c2a030ea', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:53 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-dd013d3b-86ff-4efb-8130-1a04eb26e3c8 tempest-GroupsTest-1636606751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12ea1dfb-4fd2-41c3-a32a-ff4806dd4613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:53 devstack sudo[95408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9cefe325-f8ae-4419-83ad-9e8d7e332fdb 1073741824 Jul 16 23:23:53 devstack sudo[95408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:53 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-dd013d3b-86ff-4efb-8130-1a04eb26e3c8 tempest-GroupsTest-1636606751 None] Volume volume-2884e301-e370-4748-826a-4397c2a030ea (2884e301-e370-4748-826a-4397c2a030ea): created successfully Jul 16 23:23:53 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-dd013d3b-86ff-4efb-8130-1a04eb26e3c8 tempest-GroupsTest-1636606751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12ea1dfb-4fd2-41c3-a32a-ff4806dd4613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:53 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-dd013d3b-86ff-4efb-8130-1a04eb26e3c8 tempest-GroupsTest-1636606751 None] Flow 'volume_create_manager' (c4a86340-5a0d-4e8d-ba1d-560e1c7fb877) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:23:53 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-dd013d3b-86ff-4efb-8130-1a04eb26e3c8 tempest-GroupsTest-1636606751 None] Created volume successfully. Jul 16 23:23:53 devstack sudo[95408]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5ff1f5d8-bdc2-47fe-95f6-9ead743a4a7d tempest-AttachVolumeTestJSON-886512989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9cefe325-f8ae-4419-83ad-9e8d7e332fdb 1073741824" returned: 0 in 0.583s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5ff1f5d8-bdc2-47fe-95f6-9ead743a4a7d tempest-AttachVolumeTestJSON-886512989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9cefe325-f8ae-4419-83ad-9e8d7e332fdb {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:53 devstack sudo[95414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9cefe325-f8ae-4419-83ad-9e8d7e332fdb Jul 16 23:23:53 devstack sudo[95414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:54 devstack sudo[95414]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5ff1f5d8-bdc2-47fe-95f6-9ead743a4a7d tempest-AttachVolumeTestJSON-886512989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9cefe325-f8ae-4419-83ad-9e8d7e332fdb" returned: 0 in 0.327s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:54 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-5ff1f5d8-bdc2-47fe-95f6-9ead743a4a7d tempest-AttachVolumeTestJSON-886512989 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:23:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5ff1f5d8-bdc2-47fe-95f6-9ead743a4a7d tempest-AttachVolumeTestJSON-886512989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:23:54 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5ff1f5d8-bdc2-47fe-95f6-9ead743a4a7d tempest-AttachVolumeTestJSON-886512989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec336994-0753-40c3-97bd-2062f3a67fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cefe325-f8ae-4419-83ad-9e8d7e332fdb', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:54 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5ff1f5d8-bdc2-47fe-95f6-9ead743a4a7d tempest-AttachVolumeTestJSON-886512989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb83abae-233b-4376-a3d8-354e8f9ee00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:54 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-5ff1f5d8-bdc2-47fe-95f6-9ead743a4a7d tempest-AttachVolumeTestJSON-886512989 None] Volume volume-9cefe325-f8ae-4419-83ad-9e8d7e332fdb (9cefe325-f8ae-4419-83ad-9e8d7e332fdb): created successfully Jul 16 23:23:54 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5ff1f5d8-bdc2-47fe-95f6-9ead743a4a7d tempest-AttachVolumeTestJSON-886512989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb83abae-233b-4376-a3d8-354e8f9ee00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:54 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5ff1f5d8-bdc2-47fe-95f6-9ead743a4a7d tempest-AttachVolumeTestJSON-886512989 None] Flow 'volume_create_manager' (a621fac3-9a6a-499a-9eb9-d7c5e0430983) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:23:54 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-5ff1f5d8-bdc2-47fe-95f6-9ead743a4a7d tempest-AttachVolumeTestJSON-886512989 None] Created volume successfully. Jul 16 23:23:55 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc1c4ea9-2de9-4871-b5fe-5bc6ca8e35a5 tempest-GroupsTest-1636606751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:23:55 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bc1c4ea9-2de9-4871-b5fe-5bc6ca8e35a5 tempest-GroupsTest-1636606751 None] Flow 'volume_create_manager' (1071d7e9-13bc-49f6-98f6-d8c80acf421d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:23:55 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bc1c4ea9-2de9-4871-b5fe-5bc6ca8e35a5 tempest-GroupsTest-1636606751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1dd67ac-579a-4e47-97d2-d319554442df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:55 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bc1c4ea9-2de9-4871-b5fe-5bc6ca8e35a5 tempest-GroupsTest-1636606751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1dd67ac-579a-4e47-97d2-d319554442df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1181711233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=571b2547-e2e7-472b-8a6d-4a32141af329,host='devstack@QuobyteHD#QuobyteHD',id=09ccaa51-90d5-4505-9480-eb8a54a6b34d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8142d2f3386348d48b3e77a20f0d93bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:23:55Z,use_quota=True,user_id='a7ef9dc0236a4b708a5bbf3412bbe555',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1899adbd-811f-497a-bf74-e140815e685f),volume_type_id=1899adbd-811f-497a-bf74-e140815e685f)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:55 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bc1c4ea9-2de9-4871-b5fe-5bc6ca8e35a5 tempest-GroupsTest-1636606751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32363b8a-1dab-4905-a74b-328e989a9866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:55 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bc1c4ea9-2de9-4871-b5fe-5bc6ca8e35a5 tempest-GroupsTest-1636606751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32363b8a-1dab-4905-a74b-328e989a9866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:55 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bc1c4ea9-2de9-4871-b5fe-5bc6ca8e35a5 tempest-GroupsTest-1636606751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d466b399-d56e-4f47-a818-f3e388d40a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:55 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bc1c4ea9-2de9-4871-b5fe-5bc6ca8e35a5 tempest-GroupsTest-1636606751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d466b399-d56e-4f47-a818-f3e388d40a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09ccaa51-90d5-4505-9480-eb8a54a6b34d', 'volume_name': 'volume-09ccaa51-90d5-4505-9480-eb8a54a6b34d', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:55 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bc1c4ea9-2de9-4871-b5fe-5bc6ca8e35a5 tempest-GroupsTest-1636606751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47fea322-313b-4a8e-9876-9a99c979118d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:55 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bc1c4ea9-2de9-4871-b5fe-5bc6ca8e35a5 tempest-GroupsTest-1636606751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47fea322-313b-4a8e-9876-9a99c979118d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:55 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bc1c4ea9-2de9-4871-b5fe-5bc6ca8e35a5 tempest-GroupsTest-1636606751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (668dbe05-2910-4995-a49e-7c5b1ceacbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:55 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-bc1c4ea9-2de9-4871-b5fe-5bc6ca8e35a5 tempest-GroupsTest-1636606751 None] Volume 09ccaa51-90d5-4505-9480-eb8a54a6b34d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09ccaa51-90d5-4505-9480-eb8a54a6b34d', 'volume_size': 1} Jul 16 23:23:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bc1c4ea9-2de9-4871-b5fe-5bc6ca8e35a5 tempest-GroupsTest-1636606751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:23:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bc1c4ea9-2de9-4871-b5fe-5bc6ca8e35a5 tempest-GroupsTest-1636606751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:23:55 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-bc1c4ea9-2de9-4871-b5fe-5bc6ca8e35a5 tempest-GroupsTest-1636606751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=571b2547-e2e7-472b-8a6d-4a32141af329,created_at=2026-07-16T21:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1181711233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=571b2547-e2e7-472b-8a6d-4a32141af329,host='devstack@QuobyteHD#QuobyteHD',id=09ccaa51-90d5-4505-9480-eb8a54a6b34d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8142d2f3386348d48b3e77a20f0d93bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:23:55Z,use_quota=True,user_id='a7ef9dc0236a4b708a5bbf3412bbe555',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1899adbd-811f-497a-bf74-e140815e685f),volume_type_id=1899adbd-811f-497a-bf74-e140815e685f)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:23:55 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-bc1c4ea9-2de9-4871-b5fe-5bc6ca8e35a5 tempest-GroupsTest-1636606751 None] Creating volume 09ccaa51-90d5-4505-9480-eb8a54a6b34d {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:23:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bc1c4ea9-2de9-4871-b5fe-5bc6ca8e35a5 tempest-GroupsTest-1636606751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:23:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bc1c4ea9-2de9-4871-b5fe-5bc6ca8e35a5 tempest-GroupsTest-1636606751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:23:55 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-bc1c4ea9-2de9-4871-b5fe-5bc6ca8e35a5 tempest-GroupsTest-1636606751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:23:55 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-bc1c4ea9-2de9-4871-b5fe-5bc6ca8e35a5 tempest-GroupsTest-1636606751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:23:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bc1c4ea9-2de9-4871-b5fe-5bc6ca8e35a5 tempest-GroupsTest-1636606751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:23:55 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-bc1c4ea9-2de9-4871-b5fe-5bc6ca8e35a5 tempest-GroupsTest-1636606751 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:23:55 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-bc1c4ea9-2de9-4871-b5fe-5bc6ca8e35a5 tempest-GroupsTest-1636606751 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:23:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bc1c4ea9-2de9-4871-b5fe-5bc6ca8e35a5 tempest-GroupsTest-1636606751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-09ccaa51-90d5-4505-9480-eb8a54a6b34d 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:55 devstack sudo[95423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-09ccaa51-90d5-4505-9480-eb8a54a6b34d 1073741824 Jul 16 23:23:55 devstack sudo[95423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-b7edc6dc-2e0c-47e7-a8e7-03f95ebd3ea2 req-e755e37c-004f-4635-bd13-fc35111aa6c6 tempest-AttachVolumeTestJSON-886512989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:23:55 devstack sudo[95423]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bc1c4ea9-2de9-4871-b5fe-5bc6ca8e35a5 tempest-GroupsTest-1636606751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-09ccaa51-90d5-4505-9480-eb8a54a6b34d 1073741824" returned: 0 in 0.645s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bc1c4ea9-2de9-4871-b5fe-5bc6ca8e35a5 tempest-GroupsTest-1636606751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-09ccaa51-90d5-4505-9480-eb8a54a6b34d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:56 devstack sudo[95437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-09ccaa51-90d5-4505-9480-eb8a54a6b34d Jul 16 23:23:56 devstack sudo[95437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:56 devstack sudo[95437]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bc1c4ea9-2de9-4871-b5fe-5bc6ca8e35a5 tempest-GroupsTest-1636606751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-09ccaa51-90d5-4505-9480-eb8a54a6b34d" returned: 0 in 0.296s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:56 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-bc1c4ea9-2de9-4871-b5fe-5bc6ca8e35a5 tempest-GroupsTest-1636606751 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:23:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bc1c4ea9-2de9-4871-b5fe-5bc6ca8e35a5 tempest-GroupsTest-1636606751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:23:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-b7edc6dc-2e0c-47e7-a8e7-03f95ebd3ea2 req-e755e37c-004f-4635-bd13-fc35111aa6c6 tempest-AttachVolumeTestJSON-886512989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.581s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:23:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-b7edc6dc-2e0c-47e7-a8e7-03f95ebd3ea2 req-e755e37c-004f-4635-bd13-fc35111aa6c6 tempest-AttachVolumeTestJSON-886512989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:23:56 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bc1c4ea9-2de9-4871-b5fe-5bc6ca8e35a5 tempest-GroupsTest-1636606751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (668dbe05-2910-4995-a49e-7c5b1ceacbcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09ccaa51-90d5-4505-9480-eb8a54a6b34d', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:56 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bc1c4ea9-2de9-4871-b5fe-5bc6ca8e35a5 tempest-GroupsTest-1636606751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8dc7bee-740e-433c-940f-53aaf566e799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:56 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-bc1c4ea9-2de9-4871-b5fe-5bc6ca8e35a5 tempest-GroupsTest-1636606751 None] Volume volume-09ccaa51-90d5-4505-9480-eb8a54a6b34d (09ccaa51-90d5-4505-9480-eb8a54a6b34d): created successfully Jul 16 23:23:56 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bc1c4ea9-2de9-4871-b5fe-5bc6ca8e35a5 tempest-GroupsTest-1636606751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8dc7bee-740e-433c-940f-53aaf566e799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:56 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bc1c4ea9-2de9-4871-b5fe-5bc6ca8e35a5 tempest-GroupsTest-1636606751 None] Flow 'volume_create_manager' (1071d7e9-13bc-49f6-98f6-d8c80acf421d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:23:56 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-bc1c4ea9-2de9-4871-b5fe-5bc6ca8e35a5 tempest-GroupsTest-1636606751 None] Created volume successfully. Jul 16 23:23:56 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-b7edc6dc-2e0c-47e7-a8e7-03f95ebd3ea2 req-e755e37c-004f-4635-bd13-fc35111aa6c6 tempest-AttachVolumeTestJSON-886512989 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72', 'name': 'volume-9cefe325-f8ae-4419-83ad-9e8d7e332fdb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dcc29fbe-7593-4597-8f0c-683a89189084', 'enforce_multipath': True} {{(pid=87607) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 23:23:56 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-b7edc6dc-2e0c-47e7-a8e7-03f95ebd3ea2 req-e755e37c-004f-4635-bd13-fc35111aa6c6 tempest-AttachVolumeTestJSON-886512989 None] attachment_update completed successfully. Jul 16 23:23:57 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-f65754c1-da2d-47c1-8c19-80d02ac48f45 tempest-VolumesActionsTest-219677645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:23:57 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f65754c1-da2d-47c1-8c19-80d02ac48f45 tempest-VolumesActionsTest-219677645 None] Flow 'volume_create_manager' (8671279c-1bc1-4f7b-b34b-b1ae8b7e743f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:23:57 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f65754c1-da2d-47c1-8c19-80d02ac48f45 tempest-VolumesActionsTest-219677645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f68c005-510f-4350-adb1-5a0477024eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:57 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f65754c1-da2d-47c1-8c19-80d02ac48f45 tempest-VolumesActionsTest-219677645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f68c005-510f-4350-adb1-5a0477024eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1719301975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a07455-2676-48ae-ae86-d92b5c2f672c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f86ed0a20411479b9a7eb640f4abc134',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:23:57Z,use_quota=True,user_id='6461dfd842e147a1b4784873aa183510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:57 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f65754c1-da2d-47c1-8c19-80d02ac48f45 tempest-VolumesActionsTest-219677645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7724883f-c62a-4080-b265-83e4ba86ecb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:57 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f65754c1-da2d-47c1-8c19-80d02ac48f45 tempest-VolumesActionsTest-219677645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7724883f-c62a-4080-b265-83e4ba86ecb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:57 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f65754c1-da2d-47c1-8c19-80d02ac48f45 tempest-VolumesActionsTest-219677645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85ce90cf-9b90-4cde-a50b-f9fe13668c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:57 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f65754c1-da2d-47c1-8c19-80d02ac48f45 tempest-VolumesActionsTest-219677645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85ce90cf-9b90-4cde-a50b-f9fe13668c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6a07455-2676-48ae-ae86-d92b5c2f672c', 'volume_name': 'volume-a6a07455-2676-48ae-ae86-d92b5c2f672c', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:57 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f65754c1-da2d-47c1-8c19-80d02ac48f45 tempest-VolumesActionsTest-219677645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c2afa6e-4657-4028-b7a6-46d5927b9c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:57 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f65754c1-da2d-47c1-8c19-80d02ac48f45 tempest-VolumesActionsTest-219677645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c2afa6e-4657-4028-b7a6-46d5927b9c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:57 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f65754c1-da2d-47c1-8c19-80d02ac48f45 tempest-VolumesActionsTest-219677645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39af83c7-388f-4bec-b9f4-ee752b02353e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:57 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-f65754c1-da2d-47c1-8c19-80d02ac48f45 tempest-VolumesActionsTest-219677645 None] Volume a6a07455-2676-48ae-ae86-d92b5c2f672c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6a07455-2676-48ae-ae86-d92b5c2f672c', 'volume_size': 1} Jul 16 23:23:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f65754c1-da2d-47c1-8c19-80d02ac48f45 tempest-VolumesActionsTest-219677645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:23:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f65754c1-da2d-47c1-8c19-80d02ac48f45 tempest-VolumesActionsTest-219677645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:23:57 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f65754c1-da2d-47c1-8c19-80d02ac48f45 tempest-VolumesActionsTest-219677645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1719301975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a07455-2676-48ae-ae86-d92b5c2f672c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f86ed0a20411479b9a7eb640f4abc134',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:23:57Z,use_quota=True,user_id='6461dfd842e147a1b4784873aa183510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:23:57 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-f65754c1-da2d-47c1-8c19-80d02ac48f45 tempest-VolumesActionsTest-219677645 None] Creating volume a6a07455-2676-48ae-ae86-d92b5c2f672c {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:23:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f65754c1-da2d-47c1-8c19-80d02ac48f45 tempest-VolumesActionsTest-219677645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:23:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f65754c1-da2d-47c1-8c19-80d02ac48f45 tempest-VolumesActionsTest-219677645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:23:57 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f65754c1-da2d-47c1-8c19-80d02ac48f45 tempest-VolumesActionsTest-219677645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:23:57 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f65754c1-da2d-47c1-8c19-80d02ac48f45 tempest-VolumesActionsTest-219677645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:23:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f65754c1-da2d-47c1-8c19-80d02ac48f45 tempest-VolumesActionsTest-219677645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:23:57 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f65754c1-da2d-47c1-8c19-80d02ac48f45 tempest-VolumesActionsTest-219677645 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:23:57 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-f65754c1-da2d-47c1-8c19-80d02ac48f45 tempest-VolumesActionsTest-219677645 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:23:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f65754c1-da2d-47c1-8c19-80d02ac48f45 tempest-VolumesActionsTest-219677645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a6a07455-2676-48ae-ae86-d92b5c2f672c 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:57 devstack sudo[95442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a6a07455-2676-48ae-ae86-d92b5c2f672c 1073741824 Jul 16 23:23:57 devstack sudo[95442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:57 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-b38928c3-cfc3-4f82-8df0-2571ba0a0466 tempest-GroupsTest-1636606751 None] Update group completed successfully. Jul 16 23:23:58 devstack sudo[95442]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f65754c1-da2d-47c1-8c19-80d02ac48f45 tempest-VolumesActionsTest-219677645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a6a07455-2676-48ae-ae86-d92b5c2f672c 1073741824" returned: 0 in 0.559s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f65754c1-da2d-47c1-8c19-80d02ac48f45 tempest-VolumesActionsTest-219677645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a6a07455-2676-48ae-ae86-d92b5c2f672c {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:23:58 devstack sudo[95451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a6a07455-2676-48ae-ae86-d92b5c2f672c Jul 16 23:23:58 devstack sudo[95451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:23:58 devstack sudo[95451]: pam_unix(sudo:session): session closed for user root Jul 16 23:23:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f65754c1-da2d-47c1-8c19-80d02ac48f45 tempest-VolumesActionsTest-219677645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a6a07455-2676-48ae-ae86-d92b5c2f672c" returned: 0 in 0.287s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:23:58 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f65754c1-da2d-47c1-8c19-80d02ac48f45 tempest-VolumesActionsTest-219677645 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:23:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f65754c1-da2d-47c1-8c19-80d02ac48f45 tempest-VolumesActionsTest-219677645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:23:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f65754c1-da2d-47c1-8c19-80d02ac48f45 tempest-VolumesActionsTest-219677645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39af83c7-388f-4bec-b9f4-ee752b02353e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6a07455-2676-48ae-ae86-d92b5c2f672c', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f65754c1-da2d-47c1-8c19-80d02ac48f45 tempest-VolumesActionsTest-219677645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52200c9b-113d-489c-8572-316d2ff01c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:23:58 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-f65754c1-da2d-47c1-8c19-80d02ac48f45 tempest-VolumesActionsTest-219677645 None] Volume volume-a6a07455-2676-48ae-ae86-d92b5c2f672c (a6a07455-2676-48ae-ae86-d92b5c2f672c): created successfully Jul 16 23:23:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f65754c1-da2d-47c1-8c19-80d02ac48f45 tempest-VolumesActionsTest-219677645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52200c9b-113d-489c-8572-316d2ff01c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:23:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f65754c1-da2d-47c1-8c19-80d02ac48f45 tempest-VolumesActionsTest-219677645 None] Flow 'volume_create_manager' (8671279c-1bc1-4f7b-b34b-b1ae8b7e743f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:23:58 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-f65754c1-da2d-47c1-8c19-80d02ac48f45 tempest-VolumesActionsTest-219677645 None] Created volume successfully. Jul 16 23:23:58 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-a7c37061-c9ec-412f-b4da-78bc7d885a5b req-258e1f46-3c4a-48dc-8be3-458b501db474 tempest-AttachVolumeTestJSON-886512989 None] Terminate volume connection completed successfully. Jul 16 23:23:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-a7c37061-c9ec-412f-b4da-78bc7d885a5b req-258e1f46-3c4a-48dc-8be3-458b501db474 tempest-AttachVolumeTestJSON-886512989 None] Deleting attachment f946ca5e-a653-46b2-ae40-8cd13c1ef7f0. {{(pid=87607) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 23:23:59 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-af17fa47-5302-497b-bf87-8e7f4264cb1a tempest-GroupsTest-1636606751 None] Update group completed successfully. Jul 16 23:24:00 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-4130a490-4e61-48bc-a590-aad65eadb535 req-6085d14a-9c8a-42ea-9d82-9a1f7c6197e3 tempest-AttachVolumeTestJSON-886512989 None] Terminate volume connection completed successfully. Jul 16 23:24:00 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-4130a490-4e61-48bc-a590-aad65eadb535 req-6085d14a-9c8a-42ea-9d82-9a1f7c6197e3 tempest-AttachVolumeTestJSON-886512989 None] Deleting attachment dcc29fbe-7593-4597-8f0c-683a89189084. {{(pid=87607) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 23:24:01 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-44a6370a-f1e7-4580-a548-4d68bb28c7ad tempest-GroupsTest-1636606751 None] Acquiring lock "cinder-quobyte-09ccaa51-90d5-4505-9480-eb8a54a6b34d" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:24:01 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-44a6370a-f1e7-4580-a548-4d68bb28c7ad tempest-GroupsTest-1636606751 None] Lock "cinder-quobyte-09ccaa51-90d5-4505-9480-eb8a54a6b34d" acquired by "delete_volume" :: waited 0.020s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:24:01 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6885a03-62e3-4cc3-b111-8df745c8ae2c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:24:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-44a6370a-f1e7-4580-a548-4d68bb28c7ad tempest-GroupsTest-1636606751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-09ccaa51-90d5-4505-9480-eb8a54a6b34d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:24:01 devstack sudo[95488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-09ccaa51-90d5-4505-9480-eb8a54a6b34d Jul 16 23:24:01 devstack sudo[95488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:24:01 devstack sudo[95488]: pam_unix(sudo:session): session closed for user root Jul 16 23:24:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-44a6370a-f1e7-4580-a548-4d68bb28c7ad tempest-GroupsTest-1636606751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-09ccaa51-90d5-4505-9480-eb8a54a6b34d" returned: 0 in 0.603s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:24:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-44a6370a-f1e7-4580-a548-4d68bb28c7ad tempest-GroupsTest-1636606751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-09ccaa51-90d5-4505-9480-eb8a54a6b34d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:24:01 devstack sudo[95494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-09ccaa51-90d5-4505-9480-eb8a54a6b34d Jul 16 23:24:01 devstack sudo[95494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:24:02 devstack sudo[95494]: pam_unix(sudo:session): session closed for user root Jul 16 23:24:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-44a6370a-f1e7-4580-a548-4d68bb28c7ad tempest-GroupsTest-1636606751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-09ccaa51-90d5-4505-9480-eb8a54a6b34d" returned: 0 in 0.409s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:24:02 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-44a6370a-f1e7-4580-a548-4d68bb28c7ad tempest-GroupsTest-1636606751 None] Lock "cinder-quobyte-09ccaa51-90d5-4505-9480-eb8a54a6b34d" released by "delete_volume" :: held 1.083s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:24:02 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-44a6370a-f1e7-4580-a548-4d68bb28c7ad tempest-GroupsTest-1636606751 None] Acquiring lock "cinder-quobyte-2884e301-e370-4748-826a-4397c2a030ea" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:24:02 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-44a6370a-f1e7-4580-a548-4d68bb28c7ad tempest-GroupsTest-1636606751 None] Lock "cinder-quobyte-2884e301-e370-4748-826a-4397c2a030ea" acquired by "delete_volume" :: waited 0.020s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:24:02 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[3449e4fb-a7f9-4dfc-a085-c7ebf432a90b]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:24:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-44a6370a-f1e7-4580-a548-4d68bb28c7ad tempest-GroupsTest-1636606751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2884e301-e370-4748-826a-4397c2a030ea {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:24:02 devstack sudo[95507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2884e301-e370-4748-826a-4397c2a030ea Jul 16 23:24:02 devstack sudo[95507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:24:02 devstack sudo[95507]: pam_unix(sudo:session): session closed for user root Jul 16 23:24:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-44a6370a-f1e7-4580-a548-4d68bb28c7ad tempest-GroupsTest-1636606751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2884e301-e370-4748-826a-4397c2a030ea" returned: 0 in 0.675s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:24:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-44a6370a-f1e7-4580-a548-4d68bb28c7ad tempest-GroupsTest-1636606751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2884e301-e370-4748-826a-4397c2a030ea {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:24:02 devstack sudo[95528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2884e301-e370-4748-826a-4397c2a030ea Jul 16 23:24:02 devstack sudo[95528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:24:03 devstack sudo[95528]: pam_unix(sudo:session): session closed for user root Jul 16 23:24:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-44a6370a-f1e7-4580-a548-4d68bb28c7ad tempest-GroupsTest-1636606751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2884e301-e370-4748-826a-4397c2a030ea" returned: 0 in 0.316s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:24:03 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-44a6370a-f1e7-4580-a548-4d68bb28c7ad tempest-GroupsTest-1636606751 None] Lock "cinder-quobyte-2884e301-e370-4748-826a-4397c2a030ea" released by "delete_volume" :: held 1.064s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:24:03 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-44a6370a-f1e7-4580-a548-4d68bb28c7ad tempest-GroupsTest-1636606751 None] Created reservations ['f3f00815-580d-4e11-a948-05162daee10d'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:24:03 devstack cinder-volume[87607]: WARNING cinder.quota [None req-44a6370a-f1e7-4580-a548-4d68bb28c7ad tempest-GroupsTest-1636606751 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1230010078 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1230010078, it is now deprecated. Please use the default quota class for default quota. Jul 16 23:24:03 devstack cinder-volume[87607]: WARNING cinder.quota [None req-44a6370a-f1e7-4580-a548-4d68bb28c7ad tempest-GroupsTest-1636606751 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1230010078 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1230010078, it is now deprecated. Please use the default quota class for default quota. Jul 16 23:24:03 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-44a6370a-f1e7-4580-a548-4d68bb28c7ad tempest-GroupsTest-1636606751 None] Created reservations ['d3d0dc43-9e0a-4029-a1e8-c7cfafa129af', 'ab705f8e-79c9-480e-889c-fda611eba41e', '7903470a-9db2-49f7-b11e-b245805c5b6d', '2345c853-1931-4a91-bfe4-9f71449584f9'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:24:03 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-44a6370a-f1e7-4580-a548-4d68bb28c7ad tempest-GroupsTest-1636606751 None] Created reservations ['b5761580-8aeb-4220-8c0b-6013d72fd6db', 'b899abff-a34f-42dc-9137-ea85acbfb130', '705e8cee-1bac-4311-bfe7-9ac8f502ce90', '22a55644-6a4b-4815-96d5-1fb9f82a8994'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:24:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-44a6370a-f1e7-4580-a548-4d68bb28c7ad tempest-GroupsTest-1636606751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:24:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-44a6370a-f1e7-4580-a548-4d68bb28c7ad tempest-GroupsTest-1636606751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:24:03 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-44a6370a-f1e7-4580-a548-4d68bb28c7ad tempest-GroupsTest-1636606751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:24:03 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-44a6370a-f1e7-4580-a548-4d68bb28c7ad tempest-GroupsTest-1636606751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:24:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-44a6370a-f1e7-4580-a548-4d68bb28c7ad tempest-GroupsTest-1636606751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:24:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-44a6370a-f1e7-4580-a548-4d68bb28c7ad tempest-GroupsTest-1636606751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:24:03 devstack sudo[95543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:24:03 devstack sudo[95543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:24:04 devstack sudo[95543]: pam_unix(sudo:session): session closed for user root Jul 16 23:24:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-44a6370a-f1e7-4580-a548-4d68bb28c7ad tempest-GroupsTest-1636606751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.399s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:24:04 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-44a6370a-f1e7-4580-a548-4d68bb28c7ad tempest-GroupsTest-1636606751 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:24:04 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-44a6370a-f1e7-4580-a548-4d68bb28c7ad tempest-GroupsTest-1636606751 None] Delete group completed successfully. Jul 16 23:24:09 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-bf65622d-a0af-47f1-b14f-2f4a3f8896d0 tempest-AttachVolumeTestJSON-886512989 None] Acquiring lock "cinder-9cefe325-f8ae-4419-83ad-9e8d7e332fdb-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:24:10 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-bf65622d-a0af-47f1-b14f-2f4a3f8896d0 tempest-AttachVolumeTestJSON-886512989 None] Lock "cinder-9cefe325-f8ae-4419-83ad-9e8d7e332fdb-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:24:10 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-bf65622d-a0af-47f1-b14f-2f4a3f8896d0 tempest-AttachVolumeTestJSON-886512989 None] Acquiring lock "cinder-quobyte-9cefe325-f8ae-4419-83ad-9e8d7e332fdb" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:24:10 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-bf65622d-a0af-47f1-b14f-2f4a3f8896d0 tempest-AttachVolumeTestJSON-886512989 None] Lock "cinder-quobyte-9cefe325-f8ae-4419-83ad-9e8d7e332fdb" acquired by "delete_volume" :: waited 0.031s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:24:10 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[1679b16f-6c47-4cfb-a8ce-cf943ef6d3b4]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:24:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bf65622d-a0af-47f1-b14f-2f4a3f8896d0 tempest-AttachVolumeTestJSON-886512989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9cefe325-f8ae-4419-83ad-9e8d7e332fdb {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:24:10 devstack sudo[95621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9cefe325-f8ae-4419-83ad-9e8d7e332fdb Jul 16 23:24:10 devstack sudo[95621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:24:10 devstack sudo[95621]: pam_unix(sudo:session): session closed for user root Jul 16 23:24:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bf65622d-a0af-47f1-b14f-2f4a3f8896d0 tempest-AttachVolumeTestJSON-886512989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9cefe325-f8ae-4419-83ad-9e8d7e332fdb" returned: 0 in 0.751s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:24:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bf65622d-a0af-47f1-b14f-2f4a3f8896d0 tempest-AttachVolumeTestJSON-886512989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9cefe325-f8ae-4419-83ad-9e8d7e332fdb {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:24:10 devstack sudo[95626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9cefe325-f8ae-4419-83ad-9e8d7e332fdb Jul 16 23:24:10 devstack sudo[95626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:24:11 devstack sudo[95626]: pam_unix(sudo:session): session closed for user root Jul 16 23:24:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bf65622d-a0af-47f1-b14f-2f4a3f8896d0 tempest-AttachVolumeTestJSON-886512989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9cefe325-f8ae-4419-83ad-9e8d7e332fdb" returned: 0 in 0.415s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:24:11 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-bf65622d-a0af-47f1-b14f-2f4a3f8896d0 tempest-AttachVolumeTestJSON-886512989 None] Lock "cinder-quobyte-9cefe325-f8ae-4419-83ad-9e8d7e332fdb" released by "delete_volume" :: held 1.272s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:24:11 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-bf65622d-a0af-47f1-b14f-2f4a3f8896d0 tempest-AttachVolumeTestJSON-886512989 None] Created reservations ['127f90eb-8e2b-4c05-982f-4036ef69329d', '11461256-6dbd-42a5-803e-1ba8aa02f86b', '3a4f6647-0447-41b1-9fe0-b660013088c2', '2019487b-dbb2-49d5-9336-182118f6583b'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:24:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bf65622d-a0af-47f1-b14f-2f4a3f8896d0 tempest-AttachVolumeTestJSON-886512989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:24:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bf65622d-a0af-47f1-b14f-2f4a3f8896d0 tempest-AttachVolumeTestJSON-886512989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:24:11 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-bf65622d-a0af-47f1-b14f-2f4a3f8896d0 tempest-AttachVolumeTestJSON-886512989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:24:11 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-bf65622d-a0af-47f1-b14f-2f4a3f8896d0 tempest-AttachVolumeTestJSON-886512989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:24:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bf65622d-a0af-47f1-b14f-2f4a3f8896d0 tempest-AttachVolumeTestJSON-886512989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:24:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bf65622d-a0af-47f1-b14f-2f4a3f8896d0 tempest-AttachVolumeTestJSON-886512989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:24:11 devstack sudo[95629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:24:11 devstack sudo[95629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:24:11 devstack sudo[95629]: pam_unix(sudo:session): session closed for user root Jul 16 23:24:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bf65622d-a0af-47f1-b14f-2f4a3f8896d0 tempest-AttachVolumeTestJSON-886512989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.406s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:24:11 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-bf65622d-a0af-47f1-b14f-2f4a3f8896d0 tempest-AttachVolumeTestJSON-886512989 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:24:11 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-bf65622d-a0af-47f1-b14f-2f4a3f8896d0 tempest-AttachVolumeTestJSON-886512989 None] Deleted volume successfully. Jul 16 23:24:12 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-bf65622d-a0af-47f1-b14f-2f4a3f8896d0 tempest-AttachVolumeTestJSON-886512989 None] Lock "cinder-9cefe325-f8ae-4419-83ad-9e8d7e332fdb-delete_volume" released by "delete_volume" :: held 2.015s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:24:12 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-19a13c20-fe46-4629-ac70-5a23707c1f90 tempest-AttachVolumeTestJSON-886512989 None] Acquiring lock "cinder-1c887a43-5d47-43c7-ac18-a80d34851988-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:24:12 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-19a13c20-fe46-4629-ac70-5a23707c1f90 tempest-AttachVolumeTestJSON-886512989 None] Lock "cinder-1c887a43-5d47-43c7-ac18-a80d34851988-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:24:12 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-19a13c20-fe46-4629-ac70-5a23707c1f90 tempest-AttachVolumeTestJSON-886512989 None] Acquiring lock "cinder-quobyte-1c887a43-5d47-43c7-ac18-a80d34851988" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:24:12 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-19a13c20-fe46-4629-ac70-5a23707c1f90 tempest-AttachVolumeTestJSON-886512989 None] Lock "cinder-quobyte-1c887a43-5d47-43c7-ac18-a80d34851988" acquired by "delete_volume" :: waited 0.030s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:24:12 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[3031fd77-247b-4e60-bad8-fdafda881653]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:24:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-19a13c20-fe46-4629-ac70-5a23707c1f90 tempest-AttachVolumeTestJSON-886512989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1c887a43-5d47-43c7-ac18-a80d34851988 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:24:12 devstack sudo[95632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1c887a43-5d47-43c7-ac18-a80d34851988 Jul 16 23:24:12 devstack sudo[95632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:24:12 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-9965720d-5f55-44c9-aeff-3c4327aea977 tempest-VolumesActionsTest-219677645 None] Acquiring lock "cinder-a6a07455-2676-48ae-ae86-d92b5c2f672c" by "attach_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:24:12 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-9965720d-5f55-44c9-aeff-3c4327aea977 tempest-VolumesActionsTest-219677645 None] Lock "cinder-a6a07455-2676-48ae-ae86-d92b5c2f672c" acquired by "attach_volume" :: waited 0.041s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:24:12 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-9965720d-5f55-44c9-aeff-3c4327aea977 tempest-VolumesActionsTest-219677645 None] Attaching volume a6a07455-2676-48ae-ae86-d92b5c2f672c to instance a6eed517-cd43-41fd-be6f-5780a6a27a1f at mountpoint /dev/vdb on host None. Jul 16 23:24:12 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-9965720d-5f55-44c9-aeff-3c4327aea977 tempest-VolumesActionsTest-219677645 None] Attach volume completed successfully. Jul 16 23:24:13 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-9965720d-5f55-44c9-aeff-3c4327aea977 tempest-VolumesActionsTest-219677645 None] Lock "cinder-a6a07455-2676-48ae-ae86-d92b5c2f672c" released by "attach_volume" :: held 0.162s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:24:13 devstack sudo[95632]: pam_unix(sudo:session): session closed for user root Jul 16 23:24:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-19a13c20-fe46-4629-ac70-5a23707c1f90 tempest-AttachVolumeTestJSON-886512989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1c887a43-5d47-43c7-ac18-a80d34851988" returned: 0 in 0.581s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:24:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-19a13c20-fe46-4629-ac70-5a23707c1f90 tempest-AttachVolumeTestJSON-886512989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1c887a43-5d47-43c7-ac18-a80d34851988 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:24:13 devstack sudo[95637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1c887a43-5d47-43c7-ac18-a80d34851988 Jul 16 23:24:13 devstack sudo[95637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:24:13 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d85b05e9-db2b-4241-9d1e-fee53219d03d tempest-VolumesActionsTest-219677645 None] Acquiring lock "cinder-a6a07455-2676-48ae-ae86-d92b5c2f672c-detach_volume" by "detach_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:24:13 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d85b05e9-db2b-4241-9d1e-fee53219d03d tempest-VolumesActionsTest-219677645 None] Lock "cinder-a6a07455-2676-48ae-ae86-d92b5c2f672c-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:24:13 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-d85b05e9-db2b-4241-9d1e-fee53219d03d tempest-VolumesActionsTest-219677645 None] Detaching volume a6a07455-2676-48ae-ae86-d92b5c2f672c from instance a6eed517-cd43-41fd-be6f-5780a6a27a1f. Jul 16 23:24:13 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-d85b05e9-db2b-4241-9d1e-fee53219d03d tempest-VolumesActionsTest-219677645 None] Detach volume completed successfully. Jul 16 23:24:13 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d85b05e9-db2b-4241-9d1e-fee53219d03d tempest-VolumesActionsTest-219677645 None] Lock "cinder-a6a07455-2676-48ae-ae86-d92b5c2f672c-detach_volume" released by "detach_volume" :: held 0.092s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:24:13 devstack sudo[95637]: pam_unix(sudo:session): session closed for user root Jul 16 23:24:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-19a13c20-fe46-4629-ac70-5a23707c1f90 tempest-AttachVolumeTestJSON-886512989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1c887a43-5d47-43c7-ac18-a80d34851988" returned: 0 in 0.429s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:24:13 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-19a13c20-fe46-4629-ac70-5a23707c1f90 tempest-AttachVolumeTestJSON-886512989 None] Lock "cinder-quobyte-1c887a43-5d47-43c7-ac18-a80d34851988" released by "delete_volume" :: held 1.085s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:24:13 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-19a13c20-fe46-4629-ac70-5a23707c1f90 tempest-AttachVolumeTestJSON-886512989 None] Created reservations ['3f6da7bb-5b78-4edd-bb34-9f2d015fa355', 'b0139790-ef4c-483d-81fa-7b7ad389565c', 'cce44976-a426-40da-9a3b-e84312e1d936', '71bef86d-e27c-4534-aa63-a29eca5b12f7'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:24:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-19a13c20-fe46-4629-ac70-5a23707c1f90 tempest-AttachVolumeTestJSON-886512989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:24:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-19a13c20-fe46-4629-ac70-5a23707c1f90 tempest-AttachVolumeTestJSON-886512989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:24:13 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-19a13c20-fe46-4629-ac70-5a23707c1f90 tempest-AttachVolumeTestJSON-886512989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:24:13 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-19a13c20-fe46-4629-ac70-5a23707c1f90 tempest-AttachVolumeTestJSON-886512989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:24:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-19a13c20-fe46-4629-ac70-5a23707c1f90 tempest-AttachVolumeTestJSON-886512989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:24:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-19a13c20-fe46-4629-ac70-5a23707c1f90 tempest-AttachVolumeTestJSON-886512989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:24:13 devstack sudo[95642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:24:13 devstack sudo[95642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:24:14 devstack sudo[95642]: pam_unix(sudo:session): session closed for user root Jul 16 23:24:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-19a13c20-fe46-4629-ac70-5a23707c1f90 tempest-AttachVolumeTestJSON-886512989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.465s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:24:14 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-19a13c20-fe46-4629-ac70-5a23707c1f90 tempest-AttachVolumeTestJSON-886512989 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:24:14 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-19a13c20-fe46-4629-ac70-5a23707c1f90 tempest-AttachVolumeTestJSON-886512989 None] Deleted volume successfully. Jul 16 23:24:14 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-19a13c20-fe46-4629-ac70-5a23707c1f90 tempest-AttachVolumeTestJSON-886512989 None] Lock "cinder-1c887a43-5d47-43c7-ac18-a80d34851988-delete_volume" released by "delete_volume" :: held 1.997s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:24:14 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ec2c1f55-a7a6-4e7d-b03d-54b4e01fdf45 tempest-AttachVolumeTestJSON-886512989 None] Acquiring lock "cinder-70b02aa0-e8ae-4aaa-bb47-d48c7f3eb9c7-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:24:14 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ec2c1f55-a7a6-4e7d-b03d-54b4e01fdf45 tempest-AttachVolumeTestJSON-886512989 None] Lock "cinder-70b02aa0-e8ae-4aaa-bb47-d48c7f3eb9c7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:24:14 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ec2c1f55-a7a6-4e7d-b03d-54b4e01fdf45 tempest-AttachVolumeTestJSON-886512989 None] Acquiring lock "cinder-quobyte-70b02aa0-e8ae-4aaa-bb47-d48c7f3eb9c7" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:24:14 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ec2c1f55-a7a6-4e7d-b03d-54b4e01fdf45 tempest-AttachVolumeTestJSON-886512989 None] Lock "cinder-quobyte-70b02aa0-e8ae-4aaa-bb47-d48c7f3eb9c7" acquired by "delete_volume" :: waited 0.020s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:24:15 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec8f35a-45b1-4067-9b49-0f206c999db9]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:24:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ec2c1f55-a7a6-4e7d-b03d-54b4e01fdf45 tempest-AttachVolumeTestJSON-886512989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-70b02aa0-e8ae-4aaa-bb47-d48c7f3eb9c7 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:24:15 devstack sudo[95665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-70b02aa0-e8ae-4aaa-bb47-d48c7f3eb9c7 Jul 16 23:24:15 devstack sudo[95665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:24:15 devstack sudo[95665]: pam_unix(sudo:session): session closed for user root Jul 16 23:24:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ec2c1f55-a7a6-4e7d-b03d-54b4e01fdf45 tempest-AttachVolumeTestJSON-886512989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-70b02aa0-e8ae-4aaa-bb47-d48c7f3eb9c7" returned: 0 in 0.547s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:24:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ec2c1f55-a7a6-4e7d-b03d-54b4e01fdf45 tempest-AttachVolumeTestJSON-886512989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-70b02aa0-e8ae-4aaa-bb47-d48c7f3eb9c7 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:24:15 devstack sudo[95671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-70b02aa0-e8ae-4aaa-bb47-d48c7f3eb9c7 Jul 16 23:24:15 devstack sudo[95671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:24:15 devstack sudo[95671]: pam_unix(sudo:session): session closed for user root Jul 16 23:24:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ec2c1f55-a7a6-4e7d-b03d-54b4e01fdf45 tempest-AttachVolumeTestJSON-886512989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-70b02aa0-e8ae-4aaa-bb47-d48c7f3eb9c7" returned: 0 in 0.382s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:24:15 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ec2c1f55-a7a6-4e7d-b03d-54b4e01fdf45 tempest-AttachVolumeTestJSON-886512989 None] Lock "cinder-quobyte-70b02aa0-e8ae-4aaa-bb47-d48c7f3eb9c7" released by "delete_volume" :: held 1.001s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:24:16 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-ec2c1f55-a7a6-4e7d-b03d-54b4e01fdf45 tempest-AttachVolumeTestJSON-886512989 None] Created reservations ['cd51d31d-76f0-4be5-9824-3d07ad6f1006', '38abb695-2bf6-484c-82d1-0fff7013a359', 'dc288f8e-e0ea-4230-8073-a00bcdf9fa47', 'c7c1708c-25ef-4769-806a-8d3babb90393'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:24:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ec2c1f55-a7a6-4e7d-b03d-54b4e01fdf45 tempest-AttachVolumeTestJSON-886512989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:24:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ec2c1f55-a7a6-4e7d-b03d-54b4e01fdf45 tempest-AttachVolumeTestJSON-886512989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:24:16 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ec2c1f55-a7a6-4e7d-b03d-54b4e01fdf45 tempest-AttachVolumeTestJSON-886512989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:24:16 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ec2c1f55-a7a6-4e7d-b03d-54b4e01fdf45 tempest-AttachVolumeTestJSON-886512989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:24:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ec2c1f55-a7a6-4e7d-b03d-54b4e01fdf45 tempest-AttachVolumeTestJSON-886512989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:24:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ec2c1f55-a7a6-4e7d-b03d-54b4e01fdf45 tempest-AttachVolumeTestJSON-886512989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:24:16 devstack sudo[95674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:24:16 devstack sudo[95674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:24:16 devstack sudo[95674]: pam_unix(sudo:session): session closed for user root Jul 16 23:24:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ec2c1f55-a7a6-4e7d-b03d-54b4e01fdf45 tempest-AttachVolumeTestJSON-886512989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.299s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:24:16 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-ec2c1f55-a7a6-4e7d-b03d-54b4e01fdf45 tempest-AttachVolumeTestJSON-886512989 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:24:16 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-ec2c1f55-a7a6-4e7d-b03d-54b4e01fdf45 tempest-AttachVolumeTestJSON-886512989 None] Deleted volume successfully. Jul 16 23:24:16 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ec2c1f55-a7a6-4e7d-b03d-54b4e01fdf45 tempest-AttachVolumeTestJSON-886512989 None] Lock "cinder-70b02aa0-e8ae-4aaa-bb47-d48c7f3eb9c7-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:24:24 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-997b4f37-2e9c-4153-9f5e-061a0c224180 tempest-SnapshotsActionsTest-1472833697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:24:24 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-997b4f37-2e9c-4153-9f5e-061a0c224180 tempest-SnapshotsActionsTest-1472833697 None] Flow 'volume_create_manager' (0cf49e44-5f04-4451-adc4-005d91a2c7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:24:24 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-997b4f37-2e9c-4153-9f5e-061a0c224180 tempest-SnapshotsActionsTest-1472833697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (964b6aa0-c640-4b98-a9ff-be126ac3f38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:24:24 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-997b4f37-2e9c-4153-9f5e-061a0c224180 tempest-SnapshotsActionsTest-1472833697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (964b6aa0-c640-4b98-a9ff-be126ac3f38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1183736596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b027d3-aecd-4c9d-918c-533f835c7b3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='861a8d25c1f44d14bf29a1694b270b8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:24:25Z,use_quota=True,user_id='4dbe2c5ee86a4257868eaa9abe049313',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:24:24 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-997b4f37-2e9c-4153-9f5e-061a0c224180 tempest-SnapshotsActionsTest-1472833697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68472100-dc5f-4f52-947c-8cb5ddfbc174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:24:24 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-997b4f37-2e9c-4153-9f5e-061a0c224180 tempest-SnapshotsActionsTest-1472833697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68472100-dc5f-4f52-947c-8cb5ddfbc174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:24:24 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-997b4f37-2e9c-4153-9f5e-061a0c224180 tempest-SnapshotsActionsTest-1472833697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae1037b-3e32-4a01-92c3-bb3e74197a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:24:24 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-997b4f37-2e9c-4153-9f5e-061a0c224180 tempest-SnapshotsActionsTest-1472833697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae1037b-3e32-4a01-92c3-bb3e74197a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72b027d3-aecd-4c9d-918c-533f835c7b3e', 'volume_name': 'volume-72b027d3-aecd-4c9d-918c-533f835c7b3e', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:24:24 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-997b4f37-2e9c-4153-9f5e-061a0c224180 tempest-SnapshotsActionsTest-1472833697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b05b3f61-baf9-4d22-96c5-397f2b35a722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:24:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-997b4f37-2e9c-4153-9f5e-061a0c224180 tempest-SnapshotsActionsTest-1472833697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b05b3f61-baf9-4d22-96c5-397f2b35a722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:24:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-997b4f37-2e9c-4153-9f5e-061a0c224180 tempest-SnapshotsActionsTest-1472833697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (974a921f-3836-470c-a75a-47d9c3cf4346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:24:25 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-997b4f37-2e9c-4153-9f5e-061a0c224180 tempest-SnapshotsActionsTest-1472833697 None] Volume 72b027d3-aecd-4c9d-918c-533f835c7b3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72b027d3-aecd-4c9d-918c-533f835c7b3e', 'volume_size': 1} Jul 16 23:24:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-997b4f37-2e9c-4153-9f5e-061a0c224180 tempest-SnapshotsActionsTest-1472833697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:24:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-997b4f37-2e9c-4153-9f5e-061a0c224180 tempest-SnapshotsActionsTest-1472833697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:24:25 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-997b4f37-2e9c-4153-9f5e-061a0c224180 tempest-SnapshotsActionsTest-1472833697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1183736596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b027d3-aecd-4c9d-918c-533f835c7b3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='861a8d25c1f44d14bf29a1694b270b8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:24:25Z,use_quota=True,user_id='4dbe2c5ee86a4257868eaa9abe049313',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:24:25 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-997b4f37-2e9c-4153-9f5e-061a0c224180 tempest-SnapshotsActionsTest-1472833697 None] Creating volume 72b027d3-aecd-4c9d-918c-533f835c7b3e {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:24:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-997b4f37-2e9c-4153-9f5e-061a0c224180 tempest-SnapshotsActionsTest-1472833697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:24:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-997b4f37-2e9c-4153-9f5e-061a0c224180 tempest-SnapshotsActionsTest-1472833697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:24:25 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-997b4f37-2e9c-4153-9f5e-061a0c224180 tempest-SnapshotsActionsTest-1472833697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:24:25 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-997b4f37-2e9c-4153-9f5e-061a0c224180 tempest-SnapshotsActionsTest-1472833697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:24:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-997b4f37-2e9c-4153-9f5e-061a0c224180 tempest-SnapshotsActionsTest-1472833697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:24:25 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-997b4f37-2e9c-4153-9f5e-061a0c224180 tempest-SnapshotsActionsTest-1472833697 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:24:25 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-997b4f37-2e9c-4153-9f5e-061a0c224180 tempest-SnapshotsActionsTest-1472833697 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:24:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-997b4f37-2e9c-4153-9f5e-061a0c224180 tempest-SnapshotsActionsTest-1472833697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:24:25 devstack sudo[95702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e 1073741824 Jul 16 23:24:25 devstack sudo[95702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:24:25 devstack sudo[95702]: pam_unix(sudo:session): session closed for user root Jul 16 23:24:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-997b4f37-2e9c-4153-9f5e-061a0c224180 tempest-SnapshotsActionsTest-1472833697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e 1073741824" returned: 0 in 0.569s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:24:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-997b4f37-2e9c-4153-9f5e-061a0c224180 tempest-SnapshotsActionsTest-1472833697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:24:25 devstack sudo[95708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e Jul 16 23:24:25 devstack sudo[95708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:24:25 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a30c87-b03d-4b91-8c3d-55be420a87bd tempest-TestStampPattern-699542814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:24:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-17a30c87-b03d-4b91-8c3d-55be420a87bd tempest-TestStampPattern-699542814 None] Flow 'volume_create_manager' (3b40e448-95e3-4bb6-9efa-89c66204da0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:24:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-17a30c87-b03d-4b91-8c3d-55be420a87bd tempest-TestStampPattern-699542814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2c0411f-636b-43e0-8767-80b5ac3fcbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:24:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-17a30c87-b03d-4b91-8c3d-55be420a87bd tempest-TestStampPattern-699542814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2c0411f-636b-43e0-8767-80b5ac3fcbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1988814044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2a74ad6-9996-4227-936e-f93dcce122a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4018fa749d0459b8ccced22c123bcb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:24:26Z,use_quota=True,user_id='d0b94e0d8df14fc1ae9945508d99870d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:24:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-17a30c87-b03d-4b91-8c3d-55be420a87bd tempest-TestStampPattern-699542814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5934c6b-89ae-4c2e-bd38-251858c07917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:24:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-17a30c87-b03d-4b91-8c3d-55be420a87bd tempest-TestStampPattern-699542814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5934c6b-89ae-4c2e-bd38-251858c07917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:24:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-17a30c87-b03d-4b91-8c3d-55be420a87bd tempest-TestStampPattern-699542814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51741538-9a39-4eb1-b620-682e427b2936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:24:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-17a30c87-b03d-4b91-8c3d-55be420a87bd tempest-TestStampPattern-699542814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51741538-9a39-4eb1-b620-682e427b2936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2a74ad6-9996-4227-936e-f93dcce122a7', 'volume_name': 'volume-d2a74ad6-9996-4227-936e-f93dcce122a7', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:24:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-17a30c87-b03d-4b91-8c3d-55be420a87bd tempest-TestStampPattern-699542814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f621a9b-8693-4a83-945d-6c9b0956d8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:24:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-17a30c87-b03d-4b91-8c3d-55be420a87bd tempest-TestStampPattern-699542814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f621a9b-8693-4a83-945d-6c9b0956d8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:24:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-17a30c87-b03d-4b91-8c3d-55be420a87bd tempest-TestStampPattern-699542814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4981b050-5409-4f01-b026-72602b2e2dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:24:25 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-17a30c87-b03d-4b91-8c3d-55be420a87bd tempest-TestStampPattern-699542814 None] Volume d2a74ad6-9996-4227-936e-f93dcce122a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2a74ad6-9996-4227-936e-f93dcce122a7', 'volume_size': 1} Jul 16 23:24:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-17a30c87-b03d-4b91-8c3d-55be420a87bd tempest-TestStampPattern-699542814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:24:26 devstack sudo[95708]: pam_unix(sudo:session): session closed for user root Jul 16 23:24:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-997b4f37-2e9c-4153-9f5e-061a0c224180 tempest-SnapshotsActionsTest-1472833697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e" returned: 0 in 0.444s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:24:26 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-997b4f37-2e9c-4153-9f5e-061a0c224180 tempest-SnapshotsActionsTest-1472833697 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:24:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-997b4f37-2e9c-4153-9f5e-061a0c224180 tempest-SnapshotsActionsTest-1472833697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:24:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-17a30c87-b03d-4b91-8c3d-55be420a87bd tempest-TestStampPattern-699542814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.122s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:24:26 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-17a30c87-b03d-4b91-8c3d-55be420a87bd tempest-TestStampPattern-699542814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1988814044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2a74ad6-9996-4227-936e-f93dcce122a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4018fa749d0459b8ccced22c123bcb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:24:26Z,use_quota=True,user_id='d0b94e0d8df14fc1ae9945508d99870d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:24:26 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-17a30c87-b03d-4b91-8c3d-55be420a87bd tempest-TestStampPattern-699542814 None] Creating volume d2a74ad6-9996-4227-936e-f93dcce122a7 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:24:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-17a30c87-b03d-4b91-8c3d-55be420a87bd tempest-TestStampPattern-699542814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:24:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-17a30c87-b03d-4b91-8c3d-55be420a87bd tempest-TestStampPattern-699542814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:24:26 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-17a30c87-b03d-4b91-8c3d-55be420a87bd tempest-TestStampPattern-699542814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:24:26 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-17a30c87-b03d-4b91-8c3d-55be420a87bd tempest-TestStampPattern-699542814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:24:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-17a30c87-b03d-4b91-8c3d-55be420a87bd tempest-TestStampPattern-699542814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:24:26 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-17a30c87-b03d-4b91-8c3d-55be420a87bd tempest-TestStampPattern-699542814 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:24:26 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-17a30c87-b03d-4b91-8c3d-55be420a87bd tempest-TestStampPattern-699542814 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:24:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-17a30c87-b03d-4b91-8c3d-55be420a87bd tempest-TestStampPattern-699542814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:24:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-997b4f37-2e9c-4153-9f5e-061a0c224180 tempest-SnapshotsActionsTest-1472833697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (974a921f-3836-470c-a75a-47d9c3cf4346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72b027d3-aecd-4c9d-918c-533f835c7b3e', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:24:26 devstack sudo[95711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7 1073741824 Jul 16 23:24:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-997b4f37-2e9c-4153-9f5e-061a0c224180 tempest-SnapshotsActionsTest-1472833697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adc86522-b1e4-4275-9047-6867ea9b58f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:24:26 devstack sudo[95711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:24:26 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-997b4f37-2e9c-4153-9f5e-061a0c224180 tempest-SnapshotsActionsTest-1472833697 None] Volume volume-72b027d3-aecd-4c9d-918c-533f835c7b3e (72b027d3-aecd-4c9d-918c-533f835c7b3e): created successfully Jul 16 23:24:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-997b4f37-2e9c-4153-9f5e-061a0c224180 tempest-SnapshotsActionsTest-1472833697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adc86522-b1e4-4275-9047-6867ea9b58f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:24:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-997b4f37-2e9c-4153-9f5e-061a0c224180 tempest-SnapshotsActionsTest-1472833697 None] Flow 'volume_create_manager' (0cf49e44-5f04-4451-adc4-005d91a2c7f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:24:26 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-997b4f37-2e9c-4153-9f5e-061a0c224180 tempest-SnapshotsActionsTest-1472833697 None] Created volume successfully. Jul 16 23:24:26 devstack sudo[95711]: pam_unix(sudo:session): session closed for user root Jul 16 23:24:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-17a30c87-b03d-4b91-8c3d-55be420a87bd tempest-TestStampPattern-699542814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7 1073741824" returned: 0 in 0.645s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:24:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-17a30c87-b03d-4b91-8c3d-55be420a87bd tempest-TestStampPattern-699542814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:24:26 devstack sudo[95718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7 Jul 16 23:24:26 devstack sudo[95718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:24:27 devstack sudo[95718]: pam_unix(sudo:session): session closed for user root Jul 16 23:24:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-17a30c87-b03d-4b91-8c3d-55be420a87bd tempest-TestStampPattern-699542814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7" returned: 0 in 0.607s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:24:27 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-17a30c87-b03d-4b91-8c3d-55be420a87bd tempest-TestStampPattern-699542814 None] <== create_volume: return (1312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:24:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-17a30c87-b03d-4b91-8c3d-55be420a87bd tempest-TestStampPattern-699542814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:24:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-17a30c87-b03d-4b91-8c3d-55be420a87bd tempest-TestStampPattern-699542814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4981b050-5409-4f01-b026-72602b2e2dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2a74ad6-9996-4227-936e-f93dcce122a7', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:24:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-17a30c87-b03d-4b91-8c3d-55be420a87bd tempest-TestStampPattern-699542814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2216af24-17e4-4158-94ef-bfc8554a03d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:24:27 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-17a30c87-b03d-4b91-8c3d-55be420a87bd tempest-TestStampPattern-699542814 None] Volume volume-d2a74ad6-9996-4227-936e-f93dcce122a7 (d2a74ad6-9996-4227-936e-f93dcce122a7): created successfully Jul 16 23:24:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-17a30c87-b03d-4b91-8c3d-55be420a87bd tempest-TestStampPattern-699542814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2216af24-17e4-4158-94ef-bfc8554a03d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:24:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-17a30c87-b03d-4b91-8c3d-55be420a87bd tempest-TestStampPattern-699542814 None] Flow 'volume_create_manager' (3b40e448-95e3-4bb6-9efa-89c66204da0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:24:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b2b815b0-3235-4d3b-a8a8-dc07d56b6567 tempest-SnapshotsActionsTest-1472833697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:24:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b2b815b0-3235-4d3b-a8a8-dc07d56b6567 tempest-SnapshotsActionsTest-1472833697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:24:27 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-17a30c87-b03d-4b91-8c3d-55be420a87bd tempest-TestStampPattern-699542814 None] Created volume successfully. Jul 16 23:24:27 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-b2b815b0-3235-4d3b-a8a8-dc07d56b6567 tempest-SnapshotsActionsTest-1472833697 None] Creating offline snapshot d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee of volume 72b027d3-aecd-4c9d-918c-533f835c7b3e {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:24:27 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[c472d84c-4425-4984-8437-315ff8945ef3]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:24:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b2b815b0-3235-4d3b-a8a8-dc07d56b6567 tempest-SnapshotsActionsTest-1472833697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:24:27 devstack sudo[95773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e Jul 16 23:24:27 devstack sudo[95773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:24:28 devstack sudo[95773]: pam_unix(sudo:session): session closed for user root Jul 16 23:24:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b2b815b0-3235-4d3b-a8a8-dc07d56b6567 tempest-SnapshotsActionsTest-1472833697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e" returned: 0 in 1.087s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:24:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b2b815b0-3235-4d3b-a8a8-dc07d56b6567 tempest-SnapshotsActionsTest-1472833697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:24:28 devstack sudo[95800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee 1G Jul 16 23:24:28 devstack sudo[95800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:24:29 devstack sudo[95800]: pam_unix(sudo:session): session closed for user root Jul 16 23:24:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b2b815b0-3235-4d3b-a8a8-dc07d56b6567 tempest-SnapshotsActionsTest-1472833697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee 1G" returned: 0 in 0.833s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:24:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b2b815b0-3235-4d3b-a8a8-dc07d56b6567 tempest-SnapshotsActionsTest-1472833697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b027d3-aecd-4c9d-918c-533f835c7b3e -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:24:29 devstack sudo[95809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b027d3-aecd-4c9d-918c-533f835c7b3e -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee Jul 16 23:24:29 devstack sudo[95809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:24:30 devstack sudo[95809]: pam_unix(sudo:session): session closed for user root Jul 16 23:24:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b2b815b0-3235-4d3b-a8a8-dc07d56b6567 tempest-SnapshotsActionsTest-1472833697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b027d3-aecd-4c9d-918c-533f835c7b3e -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee" returned: 0 in 0.675s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:24:30 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-b2b815b0-3235-4d3b-a8a8-dc07d56b6567 tempest-SnapshotsActionsTest-1472833697 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee is being set with open permissions: ugo+rw Jul 16 23:24:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b2b815b0-3235-4d3b-a8a8-dc07d56b6567 tempest-SnapshotsActionsTest-1472833697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:24:30 devstack sudo[95818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee Jul 16 23:24:30 devstack sudo[95818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:24:30 devstack sudo[95818]: pam_unix(sudo:session): session closed for user root Jul 16 23:24:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b2b815b0-3235-4d3b-a8a8-dc07d56b6567 tempest-SnapshotsActionsTest-1472833697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee" returned: 0 in 0.542s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:24:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b2b815b0-3235-4d3b-a8a8-dc07d56b6567 tempest-SnapshotsActionsTest-1472833697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:24:30 devstack sudo[95825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.info Jul 16 23:24:30 devstack sudo[95825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:24:31 devstack sudo[95825]: pam_unix(sudo:session): session closed for user root Jul 16 23:24:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b2b815b0-3235-4d3b-a8a8-dc07d56b6567 tempest-SnapshotsActionsTest-1472833697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.info" returned: 0 in 0.600s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:24:31 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-b2b815b0-3235-4d3b-a8a8-dc07d56b6567 tempest-SnapshotsActionsTest-1472833697 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.info is being set with open permissions: ugo+rw Jul 16 23:24:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b2b815b0-3235-4d3b-a8a8-dc07d56b6567 tempest-SnapshotsActionsTest-1472833697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:24:31 devstack sudo[95840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.info Jul 16 23:24:31 devstack sudo[95840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:24:31 devstack sudo[95840]: pam_unix(sudo:session): session closed for user root Jul 16 23:24:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b2b815b0-3235-4d3b-a8a8-dc07d56b6567 tempest-SnapshotsActionsTest-1472833697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.info" returned: 0 in 0.416s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:24:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b2b815b0-3235-4d3b-a8a8-dc07d56b6567 tempest-SnapshotsActionsTest-1472833697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.361s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:24:32 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-b2b815b0-3235-4d3b-a8a8-dc07d56b6567 tempest-SnapshotsActionsTest-1472833697 None] Create snapshot completed successfully Jul 16 23:24:32 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-982f09cf-6cfa-4304-8bf7-79e1a5133326 tempest-VolumesActionsTest-219677645 None] Acquiring lock "cinder-a6a07455-2676-48ae-ae86-d92b5c2f672c" by "attach_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:24:32 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-982f09cf-6cfa-4304-8bf7-79e1a5133326 tempest-VolumesActionsTest-219677645 None] Lock "cinder-a6a07455-2676-48ae-ae86-d92b5c2f672c" acquired by "attach_volume" :: waited 0.026s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:24:32 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-982f09cf-6cfa-4304-8bf7-79e1a5133326 tempest-VolumesActionsTest-219677645 None] Attaching volume a6a07455-2676-48ae-ae86-d92b5c2f672c to instance 387b278f-b3c7-4b2e-bf17-a92d2e0c7293 at mountpoint /dev/vdb on host None. Jul 16 23:24:32 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-982f09cf-6cfa-4304-8bf7-79e1a5133326 tempest-VolumesActionsTest-219677645 None] Attach volume completed successfully. Jul 16 23:24:32 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-982f09cf-6cfa-4304-8bf7-79e1a5133326 tempest-VolumesActionsTest-219677645 None] Lock "cinder-a6a07455-2676-48ae-ae86-d92b5c2f672c" released by "attach_volume" :: held 0.134s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:24:32 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4b236134-2175-4905-9ca0-96d336b7b109 tempest-VolumesActionsTest-219677645 None] Acquiring lock "cinder-a6a07455-2676-48ae-ae86-d92b5c2f672c-detach_volume" by "detach_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:24:32 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4b236134-2175-4905-9ca0-96d336b7b109 tempest-VolumesActionsTest-219677645 None] Lock "cinder-a6a07455-2676-48ae-ae86-d92b5c2f672c-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:24:32 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-4b236134-2175-4905-9ca0-96d336b7b109 tempest-VolumesActionsTest-219677645 None] Detaching volume a6a07455-2676-48ae-ae86-d92b5c2f672c from instance 387b278f-b3c7-4b2e-bf17-a92d2e0c7293. Jul 16 23:24:32 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-4b236134-2175-4905-9ca0-96d336b7b109 tempest-VolumesActionsTest-219677645 None] Detach volume completed successfully. Jul 16 23:24:32 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4b236134-2175-4905-9ca0-96d336b7b109 tempest-VolumesActionsTest-219677645 None] Lock "cinder-a6a07455-2676-48ae-ae86-d92b5c2f672c-detach_volume" released by "detach_volume" :: held 0.156s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:24:34 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-79eec175-ceed-4365-82bf-9f7b39bd1121 tempest-SnapshotsActionsTest-1472833697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:24:34 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-79eec175-ceed-4365-82bf-9f7b39bd1121 tempest-SnapshotsActionsTest-1472833697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:24:34 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-79eec175-ceed-4365-82bf-9f7b39bd1121 tempest-SnapshotsActionsTest-1472833697 None] Creating offline snapshot 97095302-0ba5-4cc0-886d-512c062de85d of volume 72b027d3-aecd-4c9d-918c-533f835c7b3e {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:24:34 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[91694cee-b536-4337-bb1e-4e1e812a4efc]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:24:34 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-79eec175-ceed-4365-82bf-9f7b39bd1121 tempest-SnapshotsActionsTest-1472833697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:24:34 devstack sudo[95903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee Jul 16 23:24:34 devstack sudo[95903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:24:34 devstack sudo[95903]: pam_unix(sudo:session): session closed for user root Jul 16 23:24:34 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-79eec175-ceed-4365-82bf-9f7b39bd1121 tempest-SnapshotsActionsTest-1472833697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee" returned: 0 in 0.414s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:24:34 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-79eec175-ceed-4365-82bf-9f7b39bd1121 tempest-SnapshotsActionsTest-1472833697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b027d3-aecd-4c9d-918c-533f835c7b3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:24:34 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-79eec175-ceed-4365-82bf-9f7b39bd1121 tempest-SnapshotsActionsTest-1472833697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.97095302-0ba5-4cc0-886d-512c062de85d 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:24:34 devstack sudo[95909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.97095302-0ba5-4cc0-886d-512c062de85d 1G Jul 16 23:24:34 devstack sudo[95909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:24:35 devstack sudo[95909]: pam_unix(sudo:session): session closed for user root Jul 16 23:24:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-79eec175-ceed-4365-82bf-9f7b39bd1121 tempest-SnapshotsActionsTest-1472833697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.97095302-0ba5-4cc0-886d-512c062de85d 1G" returned: 0 in 0.531s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:24:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-79eec175-ceed-4365-82bf-9f7b39bd1121 tempest-SnapshotsActionsTest-1472833697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.97095302-0ba5-4cc0-886d-512c062de85d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:24:35 devstack sudo[95917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.97095302-0ba5-4cc0-886d-512c062de85d Jul 16 23:24:35 devstack sudo[95917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:24:35 devstack sudo[95917]: pam_unix(sudo:session): session closed for user root Jul 16 23:24:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-79eec175-ceed-4365-82bf-9f7b39bd1121 tempest-SnapshotsActionsTest-1472833697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.97095302-0ba5-4cc0-886d-512c062de85d" returned: 0 in 0.404s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:24:35 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-79eec175-ceed-4365-82bf-9f7b39bd1121 tempest-SnapshotsActionsTest-1472833697 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.97095302-0ba5-4cc0-886d-512c062de85d is being set with open permissions: ugo+rw Jul 16 23:24:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-79eec175-ceed-4365-82bf-9f7b39bd1121 tempest-SnapshotsActionsTest-1472833697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.97095302-0ba5-4cc0-886d-512c062de85d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:24:35 devstack sudo[95924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.97095302-0ba5-4cc0-886d-512c062de85d Jul 16 23:24:35 devstack sudo[95924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:24:36 devstack sudo[95924]: pam_unix(sudo:session): session closed for user root Jul 16 23:24:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-79eec175-ceed-4365-82bf-9f7b39bd1121 tempest-SnapshotsActionsTest-1472833697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.97095302-0ba5-4cc0-886d-512c062de85d" returned: 0 in 0.488s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:24:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-79eec175-ceed-4365-82bf-9f7b39bd1121 tempest-SnapshotsActionsTest-1472833697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.011s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:24:36 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-79eec175-ceed-4365-82bf-9f7b39bd1121 tempest-SnapshotsActionsTest-1472833697 None] Create snapshot completed successfully Jul 16 23:24:37 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f18f3539-d868-45dc-8ed1-4a3765f71fe9 tempest-SnapshotsActionsTest-1653615379 None] Acquiring lock "cinder-97095302-0ba5-4cc0-886d-512c062de85d-delete_snapshot" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:24:37 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f18f3539-d868-45dc-8ed1-4a3765f71fe9 tempest-SnapshotsActionsTest-1653615379 None] Lock "cinder-97095302-0ba5-4cc0-886d-512c062de85d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:24:37 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f18f3539-d868-45dc-8ed1-4a3765f71fe9 tempest-SnapshotsActionsTest-1653615379 None] Acquiring lock "cinder-quobyte-72b027d3-aecd-4c9d-918c-533f835c7b3e" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:24:38 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f18f3539-d868-45dc-8ed1-4a3765f71fe9 tempest-SnapshotsActionsTest-1653615379 None] Lock "cinder-quobyte-72b027d3-aecd-4c9d-918c-533f835c7b3e" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:24:38 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f18f3539-d868-45dc-8ed1-4a3765f71fe9 tempest-SnapshotsActionsTest-1653615379 None] Acquiring lock "cinder-quobyte-97095302-0ba5-4cc0-886d-512c062de85d" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:24:38 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f18f3539-d868-45dc-8ed1-4a3765f71fe9 tempest-SnapshotsActionsTest-1653615379 None] Lock "cinder-quobyte-97095302-0ba5-4cc0-886d-512c062de85d" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:24:38 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-f18f3539-d868-45dc-8ed1-4a3765f71fe9 tempest-SnapshotsActionsTest-1653615379 None] Deleting offline snapshot 97095302-0ba5-4cc0-886d-512c062de85d of volume 72b027d3-aecd-4c9d-918c-533f835c7b3e {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:24:38 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-f18f3539-d868-45dc-8ed1-4a3765f71fe9 tempest-SnapshotsActionsTest-1653615379 None] snapshot_file for this snap is: volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.97095302-0ba5-4cc0-886d-512c062de85d {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:24:38 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51fa9c0-c163-4f7e-8326-dfc5724fe123]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:24:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f18f3539-d868-45dc-8ed1-4a3765f71fe9 tempest-SnapshotsActionsTest-1653615379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.97095302-0ba5-4cc0-886d-512c062de85d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:24:38 devstack sudo[95990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.97095302-0ba5-4cc0-886d-512c062de85d Jul 16 23:24:38 devstack sudo[95990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:24:38 devstack sudo[95990]: pam_unix(sudo:session): session closed for user root Jul 16 23:24:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f18f3539-d868-45dc-8ed1-4a3765f71fe9 tempest-SnapshotsActionsTest-1653615379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.97095302-0ba5-4cc0-886d-512c062de85d" returned: 0 in 0.454s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:24:38 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-f18f3539-d868-45dc-8ed1-4a3765f71fe9 tempest-SnapshotsActionsTest-1653615379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b027d3-aecd-4c9d-918c-533f835c7b3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:24:38 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5fbad40-a920-4623-a3d4-28ab399cabbc]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:24:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f18f3539-d868-45dc-8ed1-4a3765f71fe9 tempest-SnapshotsActionsTest-1653615379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:24:38 devstack sudo[95996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee Jul 16 23:24:38 devstack sudo[95996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:24:39 devstack sudo[95996]: pam_unix(sudo:session): session closed for user root Jul 16 23:24:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f18f3539-d868-45dc-8ed1-4a3765f71fe9 tempest-SnapshotsActionsTest-1653615379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee" returned: 0 in 0.483s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:24:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-f18f3539-d868-45dc-8ed1-4a3765f71fe9 tempest-SnapshotsActionsTest-1653615379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b027d3-aecd-4c9d-918c-533f835c7b3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:24:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f18f3539-d868-45dc-8ed1-4a3765f71fe9 tempest-SnapshotsActionsTest-1653615379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.97095302-0ba5-4cc0-886d-512c062de85d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:24:39 devstack sudo[96001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.97095302-0ba5-4cc0-886d-512c062de85d Jul 16 23:24:39 devstack sudo[96001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:24:39 devstack cinder-volume[87607]: DEBUG oslo_service.periodic_task [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:24:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:24:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:24:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:24:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:24:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:24:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:24:39 devstack sudo[96006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:24:39 devstack sudo[96006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:24:39 devstack sudo[96001]: pam_unix(sudo:session): session closed for user root Jul 16 23:24:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f18f3539-d868-45dc-8ed1-4a3765f71fe9 tempest-SnapshotsActionsTest-1653615379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.97095302-0ba5-4cc0-886d-512c062de85d" returned: 0 in 0.558s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:24:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f18f3539-d868-45dc-8ed1-4a3765f71fe9 tempest-SnapshotsActionsTest-1653615379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.97095302-0ba5-4cc0-886d-512c062de85d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:24:39 devstack sudo[96008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.97095302-0ba5-4cc0-886d-512c062de85d Jul 16 23:24:39 devstack sudo[96008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:24:39 devstack sudo[96006]: pam_unix(sudo:session): session closed for user root Jul 16 23:24:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.397s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:24:39 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:24:39 devstack cinder-volume[87607]: DEBUG oslo_service.periodic_task [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running periodic task VolumeManager._thread_info {{(pid=87607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:24:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] thread count: 8 {{(pid=87607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 23:24:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] thread info: [<_MainThread(MainThread, started 139090403627136)>, , , , , , , ] {{(pid=87607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 23:24:39 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:SELECT=100,cinder:UPDATE=114,cinder:DELETE=11,cinder:INSERT=26 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:24:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-919f1d08-39a0-49ad-a62d-160cc4c72c28 tempest-VolumesActionsTest-219677645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:24:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-919f1d08-39a0-49ad-a62d-160cc4c72c28 tempest-VolumesActionsTest-219677645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:24:39 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[32839415-9394-4113-8a47-e59349de2c41]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:24:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-919f1d08-39a0-49ad-a62d-160cc4c72c28 tempest-VolumesActionsTest-219677645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a6a07455-2676-48ae-ae86-d92b5c2f672c {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:24:40 devstack sudo[96011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a6a07455-2676-48ae-ae86-d92b5c2f672c Jul 16 23:24:40 devstack sudo[96011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:24:40 devstack sudo[96008]: pam_unix(sudo:session): session closed for user root Jul 16 23:24:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f18f3539-d868-45dc-8ed1-4a3765f71fe9 tempest-SnapshotsActionsTest-1653615379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.97095302-0ba5-4cc0-886d-512c062de85d" returned: 0 in 0.470s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:24:40 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f18f3539-d868-45dc-8ed1-4a3765f71fe9 tempest-SnapshotsActionsTest-1653615379 None] Lock "cinder-quobyte-97095302-0ba5-4cc0-886d-512c062de85d" released by "_delete_snapshot" :: held 2.153s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:24:40 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f18f3539-d868-45dc-8ed1-4a3765f71fe9 tempest-SnapshotsActionsTest-1653615379 None] Lock "cinder-quobyte-72b027d3-aecd-4c9d-918c-533f835c7b3e" released by "delete_snapshot" :: held 2.208s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:24:40 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:UPDATE=117,cinder:SELECT=122,cinder:INSERT=23,cinder:DELETE=5 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:24:40 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-f18f3539-d868-45dc-8ed1-4a3765f71fe9 tempest-SnapshotsActionsTest-1653615379 None] Created reservations ['c8c6e85b-db90-4343-9925-45059c5b6dcf', '56ac4a4a-9555-4682-8023-7b50547b6453', '62305733-7530-4373-bbd2-75702df93583', 'a5cd1eaa-cd9d-4299-8478-07c89aff2df1'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:24:40 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-f18f3539-d868-45dc-8ed1-4a3765f71fe9 tempest-SnapshotsActionsTest-1653615379 None] Delete snapshot completed successfully. Jul 16 23:24:40 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f18f3539-d868-45dc-8ed1-4a3765f71fe9 tempest-SnapshotsActionsTest-1653615379 None] Lock "cinder-97095302-0ba5-4cc0-886d-512c062de85d-delete_snapshot" released by "delete_snapshot" :: held 2.422s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:24:40 devstack sudo[96011]: pam_unix(sudo:session): session closed for user root Jul 16 23:24:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-919f1d08-39a0-49ad-a62d-160cc4c72c28 tempest-VolumesActionsTest-219677645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a6a07455-2676-48ae-ae86-d92b5c2f672c" returned: 0 in 0.453s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:24:40 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59d8ad9-ff09-4f49-9df6-0d873c86ed9f]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:24:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-919f1d08-39a0-49ad-a62d-160cc4c72c28 tempest-VolumesActionsTest-219677645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a6a07455-2676-48ae-ae86-d92b5c2f672c {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:24:40 devstack sudo[96017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a6a07455-2676-48ae-ae86-d92b5c2f672c Jul 16 23:24:40 devstack sudo[96017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:24:41 devstack sudo[96017]: pam_unix(sudo:session): session closed for user root Jul 16 23:24:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-919f1d08-39a0-49ad-a62d-160cc4c72c28 tempest-VolumesActionsTest-219677645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a6a07455-2676-48ae-ae86-d92b5c2f672c" returned: 0 in 0.869s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:24:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-919f1d08-39a0-49ad-a62d-160cc4c72c28 tempest-VolumesActionsTest-219677645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a6a07455-2676-48ae-ae86-d92b5c2f672c /opt/stack/data/cinder/conversion/a6a07455-2676-48ae-ae86-d92b5c2f672c.temp_image.20c8f835-bcac-44ab-b24c-3b522081af4191p5mqzo.img {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:24:41 devstack sudo[96025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a6a07455-2676-48ae-ae86-d92b5c2f672c /opt/stack/data/cinder/conversion/a6a07455-2676-48ae-ae86-d92b5c2f672c.temp_image.20c8f835-bcac-44ab-b24c-3b522081af4191p5mqzo.img Jul 16 23:24:41 devstack sudo[96025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:24:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-fcfde2d2-6840-4516-b15d-82b7fc5eb9b9 tempest-SnapshotsActionsTest-1472833697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:24:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-919f1d08-39a0-49ad-a62d-160cc4c72c28 tempest-VolumesActionsTest-219677645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a6a07455-2676-48ae-ae86-d92b5c2f672c /opt/stack/data/cinder/conversion/a6a07455-2676-48ae-ae86-d92b5c2f672c.temp_image.20c8f835-bcac-44ab-b24c-3b522081af4191p5mqzo.img" returned: 0 in 7.385s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:24:48 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[915a63d5-78a1-4976-971d-45b751d48d86]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:24:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-919f1d08-39a0-49ad-a62d-160cc4c72c28 tempest-VolumesActionsTest-219677645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a6a07455-2676-48ae-ae86-d92b5c2f672c {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:24:48 devstack sudo[96042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a6a07455-2676-48ae-ae86-d92b5c2f672c Jul 16 23:24:48 devstack sudo[96042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:24:49 devstack sudo[96042]: pam_unix(sudo:session): session closed for user root Jul 16 23:24:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-919f1d08-39a0-49ad-a62d-160cc4c72c28 tempest-VolumesActionsTest-219677645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a6a07455-2676-48ae-ae86-d92b5c2f672c" returned: 0 in 0.658s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:24:49 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-919f1d08-39a0-49ad-a62d-160cc4c72c28 tempest-VolumesActionsTest-219677645 None] Image conversion details: src /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a6a07455-2676-48ae-ae86-d92b5c2f672c, size 1024.00 MB, duration 7.39 sec, destination /opt/stack/data/cinder/conversion/a6a07455-2676-48ae-ae86-d92b5c2f672c.temp_image.20c8f835-bcac-44ab-b24c-3b522081af4191p5mqzo.img {{(pid=87607) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 23:24:49 devstack cinder-volume[87607]: INFO cinder.image.image_utils [None req-919f1d08-39a0-49ad-a62d-160cc4c72c28 tempest-VolumesActionsTest-219677645 None] Converted 1024.00 MB image at 138.53 MB/s Jul 16 23:24:49 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-919f1d08-39a0-49ad-a62d-160cc4c72c28 tempest-VolumesActionsTest-219677645 None] 20c8f835-bcac-44ab-b24c-3b522081af41 was raw, no need to convert to raw {{(pid=87607) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 16 23:25:02 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=5 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:25:02 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:25:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-fe721285-a26b-4f26-aab7-d33645882586 req-f12ae3c2-2038-4b32-bcce-08d6867feeab tempest-TestStampPattern-699542814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:25:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-919f1d08-39a0-49ad-a62d-160cc4c72c28 tempest-VolumesActionsTest-219677645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 33.580s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:25:13 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-919f1d08-39a0-49ad-a62d-160cc4c72c28 tempest-VolumesActionsTest-219677645 None] Uploaded volume to glance image-id: 20c8f835-bcac-44ab-b24c-3b522081af41. {{(pid=87607) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 16 23:25:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-fcfde2d2-6840-4516-b15d-82b7fc5eb9b9 tempest-SnapshotsActionsTest-1472833697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 31.604s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:25:13 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-fcfde2d2-6840-4516-b15d-82b7fc5eb9b9 tempest-SnapshotsActionsTest-1472833697 None] Creating offline snapshot ed42ff39-7e0b-4a9b-bff0-5262ffd8b6cd of volume 72b027d3-aecd-4c9d-918c-533f835c7b3e {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:25:13 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-919f1d08-39a0-49ad-a62d-160cc4c72c28 tempest-VolumesActionsTest-219677645 None] Copy volume to image completed successfully. Jul 16 23:25:13 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7e4005-c098-42f7-b423-912a6cec22a6]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:25:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fcfde2d2-6840-4516-b15d-82b7fc5eb9b9 tempest-SnapshotsActionsTest-1472833697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:13 devstack sudo[96571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee Jul 16 23:25:13 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:14 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fcfde2d2-6840-4516-b15d-82b7fc5eb9b9 tempest-SnapshotsActionsTest-1472833697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee" returned: 0 in 0.410s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:14 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-fcfde2d2-6840-4516-b15d-82b7fc5eb9b9 tempest-SnapshotsActionsTest-1472833697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b027d3-aecd-4c9d-918c-533f835c7b3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:25:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fcfde2d2-6840-4516-b15d-82b7fc5eb9b9 tempest-SnapshotsActionsTest-1472833697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.ed42ff39-7e0b-4a9b-bff0-5262ffd8b6cd 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:14 devstack sudo[96576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.ed42ff39-7e0b-4a9b-bff0-5262ffd8b6cd 1G Jul 16 23:25:14 devstack sudo[96576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:14 devstack sudo[96576]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fcfde2d2-6840-4516-b15d-82b7fc5eb9b9 tempest-SnapshotsActionsTest-1472833697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.ed42ff39-7e0b-4a9b-bff0-5262ffd8b6cd 1G" returned: 0 in 0.476s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fcfde2d2-6840-4516-b15d-82b7fc5eb9b9 tempest-SnapshotsActionsTest-1472833697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.ed42ff39-7e0b-4a9b-bff0-5262ffd8b6cd {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:14 devstack sudo[96583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.ed42ff39-7e0b-4a9b-bff0-5262ffd8b6cd Jul 16 23:25:14 devstack sudo[96583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3d75ad16-815a-45d6-88b0-287918fedf1f tempest-VolumesActionsTest-219677645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:25:14 devstack sudo[96583]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fcfde2d2-6840-4516-b15d-82b7fc5eb9b9 tempest-SnapshotsActionsTest-1472833697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.ed42ff39-7e0b-4a9b-bff0-5262ffd8b6cd" returned: 0 in 0.313s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:14 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-fcfde2d2-6840-4516-b15d-82b7fc5eb9b9 tempest-SnapshotsActionsTest-1472833697 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.ed42ff39-7e0b-4a9b-bff0-5262ffd8b6cd is being set with open permissions: ugo+rw Jul 16 23:25:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fcfde2d2-6840-4516-b15d-82b7fc5eb9b9 tempest-SnapshotsActionsTest-1472833697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.ed42ff39-7e0b-4a9b-bff0-5262ffd8b6cd {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:14 devstack sudo[96588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.ed42ff39-7e0b-4a9b-bff0-5262ffd8b6cd Jul 16 23:25:14 devstack sudo[96588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:15 devstack sudo[96588]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fcfde2d2-6840-4516-b15d-82b7fc5eb9b9 tempest-SnapshotsActionsTest-1472833697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.ed42ff39-7e0b-4a9b-bff0-5262ffd8b6cd" returned: 0 in 0.244s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-fcfde2d2-6840-4516-b15d-82b7fc5eb9b9 tempest-SnapshotsActionsTest-1472833697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.547s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:25:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-fe721285-a26b-4f26-aab7-d33645882586 req-f12ae3c2-2038-4b32-bcce-08d6867feeab tempest-TestStampPattern-699542814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.736s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:25:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-fe721285-a26b-4f26-aab7-d33645882586 req-f12ae3c2-2038-4b32-bcce-08d6867feeab tempest-TestStampPattern-699542814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:25:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3d75ad16-815a-45d6-88b0-287918fedf1f tempest-VolumesActionsTest-219677645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.316s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:25:15 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-fcfde2d2-6840-4516-b15d-82b7fc5eb9b9 tempest-SnapshotsActionsTest-1472833697 None] Create snapshot completed successfully Jul 16 23:25:15 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[394d593d-d442-416a-980d-01338eddfd56]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:25:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3d75ad16-815a-45d6-88b0-287918fedf1f tempest-VolumesActionsTest-219677645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a6a07455-2676-48ae-ae86-d92b5c2f672c {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:15 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-fe721285-a26b-4f26-aab7-d33645882586 req-f12ae3c2-2038-4b32-bcce-08d6867feeab tempest-TestStampPattern-699542814 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72', 'name': 'volume-d2a74ad6-9996-4227-936e-f93dcce122a7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c304d337-502b-4ef0-a612-68d13a8915c3', 'enforce_multipath': True} {{(pid=87607) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 23:25:15 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-fe721285-a26b-4f26-aab7-d33645882586 req-f12ae3c2-2038-4b32-bcce-08d6867feeab tempest-TestStampPattern-699542814 None] attachment_update completed successfully. Jul 16 23:25:15 devstack sudo[96591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a6a07455-2676-48ae-ae86-d92b5c2f672c Jul 16 23:25:15 devstack sudo[96591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:15 devstack sudo[96591]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3d75ad16-815a-45d6-88b0-287918fedf1f tempest-VolumesActionsTest-219677645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a6a07455-2676-48ae-ae86-d92b5c2f672c" returned: 0 in 0.403s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:15 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9527f9-b21f-42c1-9123-ddbd9771fa4b]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:25:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3d75ad16-815a-45d6-88b0-287918fedf1f tempest-VolumesActionsTest-219677645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a6a07455-2676-48ae-ae86-d92b5c2f672c {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:15 devstack sudo[96909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a6a07455-2676-48ae-ae86-d92b5c2f672c Jul 16 23:25:15 devstack sudo[96909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:15 devstack sudo[96909]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3d75ad16-815a-45d6-88b0-287918fedf1f tempest-VolumesActionsTest-219677645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a6a07455-2676-48ae-ae86-d92b5c2f672c" returned: 0 in 0.422s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3d75ad16-815a-45d6-88b0-287918fedf1f tempest-VolumesActionsTest-219677645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a6a07455-2676-48ae-ae86-d92b5c2f672c /opt/stack/data/cinder/conversion/a6a07455-2676-48ae-ae86-d92b5c2f672c.temp_image.c899fd44-a7c6-4046-bfbc-2365ec8f21d4fspwond6.img {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:16 devstack sudo[97069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a6a07455-2676-48ae-ae86-d92b5c2f672c /opt/stack/data/cinder/conversion/a6a07455-2676-48ae-ae86-d92b5c2f672c.temp_image.c899fd44-a7c6-4046-bfbc-2365ec8f21d4fspwond6.img Jul 16 23:25:16 devstack sudo[97069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:16 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-89fa7893-9385-435b-a667-e21d964c4103 tempest-SnapshotsActionsTest-1653615379 None] Acquiring lock "cinder-ed42ff39-7e0b-4a9b-bff0-5262ffd8b6cd-delete_snapshot" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:25:16 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-89fa7893-9385-435b-a667-e21d964c4103 tempest-SnapshotsActionsTest-1653615379 None] Lock "cinder-ed42ff39-7e0b-4a9b-bff0-5262ffd8b6cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:25:16 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-89fa7893-9385-435b-a667-e21d964c4103 tempest-SnapshotsActionsTest-1653615379 None] Acquiring lock "cinder-quobyte-72b027d3-aecd-4c9d-918c-533f835c7b3e" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:25:16 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-89fa7893-9385-435b-a667-e21d964c4103 tempest-SnapshotsActionsTest-1653615379 None] Lock "cinder-quobyte-72b027d3-aecd-4c9d-918c-533f835c7b3e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:25:16 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-89fa7893-9385-435b-a667-e21d964c4103 tempest-SnapshotsActionsTest-1653615379 None] Acquiring lock "cinder-quobyte-ed42ff39-7e0b-4a9b-bff0-5262ffd8b6cd" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:25:16 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-89fa7893-9385-435b-a667-e21d964c4103 tempest-SnapshotsActionsTest-1653615379 None] Lock "cinder-quobyte-ed42ff39-7e0b-4a9b-bff0-5262ffd8b6cd" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:25:16 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-89fa7893-9385-435b-a667-e21d964c4103 tempest-SnapshotsActionsTest-1653615379 None] Deleting offline snapshot ed42ff39-7e0b-4a9b-bff0-5262ffd8b6cd of volume 72b027d3-aecd-4c9d-918c-533f835c7b3e {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:25:16 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-89fa7893-9385-435b-a667-e21d964c4103 tempest-SnapshotsActionsTest-1653615379 None] snapshot_file for this snap is: volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.ed42ff39-7e0b-4a9b-bff0-5262ffd8b6cd {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:25:16 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[73361210-4cc4-45fd-8f58-2156a40e11ee]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:25:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-89fa7893-9385-435b-a667-e21d964c4103 tempest-SnapshotsActionsTest-1653615379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.ed42ff39-7e0b-4a9b-bff0-5262ffd8b6cd {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:16 devstack sudo[97071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.ed42ff39-7e0b-4a9b-bff0-5262ffd8b6cd Jul 16 23:25:16 devstack sudo[97071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:17 devstack sudo[97071]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:17 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-89fa7893-9385-435b-a667-e21d964c4103 tempest-SnapshotsActionsTest-1653615379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.ed42ff39-7e0b-4a9b-bff0-5262ffd8b6cd" returned: 0 in 0.822s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:17 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-89fa7893-9385-435b-a667-e21d964c4103 tempest-SnapshotsActionsTest-1653615379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b027d3-aecd-4c9d-918c-533f835c7b3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:25:17 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c09673-904c-4eb7-8b0f-efc1b047dd19]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:25:17 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-89fa7893-9385-435b-a667-e21d964c4103 tempest-SnapshotsActionsTest-1653615379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:17 devstack sudo[97087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee Jul 16 23:25:17 devstack sudo[97087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:18 devstack sudo[97087]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-89fa7893-9385-435b-a667-e21d964c4103 tempest-SnapshotsActionsTest-1653615379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee" returned: 0 in 1.175s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:18 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-89fa7893-9385-435b-a667-e21d964c4103 tempest-SnapshotsActionsTest-1653615379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b027d3-aecd-4c9d-918c-533f835c7b3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:25:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-89fa7893-9385-435b-a667-e21d964c4103 tempest-SnapshotsActionsTest-1653615379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.ed42ff39-7e0b-4a9b-bff0-5262ffd8b6cd {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:18 devstack sudo[97102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.ed42ff39-7e0b-4a9b-bff0-5262ffd8b6cd Jul 16 23:25:18 devstack sudo[97102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:19 devstack sudo[97102]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-89fa7893-9385-435b-a667-e21d964c4103 tempest-SnapshotsActionsTest-1653615379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.ed42ff39-7e0b-4a9b-bff0-5262ffd8b6cd" returned: 0 in 1.480s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-89fa7893-9385-435b-a667-e21d964c4103 tempest-SnapshotsActionsTest-1653615379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.ed42ff39-7e0b-4a9b-bff0-5262ffd8b6cd {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:19 devstack sudo[97108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.ed42ff39-7e0b-4a9b-bff0-5262ffd8b6cd Jul 16 23:25:19 devstack sudo[97108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:20 devstack sudo[97108]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-89fa7893-9385-435b-a667-e21d964c4103 tempest-SnapshotsActionsTest-1653615379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.ed42ff39-7e0b-4a9b-bff0-5262ffd8b6cd" returned: 0 in 0.467s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:20 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-89fa7893-9385-435b-a667-e21d964c4103 tempest-SnapshotsActionsTest-1653615379 None] Lock "cinder-quobyte-ed42ff39-7e0b-4a9b-bff0-5262ffd8b6cd" released by "_delete_snapshot" :: held 4.204s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:25:20 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-89fa7893-9385-435b-a667-e21d964c4103 tempest-SnapshotsActionsTest-1653615379 None] Lock "cinder-quobyte-72b027d3-aecd-4c9d-918c-533f835c7b3e" released by "delete_snapshot" :: held 4.246s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:25:20 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-89fa7893-9385-435b-a667-e21d964c4103 tempest-SnapshotsActionsTest-1653615379 None] Created reservations ['c36a2148-77a1-4d21-ac40-07631d210ff4', '25c5a86d-d034-4959-bf8b-3a7384774449', '27c3e367-6eff-411c-a07b-3d8823d2122f', '17eb641a-bcda-4c69-ac4f-39c645dbbbfa'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:25:20 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-89fa7893-9385-435b-a667-e21d964c4103 tempest-SnapshotsActionsTest-1653615379 None] Delete snapshot completed successfully. Jul 16 23:25:20 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-89fa7893-9385-435b-a667-e21d964c4103 tempest-SnapshotsActionsTest-1653615379 None] Lock "cinder-ed42ff39-7e0b-4a9b-bff0-5262ffd8b6cd-delete_snapshot" released by "delete_snapshot" :: held 4.696s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:25:21 devstack sudo[97069]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3d75ad16-815a-45d6-88b0-287918fedf1f tempest-VolumesActionsTest-219677645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a6a07455-2676-48ae-ae86-d92b5c2f672c /opt/stack/data/cinder/conversion/a6a07455-2676-48ae-ae86-d92b5c2f672c.temp_image.c899fd44-a7c6-4046-bfbc-2365ec8f21d4fspwond6.img" returned: 0 in 5.719s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:21 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[a356a110-765f-4782-b22f-657308330f41]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:25:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3d75ad16-815a-45d6-88b0-287918fedf1f tempest-VolumesActionsTest-219677645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a6a07455-2676-48ae-ae86-d92b5c2f672c {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:21 devstack sudo[97118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a6a07455-2676-48ae-ae86-d92b5c2f672c Jul 16 23:25:21 devstack sudo[97118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3e41b58f-74d1-4787-9b86-7817b33827dc tempest-SnapshotsActionsTest-1472833697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:25:22 devstack sudo[97118]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3d75ad16-815a-45d6-88b0-287918fedf1f tempest-VolumesActionsTest-219677645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a6a07455-2676-48ae-ae86-d92b5c2f672c" returned: 0 in 0.683s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:22 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-3d75ad16-815a-45d6-88b0-287918fedf1f tempest-VolumesActionsTest-219677645 None] Image conversion details: src /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a6a07455-2676-48ae-ae86-d92b5c2f672c, size 1024.00 MB, duration 5.72 sec, destination /opt/stack/data/cinder/conversion/a6a07455-2676-48ae-ae86-d92b5c2f672c.temp_image.c899fd44-a7c6-4046-bfbc-2365ec8f21d4fspwond6.img {{(pid=87607) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 23:25:22 devstack cinder-volume[87607]: INFO cinder.image.image_utils [None req-3d75ad16-815a-45d6-88b0-287918fedf1f tempest-VolumesActionsTest-219677645 None] Converted 1024.00 MB image at 179.02 MB/s Jul 16 23:25:22 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-3d75ad16-815a-45d6-88b0-287918fedf1f tempest-VolumesActionsTest-219677645 None] c899fd44-a7c6-4046-bfbc-2365ec8f21d4 was raw, converting to qcow2 {{(pid=87607) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 16 23:25:22 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7d6a42-c8fc-419c-a094-d5e0e3be1575]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:25:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3d75ad16-815a-45d6-88b0-287918fedf1f tempest-VolumesActionsTest-219677645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a6a07455-2676-48ae-ae86-d92b5c2f672c.temp_image.c899fd44-a7c6-4046-bfbc-2365ec8f21d4fspwond6.img {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:22 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a6a07455-2676-48ae-ae86-d92b5c2f672c.temp_image.c899fd44-a7c6-4046-bfbc-2365ec8f21d4fspwond6.img Jul 16 23:25:22 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:22 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3d75ad16-815a-45d6-88b0-287918fedf1f tempest-VolumesActionsTest-219677645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a6a07455-2676-48ae-ae86-d92b5c2f672c.temp_image.c899fd44-a7c6-4046-bfbc-2365ec8f21d4fspwond6.img" returned: 0 in 0.411s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3d75ad16-815a-45d6-88b0-287918fedf1f tempest-VolumesActionsTest-219677645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a6a07455-2676-48ae-ae86-d92b5c2f672c.temp_image.c899fd44-a7c6-4046-bfbc-2365ec8f21d4fspwond6.img {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:22 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-664740c1-d149-4749-854a-64a2608f6788 req-c650b847-b79f-45aa-b11e-645bd025dca7 tempest-TestStampPattern-699542814 None] Terminate volume connection completed successfully. Jul 16 23:25:22 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-664740c1-d149-4749-854a-64a2608f6788 req-c650b847-b79f-45aa-b11e-645bd025dca7 tempest-TestStampPattern-699542814 None] Deleting attachment c304d337-502b-4ef0-a612-68d13a8915c3. {{(pid=87607) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 23:25:23 devstack sudo[97164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a6a07455-2676-48ae-ae86-d92b5c2f672c.temp_image.c899fd44-a7c6-4046-bfbc-2365ec8f21d4fspwond6.img Jul 16 23:25:23 devstack sudo[97164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:23 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2658077-f6b5-4d25-80d5-13a0eb43e29d tempest-AttachVolumeNegativeTest-552460454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:25:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d2658077-f6b5-4d25-80d5-13a0eb43e29d tempest-AttachVolumeNegativeTest-552460454 None] Flow 'volume_create_manager' (bf3af630-b53f-4edf-a0f4-7f7fdf3195d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:25:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d2658077-f6b5-4d25-80d5-13a0eb43e29d tempest-AttachVolumeNegativeTest-552460454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae8e43d-1b0f-46c6-8540-db0b0c732ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:25:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d2658077-f6b5-4d25-80d5-13a0eb43e29d tempest-AttachVolumeNegativeTest-552460454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae8e43d-1b0f-46c6-8540-db0b0c732ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1816796966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68a4212d-4fba-457b-8ca3-eb2ba7261b7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad2eceaebf5b4204b9222188f3e0e98d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:25:23Z,use_quota=True,user_id='609a2cd5502a47deab0e97d228687a01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:25:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d2658077-f6b5-4d25-80d5-13a0eb43e29d tempest-AttachVolumeNegativeTest-552460454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82abd08e-86ea-4d9a-ae2d-3241847b9b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:25:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d2658077-f6b5-4d25-80d5-13a0eb43e29d tempest-AttachVolumeNegativeTest-552460454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82abd08e-86ea-4d9a-ae2d-3241847b9b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:25:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d2658077-f6b5-4d25-80d5-13a0eb43e29d tempest-AttachVolumeNegativeTest-552460454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31d3b965-36af-4303-8c9e-6ab2feeafdd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:25:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d2658077-f6b5-4d25-80d5-13a0eb43e29d tempest-AttachVolumeNegativeTest-552460454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31d3b965-36af-4303-8c9e-6ab2feeafdd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68a4212d-4fba-457b-8ca3-eb2ba7261b7f', 'volume_name': 'volume-68a4212d-4fba-457b-8ca3-eb2ba7261b7f', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:25:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d2658077-f6b5-4d25-80d5-13a0eb43e29d tempest-AttachVolumeNegativeTest-552460454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d4892c3-95b0-4903-98cf-f308c3d61867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:25:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d2658077-f6b5-4d25-80d5-13a0eb43e29d tempest-AttachVolumeNegativeTest-552460454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d4892c3-95b0-4903-98cf-f308c3d61867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:25:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d2658077-f6b5-4d25-80d5-13a0eb43e29d tempest-AttachVolumeNegativeTest-552460454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1a1c42e-4a10-46cd-aa0d-887026885eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:25:23 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-d2658077-f6b5-4d25-80d5-13a0eb43e29d tempest-AttachVolumeNegativeTest-552460454 None] Volume 68a4212d-4fba-457b-8ca3-eb2ba7261b7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68a4212d-4fba-457b-8ca3-eb2ba7261b7f', 'volume_size': 1} Jul 16 23:25:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-d2658077-f6b5-4d25-80d5-13a0eb43e29d tempest-AttachVolumeNegativeTest-552460454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:25:23 devstack sudo[97164]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3d75ad16-815a-45d6-88b0-287918fedf1f tempest-VolumesActionsTest-219677645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a6a07455-2676-48ae-ae86-d92b5c2f672c.temp_image.c899fd44-a7c6-4046-bfbc-2365ec8f21d4fspwond6.img" returned: 1 in 0.455s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3d75ad16-815a-45d6-88b0-287918fedf1f tempest-VolumesActionsTest-219677645 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a6a07455-2676-48ae-ae86-d92b5c2f672c.temp_image.c899fd44-a7c6-4046-bfbc-2365ec8f21d4fspwond6.img' failed. Not Retrying. {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 23:25:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3d75ad16-815a-45d6-88b0-287918fedf1f tempest-VolumesActionsTest-219677645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a6a07455-2676-48ae-ae86-d92b5c2f672c.temp_image.c899fd44-a7c6-4046-bfbc-2365ec8f21d4fspwond6.img /opt/stack/data/cinder/conversion/vol_upload_8n_iftg1 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:23 devstack sudo[97169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a6a07455-2676-48ae-ae86-d92b5c2f672c.temp_image.c899fd44-a7c6-4046-bfbc-2365ec8f21d4fspwond6.img /opt/stack/data/cinder/conversion/vol_upload_8n_iftg1 Jul 16 23:25:23 devstack sudo[97169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:23 devstack sudo[97169]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3d75ad16-815a-45d6-88b0-287918fedf1f tempest-VolumesActionsTest-219677645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a6a07455-2676-48ae-ae86-d92b5c2f672c.temp_image.c899fd44-a7c6-4046-bfbc-2365ec8f21d4fspwond6.img /opt/stack/data/cinder/conversion/vol_upload_8n_iftg1" returned: 0 in 0.284s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:23 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-3d75ad16-815a-45d6-88b0-287918fedf1f tempest-VolumesActionsTest-219677645 None] Image conversion details: src /opt/stack/data/cinder/conversion/a6a07455-2676-48ae-ae86-d92b5c2f672c.temp_image.c899fd44-a7c6-4046-bfbc-2365ec8f21d4fspwond6.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_8n_iftg1 {{(pid=87607) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 23:25:23 devstack cinder-volume[87607]: INFO cinder.image.image_utils [None req-3d75ad16-815a-45d6-88b0-287918fedf1f tempest-VolumesActionsTest-219677645 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 16 23:25:23 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[5370e76c-239d-415c-9b27-6f8d82f2c0ed]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:25:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3d75ad16-815a-45d6-88b0-287918fedf1f tempest-VolumesActionsTest-219677645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_8n_iftg1 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:23 devstack sudo[97175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_8n_iftg1 Jul 16 23:25:23 devstack sudo[97175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-2d31eec3-284e-4d98-97ee-acb827a5fcd5 tempest-TestStampPattern-699542814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:25:23 devstack sudo[97175]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3d75ad16-815a-45d6-88b0-287918fedf1f tempest-VolumesActionsTest-219677645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_8n_iftg1" returned: 0 in 0.376s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3d75ad16-815a-45d6-88b0-287918fedf1f tempest-VolumesActionsTest-219677645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.175s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:25:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3d75ad16-815a-45d6-88b0-287918fedf1f tempest-VolumesActionsTest-219677645 None] Uploaded volume to glance image-id: c899fd44-a7c6-4046-bfbc-2365ec8f21d4. {{(pid=87607) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 16 23:25:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3e41b58f-74d1-4787-9b86-7817b33827dc tempest-SnapshotsActionsTest-1472833697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.160s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:25:25 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-3e41b58f-74d1-4787-9b86-7817b33827dc tempest-SnapshotsActionsTest-1472833697 None] Creating offline snapshot da90414d-2da2-4b9b-b970-177bb9e93bf2 of volume 72b027d3-aecd-4c9d-918c-533f835c7b3e {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:25:25 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-3d75ad16-815a-45d6-88b0-287918fedf1f tempest-VolumesActionsTest-219677645 None] Copy volume to image completed successfully. Jul 16 23:25:25 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c27ab9-c97f-407b-82d8-e34e32f99be8]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:25:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3e41b58f-74d1-4787-9b86-7817b33827dc tempest-SnapshotsActionsTest-1472833697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:25 devstack sudo[97181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee Jul 16 23:25:25 devstack sudo[97181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:25 devstack sudo[97181]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3e41b58f-74d1-4787-9b86-7817b33827dc tempest-SnapshotsActionsTest-1472833697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee" returned: 0 in 0.367s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:25 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-3e41b58f-74d1-4787-9b86-7817b33827dc tempest-SnapshotsActionsTest-1472833697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b027d3-aecd-4c9d-918c-533f835c7b3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:25:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3e41b58f-74d1-4787-9b86-7817b33827dc tempest-SnapshotsActionsTest-1472833697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.da90414d-2da2-4b9b-b970-177bb9e93bf2 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:25 devstack sudo[97186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.da90414d-2da2-4b9b-b970-177bb9e93bf2 1G Jul 16 23:25:25 devstack sudo[97186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:26 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-97cbe5e3-6d10-4c73-a8e7-1c96b673022b tempest-VolumesActionsTest-219677645 None] Acquiring lock "cinder-a6a07455-2676-48ae-ae86-d92b5c2f672c-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:25:26 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-97cbe5e3-6d10-4c73-a8e7-1c96b673022b tempest-VolumesActionsTest-219677645 None] Lock "cinder-a6a07455-2676-48ae-ae86-d92b5c2f672c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:25:26 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-97cbe5e3-6d10-4c73-a8e7-1c96b673022b tempest-VolumesActionsTest-219677645 None] Acquiring lock "cinder-quobyte-a6a07455-2676-48ae-ae86-d92b5c2f672c" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:25:26 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-97cbe5e3-6d10-4c73-a8e7-1c96b673022b tempest-VolumesActionsTest-219677645 None] Lock "cinder-quobyte-a6a07455-2676-48ae-ae86-d92b5c2f672c" acquired by "delete_volume" :: waited 0.019s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:25:26 devstack sudo[97186]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3e41b58f-74d1-4787-9b86-7817b33827dc tempest-SnapshotsActionsTest-1472833697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.da90414d-2da2-4b9b-b970-177bb9e93bf2 1G" returned: 0 in 0.486s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3e41b58f-74d1-4787-9b86-7817b33827dc tempest-SnapshotsActionsTest-1472833697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.da90414d-2da2-4b9b-b970-177bb9e93bf2 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:26 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4c8204-ef9f-418a-ab0d-7c5a2c81494f]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:25:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-97cbe5e3-6d10-4c73-a8e7-1c96b673022b tempest-VolumesActionsTest-219677645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a6a07455-2676-48ae-ae86-d92b5c2f672c {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:26 devstack sudo[97191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.da90414d-2da2-4b9b-b970-177bb9e93bf2 Jul 16 23:25:26 devstack sudo[97191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:26 devstack sudo[97192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a6a07455-2676-48ae-ae86-d92b5c2f672c Jul 16 23:25:26 devstack sudo[97192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:26 devstack sudo[97191]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3e41b58f-74d1-4787-9b86-7817b33827dc tempest-SnapshotsActionsTest-1472833697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.da90414d-2da2-4b9b-b970-177bb9e93bf2" returned: 0 in 0.294s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:26 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-3e41b58f-74d1-4787-9b86-7817b33827dc tempest-SnapshotsActionsTest-1472833697 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.da90414d-2da2-4b9b-b970-177bb9e93bf2 is being set with open permissions: ugo+rw Jul 16 23:25:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3e41b58f-74d1-4787-9b86-7817b33827dc tempest-SnapshotsActionsTest-1472833697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.da90414d-2da2-4b9b-b970-177bb9e93bf2 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:26 devstack sudo[97198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.da90414d-2da2-4b9b-b970-177bb9e93bf2 Jul 16 23:25:26 devstack sudo[97198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:26 devstack sudo[97192]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-97cbe5e3-6d10-4c73-a8e7-1c96b673022b tempest-VolumesActionsTest-219677645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a6a07455-2676-48ae-ae86-d92b5c2f672c" returned: 0 in 0.370s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-97cbe5e3-6d10-4c73-a8e7-1c96b673022b tempest-VolumesActionsTest-219677645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a6a07455-2676-48ae-ae86-d92b5c2f672c {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:26 devstack sudo[97203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a6a07455-2676-48ae-ae86-d92b5c2f672c Jul 16 23:25:26 devstack sudo[97203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:26 devstack sudo[97198]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3e41b58f-74d1-4787-9b86-7817b33827dc tempest-SnapshotsActionsTest-1472833697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.da90414d-2da2-4b9b-b970-177bb9e93bf2" returned: 0 in 0.249s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3e41b58f-74d1-4787-9b86-7817b33827dc tempest-SnapshotsActionsTest-1472833697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.491s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:25:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-d2658077-f6b5-4d25-80d5-13a0eb43e29d tempest-AttachVolumeNegativeTest-552460454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.534s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:25:26 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-d2658077-f6b5-4d25-80d5-13a0eb43e29d tempest-AttachVolumeNegativeTest-552460454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1816796966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68a4212d-4fba-457b-8ca3-eb2ba7261b7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad2eceaebf5b4204b9222188f3e0e98d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:25:23Z,use_quota=True,user_id='609a2cd5502a47deab0e97d228687a01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:25:26 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-d2658077-f6b5-4d25-80d5-13a0eb43e29d tempest-AttachVolumeNegativeTest-552460454 None] Creating volume 68a4212d-4fba-457b-8ca3-eb2ba7261b7f {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:25:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-d2658077-f6b5-4d25-80d5-13a0eb43e29d tempest-AttachVolumeNegativeTest-552460454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:25:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-d2658077-f6b5-4d25-80d5-13a0eb43e29d tempest-AttachVolumeNegativeTest-552460454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:25:26 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-d2658077-f6b5-4d25-80d5-13a0eb43e29d tempest-AttachVolumeNegativeTest-552460454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:25:26 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-d2658077-f6b5-4d25-80d5-13a0eb43e29d tempest-AttachVolumeNegativeTest-552460454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:25:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-d2658077-f6b5-4d25-80d5-13a0eb43e29d tempest-AttachVolumeNegativeTest-552460454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:25:26 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-d2658077-f6b5-4d25-80d5-13a0eb43e29d tempest-AttachVolumeNegativeTest-552460454 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:25:26 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-d2658077-f6b5-4d25-80d5-13a0eb43e29d tempest-AttachVolumeNegativeTest-552460454 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:25:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d2658077-f6b5-4d25-80d5-13a0eb43e29d tempest-AttachVolumeNegativeTest-552460454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-68a4212d-4fba-457b-8ca3-eb2ba7261b7f 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:26 devstack sudo[97206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-68a4212d-4fba-457b-8ca3-eb2ba7261b7f 1073741824 Jul 16 23:25:26 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:26 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-3e41b58f-74d1-4787-9b86-7817b33827dc tempest-SnapshotsActionsTest-1472833697 None] Create snapshot completed successfully Jul 16 23:25:26 devstack sudo[97203]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-97cbe5e3-6d10-4c73-a8e7-1c96b673022b tempest-VolumesActionsTest-219677645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a6a07455-2676-48ae-ae86-d92b5c2f672c" returned: 0 in 0.262s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:26 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-97cbe5e3-6d10-4c73-a8e7-1c96b673022b tempest-VolumesActionsTest-219677645 None] Lock "cinder-quobyte-a6a07455-2676-48ae-ae86-d92b5c2f672c" released by "delete_volume" :: held 0.694s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:25:26 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-97cbe5e3-6d10-4c73-a8e7-1c96b673022b tempest-VolumesActionsTest-219677645 None] Created reservations ['f26136f0-0635-4ac6-b6fd-d1a85789d8f6', '19a8d3d8-b1c9-4213-b60d-ffb967bde9e3', '054775aa-8430-4ec1-aba4-2147919dd269', '3b2add3f-e16b-41dc-b954-f7becde3cd4b'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:25:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-97cbe5e3-6d10-4c73-a8e7-1c96b673022b tempest-VolumesActionsTest-219677645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:25:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-97cbe5e3-6d10-4c73-a8e7-1c96b673022b tempest-VolumesActionsTest-219677645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:25:26 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-97cbe5e3-6d10-4c73-a8e7-1c96b673022b tempest-VolumesActionsTest-219677645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:25:26 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-97cbe5e3-6d10-4c73-a8e7-1c96b673022b tempest-VolumesActionsTest-219677645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:25:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-97cbe5e3-6d10-4c73-a8e7-1c96b673022b tempest-VolumesActionsTest-219677645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:25:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-97cbe5e3-6d10-4c73-a8e7-1c96b673022b tempest-VolumesActionsTest-219677645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:27 devstack sudo[97210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:25:27 devstack sudo[97210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:27 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d2658077-f6b5-4d25-80d5-13a0eb43e29d tempest-AttachVolumeNegativeTest-552460454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-68a4212d-4fba-457b-8ca3-eb2ba7261b7f 1073741824" returned: 0 in 0.412s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d2658077-f6b5-4d25-80d5-13a0eb43e29d tempest-AttachVolumeNegativeTest-552460454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-68a4212d-4fba-457b-8ca3-eb2ba7261b7f {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:27 devstack sudo[97210]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-97cbe5e3-6d10-4c73-a8e7-1c96b673022b tempest-VolumesActionsTest-219677645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.284s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:27 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-97cbe5e3-6d10-4c73-a8e7-1c96b673022b tempest-VolumesActionsTest-219677645 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:25:27 devstack sudo[97215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-68a4212d-4fba-457b-8ca3-eb2ba7261b7f Jul 16 23:25:27 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-97cbe5e3-6d10-4c73-a8e7-1c96b673022b tempest-VolumesActionsTest-219677645 None] Deleted volume successfully. Jul 16 23:25:27 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:27 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-97cbe5e3-6d10-4c73-a8e7-1c96b673022b tempest-VolumesActionsTest-219677645 None] Lock "cinder-a6a07455-2676-48ae-ae86-d92b5c2f672c-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:25:27 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-22dc2422-ffed-40f5-a311-d9b9ebc301bc tempest-SnapshotsActionsTest-1653615379 None] Acquiring lock "cinder-da90414d-2da2-4b9b-b970-177bb9e93bf2-delete_snapshot" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:25:27 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-22dc2422-ffed-40f5-a311-d9b9ebc301bc tempest-SnapshotsActionsTest-1653615379 None] Lock "cinder-da90414d-2da2-4b9b-b970-177bb9e93bf2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:25:27 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-22dc2422-ffed-40f5-a311-d9b9ebc301bc tempest-SnapshotsActionsTest-1653615379 None] Acquiring lock "cinder-quobyte-72b027d3-aecd-4c9d-918c-533f835c7b3e" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:25:27 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-22dc2422-ffed-40f5-a311-d9b9ebc301bc tempest-SnapshotsActionsTest-1653615379 None] Lock "cinder-quobyte-72b027d3-aecd-4c9d-918c-533f835c7b3e" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:25:27 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-22dc2422-ffed-40f5-a311-d9b9ebc301bc tempest-SnapshotsActionsTest-1653615379 None] Acquiring lock "cinder-quobyte-da90414d-2da2-4b9b-b970-177bb9e93bf2" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:25:27 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-22dc2422-ffed-40f5-a311-d9b9ebc301bc tempest-SnapshotsActionsTest-1653615379 None] Lock "cinder-quobyte-da90414d-2da2-4b9b-b970-177bb9e93bf2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:25:27 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-22dc2422-ffed-40f5-a311-d9b9ebc301bc tempest-SnapshotsActionsTest-1653615379 None] Deleting offline snapshot da90414d-2da2-4b9b-b970-177bb9e93bf2 of volume 72b027d3-aecd-4c9d-918c-533f835c7b3e {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:25:27 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-22dc2422-ffed-40f5-a311-d9b9ebc301bc tempest-SnapshotsActionsTest-1653615379 None] snapshot_file for this snap is: volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.da90414d-2da2-4b9b-b970-177bb9e93bf2 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:25:27 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b558ba-6441-40b7-ab27-306c7549f583]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:25:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-22dc2422-ffed-40f5-a311-d9b9ebc301bc tempest-SnapshotsActionsTest-1653615379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.da90414d-2da2-4b9b-b970-177bb9e93bf2 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:27 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d2658077-f6b5-4d25-80d5-13a0eb43e29d tempest-AttachVolumeNegativeTest-552460454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-68a4212d-4fba-457b-8ca3-eb2ba7261b7f" returned: 0 in 0.316s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:27 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-d2658077-f6b5-4d25-80d5-13a0eb43e29d tempest-AttachVolumeNegativeTest-552460454 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:25:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-d2658077-f6b5-4d25-80d5-13a0eb43e29d tempest-AttachVolumeNegativeTest-552460454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:25:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-2d31eec3-284e-4d98-97ee-acb827a5fcd5 tempest-TestStampPattern-699542814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.759s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:25:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d2658077-f6b5-4d25-80d5-13a0eb43e29d tempest-AttachVolumeNegativeTest-552460454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1a1c42e-4a10-46cd-aa0d-887026885eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68a4212d-4fba-457b-8ca3-eb2ba7261b7f', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:25:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d2658077-f6b5-4d25-80d5-13a0eb43e29d tempest-AttachVolumeNegativeTest-552460454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e00235c-40c5-4aae-99e8-baa0f48a168e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:25:27 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-2d31eec3-284e-4d98-97ee-acb827a5fcd5 tempest-TestStampPattern-699542814 None] Creating offline snapshot d825ced7-1eb3-4c3b-85ca-324c41ab3d57 of volume d2a74ad6-9996-4227-936e-f93dcce122a7 {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:25:27 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-d2658077-f6b5-4d25-80d5-13a0eb43e29d tempest-AttachVolumeNegativeTest-552460454 None] Volume volume-68a4212d-4fba-457b-8ca3-eb2ba7261b7f (68a4212d-4fba-457b-8ca3-eb2ba7261b7f): created successfully Jul 16 23:25:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d2658077-f6b5-4d25-80d5-13a0eb43e29d tempest-AttachVolumeNegativeTest-552460454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e00235c-40c5-4aae-99e8-baa0f48a168e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:25:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d2658077-f6b5-4d25-80d5-13a0eb43e29d tempest-AttachVolumeNegativeTest-552460454 None] Flow 'volume_create_manager' (bf3af630-b53f-4edf-a0f4-7f7fdf3195d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:25:27 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9c8194-bcf0-43a9-99ba-3c6ad381c463]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:25:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2d31eec3-284e-4d98-97ee-acb827a5fcd5 tempest-TestStampPattern-699542814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:27 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-d2658077-f6b5-4d25-80d5-13a0eb43e29d tempest-AttachVolumeNegativeTest-552460454 None] Created volume successfully. Jul 16 23:25:27 devstack sudo[97218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.da90414d-2da2-4b9b-b970-177bb9e93bf2 Jul 16 23:25:27 devstack sudo[97218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:27 devstack sudo[97219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7 Jul 16 23:25:27 devstack sudo[97219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:27 devstack sudo[97218]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-22dc2422-ffed-40f5-a311-d9b9ebc301bc tempest-SnapshotsActionsTest-1653615379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.da90414d-2da2-4b9b-b970-177bb9e93bf2" returned: 0 in 0.414s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:27 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-22dc2422-ffed-40f5-a311-d9b9ebc301bc tempest-SnapshotsActionsTest-1653615379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b027d3-aecd-4c9d-918c-533f835c7b3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:25:28 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e1f105-321d-4eaf-bcb3-d675265dd52c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:25:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-22dc2422-ffed-40f5-a311-d9b9ebc301bc tempest-SnapshotsActionsTest-1653615379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:28 devstack sudo[97219]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2d31eec3-284e-4d98-97ee-acb827a5fcd5 tempest-TestStampPattern-699542814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7" returned: 0 in 0.469s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2d31eec3-284e-4d98-97ee-acb827a5fcd5 tempest-TestStampPattern-699542814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7.d825ced7-1eb3-4c3b-85ca-324c41ab3d57 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:28 devstack sudo[97230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7.d825ced7-1eb3-4c3b-85ca-324c41ab3d57 1G Jul 16 23:25:28 devstack sudo[97230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:28 devstack sudo[97228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee Jul 16 23:25:28 devstack sudo[97228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:28 devstack sudo[97228]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-22dc2422-ffed-40f5-a311-d9b9ebc301bc tempest-SnapshotsActionsTest-1653615379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee" returned: 0 in 0.429s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:28 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-22dc2422-ffed-40f5-a311-d9b9ebc301bc tempest-SnapshotsActionsTest-1653615379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b027d3-aecd-4c9d-918c-533f835c7b3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:25:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-22dc2422-ffed-40f5-a311-d9b9ebc301bc tempest-SnapshotsActionsTest-1653615379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.da90414d-2da2-4b9b-b970-177bb9e93bf2 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:28 devstack sudo[97239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.da90414d-2da2-4b9b-b970-177bb9e93bf2 Jul 16 23:25:28 devstack sudo[97239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:28 devstack sudo[97230]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2d31eec3-284e-4d98-97ee-acb827a5fcd5 tempest-TestStampPattern-699542814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7.d825ced7-1eb3-4c3b-85ca-324c41ab3d57 1G" returned: 0 in 0.516s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2d31eec3-284e-4d98-97ee-acb827a5fcd5 tempest-TestStampPattern-699542814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2a74ad6-9996-4227-936e-f93dcce122a7 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7.d825ced7-1eb3-4c3b-85ca-324c41ab3d57 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:28 devstack sudo[97245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2a74ad6-9996-4227-936e-f93dcce122a7 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7.d825ced7-1eb3-4c3b-85ca-324c41ab3d57 Jul 16 23:25:28 devstack sudo[97245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:29 devstack sudo[97239]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-22dc2422-ffed-40f5-a311-d9b9ebc301bc tempest-SnapshotsActionsTest-1653615379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.da90414d-2da2-4b9b-b970-177bb9e93bf2" returned: 0 in 0.550s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-22dc2422-ffed-40f5-a311-d9b9ebc301bc tempest-SnapshotsActionsTest-1653615379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.da90414d-2da2-4b9b-b970-177bb9e93bf2 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:29 devstack sudo[97256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.da90414d-2da2-4b9b-b970-177bb9e93bf2 Jul 16 23:25:29 devstack sudo[97256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:29 devstack sudo[97245]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2d31eec3-284e-4d98-97ee-acb827a5fcd5 tempest-TestStampPattern-699542814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2a74ad6-9996-4227-936e-f93dcce122a7 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7.d825ced7-1eb3-4c3b-85ca-324c41ab3d57" returned: 0 in 0.475s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:29 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-2d31eec3-284e-4d98-97ee-acb827a5fcd5 tempest-TestStampPattern-699542814 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7.d825ced7-1eb3-4c3b-85ca-324c41ab3d57 is being set with open permissions: ugo+rw Jul 16 23:25:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2d31eec3-284e-4d98-97ee-acb827a5fcd5 tempest-TestStampPattern-699542814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7.d825ced7-1eb3-4c3b-85ca-324c41ab3d57 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:29 devstack sudo[97258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7.d825ced7-1eb3-4c3b-85ca-324c41ab3d57 Jul 16 23:25:29 devstack sudo[97258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:29 devstack sudo[97256]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-22dc2422-ffed-40f5-a311-d9b9ebc301bc tempest-SnapshotsActionsTest-1653615379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.da90414d-2da2-4b9b-b970-177bb9e93bf2" returned: 0 in 0.290s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:29 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-22dc2422-ffed-40f5-a311-d9b9ebc301bc tempest-SnapshotsActionsTest-1653615379 None] Lock "cinder-quobyte-da90414d-2da2-4b9b-b970-177bb9e93bf2" released by "_delete_snapshot" :: held 1.823s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:25:29 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-22dc2422-ffed-40f5-a311-d9b9ebc301bc tempest-SnapshotsActionsTest-1653615379 None] Lock "cinder-quobyte-72b027d3-aecd-4c9d-918c-533f835c7b3e" released by "delete_snapshot" :: held 1.850s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:25:29 devstack sudo[97258]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2d31eec3-284e-4d98-97ee-acb827a5fcd5 tempest-TestStampPattern-699542814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7.d825ced7-1eb3-4c3b-85ca-324c41ab3d57" returned: 0 in 0.293s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-47a72aa2-ddf8-4b45-bc2e-4622a197c22b req-9f8c4b89-3cc1-4361-ab3f-3fed32ef75e4 tempest-AttachVolumeNegativeTest-552460454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:25:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2d31eec3-284e-4d98-97ee-acb827a5fcd5 tempest-TestStampPattern-699542814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:29 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-22dc2422-ffed-40f5-a311-d9b9ebc301bc tempest-SnapshotsActionsTest-1653615379 None] Created reservations ['69ca6193-54c2-4d63-9440-1b8723e5ae4f', '427549e0-4233-4f63-a6f0-c6499b64885d', '5ddc4f28-9bcf-4b5c-980b-54464ae9f2ce', '49052ab7-e52b-4920-b8ac-0122f668a0b5'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:25:29 devstack sudo[97270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7.info Jul 16 23:25:29 devstack sudo[97270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:29 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-22dc2422-ffed-40f5-a311-d9b9ebc301bc tempest-SnapshotsActionsTest-1653615379 None] Delete snapshot completed successfully. Jul 16 23:25:29 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-22dc2422-ffed-40f5-a311-d9b9ebc301bc tempest-SnapshotsActionsTest-1653615379 None] Lock "cinder-da90414d-2da2-4b9b-b970-177bb9e93bf2-delete_snapshot" released by "delete_snapshot" :: held 2.070s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:25:29 devstack sudo[97270]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2d31eec3-284e-4d98-97ee-acb827a5fcd5 tempest-TestStampPattern-699542814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7.info" returned: 0 in 0.305s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:29 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-2d31eec3-284e-4d98-97ee-acb827a5fcd5 tempest-TestStampPattern-699542814 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7.info is being set with open permissions: ugo+rw Jul 16 23:25:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2d31eec3-284e-4d98-97ee-acb827a5fcd5 tempest-TestStampPattern-699542814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:29 devstack sudo[97273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7.info Jul 16 23:25:29 devstack sudo[97273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4c632914-4870-47e4-b2ff-3c854c0d1552 tempest-SnapshotsActionsTest-1472833697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:25:30 devstack sudo[97273]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2d31eec3-284e-4d98-97ee-acb827a5fcd5 tempest-TestStampPattern-699542814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7.info" returned: 0 in 0.304s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-2d31eec3-284e-4d98-97ee-acb827a5fcd5 tempest-TestStampPattern-699542814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.493s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:25:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-47a72aa2-ddf8-4b45-bc2e-4622a197c22b req-9f8c4b89-3cc1-4361-ab3f-3fed32ef75e4 tempest-AttachVolumeNegativeTest-552460454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.663s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:25:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-47a72aa2-ddf8-4b45-bc2e-4622a197c22b req-9f8c4b89-3cc1-4361-ab3f-3fed32ef75e4 tempest-AttachVolumeNegativeTest-552460454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:25:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4c632914-4870-47e4-b2ff-3c854c0d1552 tempest-SnapshotsActionsTest-1472833697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.122s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:25:30 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-2d31eec3-284e-4d98-97ee-acb827a5fcd5 tempest-TestStampPattern-699542814 None] Create snapshot completed successfully Jul 16 23:25:30 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-4c632914-4870-47e4-b2ff-3c854c0d1552 tempest-SnapshotsActionsTest-1472833697 None] Creating offline snapshot 2f486e97-6401-461d-86b6-3940a671843d of volume 72b027d3-aecd-4c9d-918c-533f835c7b3e {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:25:30 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[672b3176-f0b1-4c2b-8201-ae51d792a9b2]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:25:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4c632914-4870-47e4-b2ff-3c854c0d1552 tempest-SnapshotsActionsTest-1472833697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:30 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-47a72aa2-ddf8-4b45-bc2e-4622a197c22b req-9f8c4b89-3cc1-4361-ab3f-3fed32ef75e4 tempest-AttachVolumeNegativeTest-552460454 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72', 'name': 'volume-68a4212d-4fba-457b-8ca3-eb2ba7261b7f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '41cbdc69-4b89-41c1-bd4d-c8e4851ba6e6', 'enforce_multipath': True} {{(pid=87607) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 23:25:30 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-47a72aa2-ddf8-4b45-bc2e-4622a197c22b req-9f8c4b89-3cc1-4361-ab3f-3fed32ef75e4 tempest-AttachVolumeNegativeTest-552460454 None] attachment_update completed successfully. Jul 16 23:25:30 devstack sudo[97276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee Jul 16 23:25:30 devstack sudo[97276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:30 devstack sudo[97276]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4c632914-4870-47e4-b2ff-3c854c0d1552 tempest-SnapshotsActionsTest-1472833697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee" returned: 0 in 0.506s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:30 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-4c632914-4870-47e4-b2ff-3c854c0d1552 tempest-SnapshotsActionsTest-1472833697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b027d3-aecd-4c9d-918c-533f835c7b3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:25:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4c632914-4870-47e4-b2ff-3c854c0d1552 tempest-SnapshotsActionsTest-1472833697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.2f486e97-6401-461d-86b6-3940a671843d 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:30 devstack sudo[97454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.2f486e97-6401-461d-86b6-3940a671843d 1G Jul 16 23:25:30 devstack sudo[97454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:31 devstack sudo[97454]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4c632914-4870-47e4-b2ff-3c854c0d1552 tempest-SnapshotsActionsTest-1472833697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.2f486e97-6401-461d-86b6-3940a671843d 1G" returned: 0 in 0.661s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4c632914-4870-47e4-b2ff-3c854c0d1552 tempest-SnapshotsActionsTest-1472833697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.2f486e97-6401-461d-86b6-3940a671843d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:31 devstack sudo[97669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.2f486e97-6401-461d-86b6-3940a671843d Jul 16 23:25:31 devstack sudo[97669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:31 devstack sudo[97669]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4c632914-4870-47e4-b2ff-3c854c0d1552 tempest-SnapshotsActionsTest-1472833697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.2f486e97-6401-461d-86b6-3940a671843d" returned: 0 in 0.518s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:31 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-4c632914-4870-47e4-b2ff-3c854c0d1552 tempest-SnapshotsActionsTest-1472833697 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.2f486e97-6401-461d-86b6-3940a671843d is being set with open permissions: ugo+rw Jul 16 23:25:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4c632914-4870-47e4-b2ff-3c854c0d1552 tempest-SnapshotsActionsTest-1472833697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.2f486e97-6401-461d-86b6-3940a671843d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:31 devstack sudo[97675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.2f486e97-6401-461d-86b6-3940a671843d Jul 16 23:25:31 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:32 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4c632914-4870-47e4-b2ff-3c854c0d1552 tempest-SnapshotsActionsTest-1472833697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.2f486e97-6401-461d-86b6-3940a671843d" returned: 0 in 0.340s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4c632914-4870-47e4-b2ff-3c854c0d1552 tempest-SnapshotsActionsTest-1472833697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.169s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:25:32 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-4c632914-4870-47e4-b2ff-3c854c0d1552 tempest-SnapshotsActionsTest-1472833697 None] Create snapshot completed successfully Jul 16 23:25:33 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6a3107cf-a5ff-47ce-bea9-492f0657d732 tempest-SnapshotsActionsTest-1653615379 None] Acquiring lock "cinder-2f486e97-6401-461d-86b6-3940a671843d-delete_snapshot" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:25:33 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6a3107cf-a5ff-47ce-bea9-492f0657d732 tempest-SnapshotsActionsTest-1653615379 None] Lock "cinder-2f486e97-6401-461d-86b6-3940a671843d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:25:33 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6a3107cf-a5ff-47ce-bea9-492f0657d732 tempest-SnapshotsActionsTest-1653615379 None] Acquiring lock "cinder-quobyte-72b027d3-aecd-4c9d-918c-533f835c7b3e" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:25:33 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6a3107cf-a5ff-47ce-bea9-492f0657d732 tempest-SnapshotsActionsTest-1653615379 None] Lock "cinder-quobyte-72b027d3-aecd-4c9d-918c-533f835c7b3e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:25:33 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6a3107cf-a5ff-47ce-bea9-492f0657d732 tempest-SnapshotsActionsTest-1653615379 None] Acquiring lock "cinder-quobyte-2f486e97-6401-461d-86b6-3940a671843d" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:25:33 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6a3107cf-a5ff-47ce-bea9-492f0657d732 tempest-SnapshotsActionsTest-1653615379 None] Lock "cinder-quobyte-2f486e97-6401-461d-86b6-3940a671843d" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:25:33 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-6a3107cf-a5ff-47ce-bea9-492f0657d732 tempest-SnapshotsActionsTest-1653615379 None] Deleting offline snapshot 2f486e97-6401-461d-86b6-3940a671843d of volume 72b027d3-aecd-4c9d-918c-533f835c7b3e {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:25:33 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-6a3107cf-a5ff-47ce-bea9-492f0657d732 tempest-SnapshotsActionsTest-1653615379 None] snapshot_file for this snap is: volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.2f486e97-6401-461d-86b6-3940a671843d {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:25:33 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9760e08-e287-49e1-8ae5-a7baf03cbcfa]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:25:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6a3107cf-a5ff-47ce-bea9-492f0657d732 tempest-SnapshotsActionsTest-1653615379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.2f486e97-6401-461d-86b6-3940a671843d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:33 devstack sudo[97683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.2f486e97-6401-461d-86b6-3940a671843d Jul 16 23:25:33 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:33 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6a3107cf-a5ff-47ce-bea9-492f0657d732 tempest-SnapshotsActionsTest-1653615379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.2f486e97-6401-461d-86b6-3940a671843d" returned: 0 in 0.467s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:33 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-6a3107cf-a5ff-47ce-bea9-492f0657d732 tempest-SnapshotsActionsTest-1653615379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b027d3-aecd-4c9d-918c-533f835c7b3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:25:33 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e8cf96-62fa-4b94-8afa-8de768d958ab]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:25:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6a3107cf-a5ff-47ce-bea9-492f0657d732 tempest-SnapshotsActionsTest-1653615379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:34 devstack sudo[97708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee Jul 16 23:25:34 devstack sudo[97708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:34 devstack sudo[97708]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:34 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6a3107cf-a5ff-47ce-bea9-492f0657d732 tempest-SnapshotsActionsTest-1653615379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee" returned: 0 in 0.466s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:34 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-6a3107cf-a5ff-47ce-bea9-492f0657d732 tempest-SnapshotsActionsTest-1653615379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b027d3-aecd-4c9d-918c-533f835c7b3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:25:34 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6a3107cf-a5ff-47ce-bea9-492f0657d732 tempest-SnapshotsActionsTest-1653615379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.2f486e97-6401-461d-86b6-3940a671843d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:34 devstack sudo[97749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.2f486e97-6401-461d-86b6-3940a671843d Jul 16 23:25:34 devstack sudo[97749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:35 devstack sudo[97749]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6a3107cf-a5ff-47ce-bea9-492f0657d732 tempest-SnapshotsActionsTest-1653615379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.2f486e97-6401-461d-86b6-3940a671843d" returned: 0 in 0.576s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6a3107cf-a5ff-47ce-bea9-492f0657d732 tempest-SnapshotsActionsTest-1653615379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.2f486e97-6401-461d-86b6-3940a671843d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:35 devstack sudo[97761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.2f486e97-6401-461d-86b6-3940a671843d Jul 16 23:25:35 devstack sudo[97761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:35 devstack sudo[97761]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6a3107cf-a5ff-47ce-bea9-492f0657d732 tempest-SnapshotsActionsTest-1653615379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.2f486e97-6401-461d-86b6-3940a671843d" returned: 0 in 0.386s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:35 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6a3107cf-a5ff-47ce-bea9-492f0657d732 tempest-SnapshotsActionsTest-1653615379 None] Lock "cinder-quobyte-2f486e97-6401-461d-86b6-3940a671843d" released by "_delete_snapshot" :: held 2.075s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:25:35 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6a3107cf-a5ff-47ce-bea9-492f0657d732 tempest-SnapshotsActionsTest-1653615379 None] Lock "cinder-quobyte-72b027d3-aecd-4c9d-918c-533f835c7b3e" released by "delete_snapshot" :: held 2.131s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:25:35 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-6a3107cf-a5ff-47ce-bea9-492f0657d732 tempest-SnapshotsActionsTest-1653615379 None] Created reservations ['d2b944ba-2595-4019-90ba-bf8696fce8dc', '23f41439-5955-4eee-91b8-ec5c2677a8ac', '4d6b3201-6eea-4850-beea-a31c80bde554', '5be75723-f5ad-4e9f-9941-b2fad46ac1d2'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:25:35 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-6a3107cf-a5ff-47ce-bea9-492f0657d732 tempest-SnapshotsActionsTest-1653615379 None] Delete snapshot completed successfully. Jul 16 23:25:35 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6a3107cf-a5ff-47ce-bea9-492f0657d732 tempest-SnapshotsActionsTest-1653615379 None] Lock "cinder-2f486e97-6401-461d-86b6-3940a671843d-delete_snapshot" released by "delete_snapshot" :: held 2.369s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:25:37 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f293883d-3d63-4fbd-ac69-b6050d012c51 tempest-SnapshotsActionsTest-1472833697 None] Acquiring lock "cinder-d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee-delete_snapshot" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:25:37 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f293883d-3d63-4fbd-ac69-b6050d012c51 tempest-SnapshotsActionsTest-1472833697 None] Lock "cinder-d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:25:37 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f293883d-3d63-4fbd-ac69-b6050d012c51 tempest-SnapshotsActionsTest-1472833697 None] Acquiring lock "cinder-quobyte-72b027d3-aecd-4c9d-918c-533f835c7b3e" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:25:37 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f293883d-3d63-4fbd-ac69-b6050d012c51 tempest-SnapshotsActionsTest-1472833697 None] Lock "cinder-quobyte-72b027d3-aecd-4c9d-918c-533f835c7b3e" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:25:37 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f293883d-3d63-4fbd-ac69-b6050d012c51 tempest-SnapshotsActionsTest-1472833697 None] Acquiring lock "cinder-quobyte-d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:25:37 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f293883d-3d63-4fbd-ac69-b6050d012c51 tempest-SnapshotsActionsTest-1472833697 None] Lock "cinder-quobyte-d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:25:37 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-f293883d-3d63-4fbd-ac69-b6050d012c51 tempest-SnapshotsActionsTest-1472833697 None] Deleting offline snapshot d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee of volume 72b027d3-aecd-4c9d-918c-533f835c7b3e {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:25:37 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-f293883d-3d63-4fbd-ac69-b6050d012c51 tempest-SnapshotsActionsTest-1472833697 None] snapshot_file for this snap is: volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:25:37 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d893188-f407-41da-8502-2a0b37c17021]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:25:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f293883d-3d63-4fbd-ac69-b6050d012c51 tempest-SnapshotsActionsTest-1472833697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:37 devstack sudo[97771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee Jul 16 23:25:37 devstack sudo[97771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:38 devstack sudo[97771]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f293883d-3d63-4fbd-ac69-b6050d012c51 tempest-SnapshotsActionsTest-1472833697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee" returned: 0 in 0.708s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:38 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-f293883d-3d63-4fbd-ac69-b6050d012c51 tempest-SnapshotsActionsTest-1472833697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b027d3-aecd-4c9d-918c-533f835c7b3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:25:38 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[f761b7a7-0206-4a5a-997e-29c2b5d0f5ba]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:25:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f293883d-3d63-4fbd-ac69-b6050d012c51 tempest-SnapshotsActionsTest-1472833697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:38 devstack sudo[97788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e Jul 16 23:25:38 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:38 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f293883d-3d63-4fbd-ac69-b6050d012c51 tempest-SnapshotsActionsTest-1472833697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e" returned: 0 in 0.579s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f293883d-3d63-4fbd-ac69-b6050d012c51 tempest-SnapshotsActionsTest-1472833697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:38 devstack sudo[97794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee Jul 16 23:25:38 devstack sudo[97794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:38 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-053e0e9b-1809-4918-b7b4-b68902a8aadf tempest-VolumesSnapshotListTestJSON-279322147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:25:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-053e0e9b-1809-4918-b7b4-b68902a8aadf tempest-VolumesSnapshotListTestJSON-279322147 None] Flow 'volume_create_manager' (7fb11034-c34f-43ca-b4f3-1698dd7cd597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:25:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-053e0e9b-1809-4918-b7b4-b68902a8aadf tempest-VolumesSnapshotListTestJSON-279322147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (491f0042-806f-4ded-a1e2-cdf45540c93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:25:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-053e0e9b-1809-4918-b7b4-b68902a8aadf tempest-VolumesSnapshotListTestJSON-279322147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (491f0042-806f-4ded-a1e2-cdf45540c93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:25:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-945074810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=821f3599-9b67-419d-864f-7274e62ff31c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f2946b5255b47ed93aa86f28a2c7624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:25:39Z,use_quota=True,user_id='ede8baa7eaac46169658470a7ca948e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:25:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-053e0e9b-1809-4918-b7b4-b68902a8aadf tempest-VolumesSnapshotListTestJSON-279322147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e49ec698-7185-453a-9e8b-53a2e7382cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:25:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-053e0e9b-1809-4918-b7b4-b68902a8aadf tempest-VolumesSnapshotListTestJSON-279322147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e49ec698-7185-453a-9e8b-53a2e7382cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:25:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-053e0e9b-1809-4918-b7b4-b68902a8aadf tempest-VolumesSnapshotListTestJSON-279322147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2730a083-0c98-43ab-8d22-904f04a9f714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:25:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-053e0e9b-1809-4918-b7b4-b68902a8aadf tempest-VolumesSnapshotListTestJSON-279322147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2730a083-0c98-43ab-8d22-904f04a9f714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '821f3599-9b67-419d-864f-7274e62ff31c', 'volume_name': 'volume-821f3599-9b67-419d-864f-7274e62ff31c', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:25:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-053e0e9b-1809-4918-b7b4-b68902a8aadf tempest-VolumesSnapshotListTestJSON-279322147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fdd1d3d-c55e-42d2-8bc0-80c9c18e3240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:25:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-053e0e9b-1809-4918-b7b4-b68902a8aadf tempest-VolumesSnapshotListTestJSON-279322147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fdd1d3d-c55e-42d2-8bc0-80c9c18e3240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:25:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-053e0e9b-1809-4918-b7b4-b68902a8aadf tempest-VolumesSnapshotListTestJSON-279322147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ab1aefd-ce83-463e-9a14-af9443759360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:25:38 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-053e0e9b-1809-4918-b7b4-b68902a8aadf tempest-VolumesSnapshotListTestJSON-279322147 None] Volume 821f3599-9b67-419d-864f-7274e62ff31c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-821f3599-9b67-419d-864f-7274e62ff31c', 'volume_size': 1} Jul 16 23:25:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-053e0e9b-1809-4918-b7b4-b68902a8aadf tempest-VolumesSnapshotListTestJSON-279322147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:25:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-053e0e9b-1809-4918-b7b4-b68902a8aadf tempest-VolumesSnapshotListTestJSON-279322147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:25:38 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-053e0e9b-1809-4918-b7b4-b68902a8aadf tempest-VolumesSnapshotListTestJSON-279322147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:25:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-945074810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=821f3599-9b67-419d-864f-7274e62ff31c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f2946b5255b47ed93aa86f28a2c7624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:25:39Z,use_quota=True,user_id='ede8baa7eaac46169658470a7ca948e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:25:38 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-053e0e9b-1809-4918-b7b4-b68902a8aadf tempest-VolumesSnapshotListTestJSON-279322147 None] Creating volume 821f3599-9b67-419d-864f-7274e62ff31c {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:25:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-053e0e9b-1809-4918-b7b4-b68902a8aadf tempest-VolumesSnapshotListTestJSON-279322147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:25:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-053e0e9b-1809-4918-b7b4-b68902a8aadf tempest-VolumesSnapshotListTestJSON-279322147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:25:38 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-053e0e9b-1809-4918-b7b4-b68902a8aadf tempest-VolumesSnapshotListTestJSON-279322147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:25:38 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-053e0e9b-1809-4918-b7b4-b68902a8aadf tempest-VolumesSnapshotListTestJSON-279322147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:25:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-053e0e9b-1809-4918-b7b4-b68902a8aadf tempest-VolumesSnapshotListTestJSON-279322147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:25:38 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-053e0e9b-1809-4918-b7b4-b68902a8aadf tempest-VolumesSnapshotListTestJSON-279322147 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:25:38 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-053e0e9b-1809-4918-b7b4-b68902a8aadf tempest-VolumesSnapshotListTestJSON-279322147 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:25:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-053e0e9b-1809-4918-b7b4-b68902a8aadf tempest-VolumesSnapshotListTestJSON-279322147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:39 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c 1073741824 Jul 16 23:25:39 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:39 devstack sudo[97794]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f293883d-3d63-4fbd-ac69-b6050d012c51 tempest-SnapshotsActionsTest-1472833697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee" returned: 0 in 0.462s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f293883d-3d63-4fbd-ac69-b6050d012c51 tempest-SnapshotsActionsTest-1472833697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:39 devstack sudo[97802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee Jul 16 23:25:39 devstack sudo[97802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:39 devstack cinder-volume[87607]: DEBUG oslo_service.periodic_task [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:25:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:25:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:25:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:25:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:25:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:25:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:39 devstack sudo[97808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:25:39 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:39 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-053e0e9b-1809-4918-b7b4-b68902a8aadf tempest-VolumesSnapshotListTestJSON-279322147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c 1073741824" returned: 0 in 0.588s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:39 devstack sudo[97802]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f293883d-3d63-4fbd-ac69-b6050d012c51 tempest-SnapshotsActionsTest-1472833697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e.d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee" returned: 0 in 0.376s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-053e0e9b-1809-4918-b7b4-b68902a8aadf tempest-VolumesSnapshotListTestJSON-279322147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:39 devstack sudo[97811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c Jul 16 23:25:39 devstack sudo[97811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:39 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f293883d-3d63-4fbd-ac69-b6050d012c51 tempest-SnapshotsActionsTest-1472833697 None] Lock "cinder-quobyte-d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee" released by "_delete_snapshot" :: held 2.353s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:25:39 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f293883d-3d63-4fbd-ac69-b6050d012c51 tempest-SnapshotsActionsTest-1472833697 None] Lock "cinder-quobyte-72b027d3-aecd-4c9d-918c-533f835c7b3e" released by "delete_snapshot" :: held 2.384s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:25:39 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-f293883d-3d63-4fbd-ac69-b6050d012c51 tempest-SnapshotsActionsTest-1472833697 None] Created reservations ['468eb038-a69c-40c8-be82-a8724f1386fa', '62b882e3-760b-4e1a-a799-3f9ec30fcfd8', '4b008d79-24d3-4e8a-8302-b07a1a08241d', 'afe63eab-a7c6-4059-a630-2b0d318a4189'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:25:39 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.381s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:39 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:25:39 devstack cinder-volume[87607]: DEBUG oslo_service.periodic_task [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running periodic task VolumeManager._thread_info {{(pid=87607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:25:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] thread count: 28 {{(pid=87607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 23:25:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] thread info: [<_MainThread(MainThread, started 139090403627136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 23:25:39 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-f293883d-3d63-4fbd-ac69-b6050d012c51 tempest-SnapshotsActionsTest-1472833697 None] Delete snapshot completed successfully. Jul 16 23:25:39 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f293883d-3d63-4fbd-ac69-b6050d012c51 tempest-SnapshotsActionsTest-1472833697 None] Lock "cinder-d89c9a18-cc7b-4ef7-b48f-b52250cdc0ee-delete_snapshot" released by "delete_snapshot" :: held 2.625s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:25:39 devstack sudo[97811]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-053e0e9b-1809-4918-b7b4-b68902a8aadf tempest-VolumesSnapshotListTestJSON-279322147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c" returned: 0 in 0.318s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-053e0e9b-1809-4918-b7b4-b68902a8aadf tempest-VolumesSnapshotListTestJSON-279322147 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:25:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-053e0e9b-1809-4918-b7b4-b68902a8aadf tempest-VolumesSnapshotListTestJSON-279322147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:25:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-053e0e9b-1809-4918-b7b4-b68902a8aadf tempest-VolumesSnapshotListTestJSON-279322147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ab1aefd-ce83-463e-9a14-af9443759360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-821f3599-9b67-419d-864f-7274e62ff31c', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:25:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-053e0e9b-1809-4918-b7b4-b68902a8aadf tempest-VolumesSnapshotListTestJSON-279322147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd6fdf19-5ef4-4191-992f-f50d68fce323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:25:39 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-053e0e9b-1809-4918-b7b4-b68902a8aadf tempest-VolumesSnapshotListTestJSON-279322147 None] Volume volume-821f3599-9b67-419d-864f-7274e62ff31c (821f3599-9b67-419d-864f-7274e62ff31c): created successfully Jul 16 23:25:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-053e0e9b-1809-4918-b7b4-b68902a8aadf tempest-VolumesSnapshotListTestJSON-279322147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd6fdf19-5ef4-4191-992f-f50d68fce323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:25:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-053e0e9b-1809-4918-b7b4-b68902a8aadf tempest-VolumesSnapshotListTestJSON-279322147 None] Flow 'volume_create_manager' (7fb11034-c34f-43ca-b4f3-1698dd7cd597) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:25:39 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-053e0e9b-1809-4918-b7b4-b68902a8aadf tempest-VolumesSnapshotListTestJSON-279322147 None] Created volume successfully. Jul 16 23:25:40 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-3dbd8491-8942-4f49-b9cb-ee71d902f388 tempest-SnapshotsActionsTest-1472833697 None] Acquiring lock "cinder-72b027d3-aecd-4c9d-918c-533f835c7b3e-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:25:40 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-3dbd8491-8942-4f49-b9cb-ee71d902f388 tempest-SnapshotsActionsTest-1472833697 None] Lock "cinder-72b027d3-aecd-4c9d-918c-533f835c7b3e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:25:40 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-3dbd8491-8942-4f49-b9cb-ee71d902f388 tempest-SnapshotsActionsTest-1472833697 None] Acquiring lock "cinder-quobyte-72b027d3-aecd-4c9d-918c-533f835c7b3e" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:25:40 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-3dbd8491-8942-4f49-b9cb-ee71d902f388 tempest-SnapshotsActionsTest-1472833697 None] Lock "cinder-quobyte-72b027d3-aecd-4c9d-918c-533f835c7b3e" acquired by "delete_volume" :: waited 0.053s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:25:41 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[464b6fac-6e39-4edc-a15a-a1cad6c5553c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:25:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3dbd8491-8942-4f49-b9cb-ee71d902f388 tempest-SnapshotsActionsTest-1472833697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:41 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:25:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Flow 'volume_create_manager' (97106563-4bbc-4909-9de0-64c548311948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:25:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab6086fd-f74b-4c40-90c6-db6304da2fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:25:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab6086fd-f74b-4c40-90c6-db6304da2fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1552114170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=244186ea-b0f6-4e65-aea7-5ab476896725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4018fa749d0459b8ccced22c123bcb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d825ced7-1eb3-4c3b-85ca-324c41ab3d57,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:25:41Z,use_quota=True,user_id='d0b94e0d8df14fc1ae9945508d99870d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:25:41 devstack sudo[97848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e Jul 16 23:25:41 devstack sudo[97848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c38b99bf-f88e-445b-ba8e-6595b4fa94d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:25:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c38b99bf-f88e-445b-ba8e-6595b4fa94d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:25:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07faaf8e-7f03-4ffe-95c0-a4c4ae78c447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:25:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07faaf8e-7f03-4ffe-95c0-a4c4ae78c447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '244186ea-b0f6-4e65-aea7-5ab476896725', 'volume_name': 'volume-244186ea-b0f6-4e65-aea7-5ab476896725', 'volume_size': 1, 'snapshot_id': 'd825ced7-1eb3-4c3b-85ca-324c41ab3d57'}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:25:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ebdd012-4447-454c-addd-e0d4b72900b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:25:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ebdd012-4447-454c-addd-e0d4b72900b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:25:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (967cb4c5-4802-4e87-b3f6-6b40f75e6636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:25:41 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Volume 244186ea-b0f6-4e65-aea7-5ab476896725: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-244186ea-b0f6-4e65-aea7-5ab476896725', 'volume_size': 1, 'snapshot_id': 'd825ced7-1eb3-4c3b-85ca-324c41ab3d57'} Jul 16 23:25:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:25:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:25:41 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Acquiring lock "cinder-quobyte-d825ced7-1eb3-4c3b-85ca-324c41ab3d57-244186ea-b0f6-4e65-aea7-5ab476896725" by "_create_volume_from_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:25:41 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Lock "cinder-quobyte-d825ced7-1eb3-4c3b-85ca-324c41ab3d57-244186ea-b0f6-4e65-aea7-5ab476896725" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:25:41 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Creating volume 244186ea-b0f6-4e65-aea7-5ab476896725 from snapshot d825ced7-1eb3-4c3b-85ca-324c41ab3d57 {{(pid=87607) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 16 23:25:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:25:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:25:41 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:25:41 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:25:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:25:41 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:25:41 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Acquiring lock "cinder-quobyte-244186ea-b0f6-4e65-aea7-5ab476896725" by "_copy_volume_from_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:25:41 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Lock "cinder-quobyte-244186ea-b0f6-4e65-aea7-5ab476896725" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:25:41 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] snapshot: d825ced7-1eb3-4c3b-85ca-324c41ab3d57, volume: 244186ea-b0f6-4e65-aea7-5ab476896725, {{(pid=87607) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 16 23:25:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:25:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:25:41 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:25:41 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:25:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:25:41 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[660731ed-31b5-4896-9c56-3f16aff42f5d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:25:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7.d825ced7-1eb3-4c3b-85ca-324c41ab3d57 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c8b6f457-6c66-4178-b8f9-8fb68159156f tempest-VolumesSnapshotListTestJSON-279322147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:25:41 devstack sudo[97857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7.d825ced7-1eb3-4c3b-85ca-324c41ab3d57 Jul 16 23:25:41 devstack sudo[97857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:41 devstack sudo[97848]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3dbd8491-8942-4f49-b9cb-ee71d902f388 tempest-SnapshotsActionsTest-1472833697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e" returned: 0 in 0.803s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3dbd8491-8942-4f49-b9cb-ee71d902f388 tempest-SnapshotsActionsTest-1472833697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:41 devstack sudo[97862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e Jul 16 23:25:41 devstack sudo[97862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:42 devstack sudo[97857]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7.d825ced7-1eb3-4c3b-85ca-324c41ab3d57" returned: 0 in 0.635s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:42 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2a74ad6-9996-4227-936e-f93dcce122a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:25:42 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7 {{(pid=87607) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 16 23:25:42 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Creating direct copy from snapshot {{(pid=87607) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 16 23:25:42 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[7944a9d4-ad61-4536-af76-6ddd42868579]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:25:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:42 devstack sudo[97862]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3dbd8491-8942-4f49-b9cb-ee71d902f388 tempest-SnapshotsActionsTest-1472833697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72b027d3-aecd-4c9d-918c-533f835c7b3e" returned: 0 in 0.395s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:42 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-3dbd8491-8942-4f49-b9cb-ee71d902f388 tempest-SnapshotsActionsTest-1472833697 None] Lock "cinder-quobyte-72b027d3-aecd-4c9d-918c-533f835c7b3e" released by "delete_volume" :: held 1.386s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:25:42 devstack sudo[97870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7 Jul 16 23:25:42 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:42 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-3dbd8491-8942-4f49-b9cb-ee71d902f388 tempest-SnapshotsActionsTest-1472833697 None] Created reservations ['3a1263c8-2b48-46f5-92cc-56093fe3851b', '12d08526-9e40-4236-8a27-8972ded54f0a', '1baa4216-4029-49b3-890d-b0430cfb6710', '0bf7dc41-ea4a-4f6d-b6ba-0d90414a3fac'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:25:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3dbd8491-8942-4f49-b9cb-ee71d902f388 tempest-SnapshotsActionsTest-1472833697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:25:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3dbd8491-8942-4f49-b9cb-ee71d902f388 tempest-SnapshotsActionsTest-1472833697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:25:42 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3dbd8491-8942-4f49-b9cb-ee71d902f388 tempest-SnapshotsActionsTest-1472833697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:25:42 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3dbd8491-8942-4f49-b9cb-ee71d902f388 tempest-SnapshotsActionsTest-1472833697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:25:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3dbd8491-8942-4f49-b9cb-ee71d902f388 tempest-SnapshotsActionsTest-1472833697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:25:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3dbd8491-8942-4f49-b9cb-ee71d902f388 tempest-SnapshotsActionsTest-1472833697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:42 devstack sudo[97879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:25:42 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:43 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7" returned: 0 in 0.857s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:43 devstack cinder-volume[87607]: DEBUG cinder.utils [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Path /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-244186ea-b0f6-4e65-aea7-5ab476896725 not found in is_blk_device check {{(pid=87607) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 16 23:25:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-244186ea-b0f6-4e65-aea7-5ab476896725 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:43 devstack sudo[97882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-244186ea-b0f6-4e65-aea7-5ab476896725 Jul 16 23:25:43 devstack sudo[97882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:43 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3dbd8491-8942-4f49-b9cb-ee71d902f388 tempest-SnapshotsActionsTest-1472833697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.519s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:43 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-3dbd8491-8942-4f49-b9cb-ee71d902f388 tempest-SnapshotsActionsTest-1472833697 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:25:43 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-3dbd8491-8942-4f49-b9cb-ee71d902f388 tempest-SnapshotsActionsTest-1472833697 None] Deleted volume successfully. Jul 16 23:25:43 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-3dbd8491-8942-4f49-b9cb-ee71d902f388 tempest-SnapshotsActionsTest-1472833697 None] Lock "cinder-72b027d3-aecd-4c9d-918c-533f835c7b3e-delete_volume" released by "delete_volume" :: held 2.685s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:25:51 devstack sudo[97882]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-244186ea-b0f6-4e65-aea7-5ab476896725" returned: 0 in 7.961s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:51 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bec1e1c-5e85-423b-8805-497dfe9d071c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:25:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:51 devstack sudo[97932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7 Jul 16 23:25:51 devstack sudo[97932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:52 devstack sudo[97932]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7" returned: 0 in 1.060s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:52 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Image conversion details: src /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7, size 1024.00 MB, duration 7.96 sec, destination /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-244186ea-b0f6-4e65-aea7-5ab476896725 {{(pid=87607) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 23:25:52 devstack cinder-volume[87607]: INFO cinder.image.image_utils [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Converted 1024.00 MB image at 128.61 MB/s Jul 16 23:25:52 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-244186ea-b0f6-4e65-aea7-5ab476896725 is being set with open permissions: ugo+rw Jul 16 23:25:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-244186ea-b0f6-4e65-aea7-5ab476896725 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:52 devstack sudo[97938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-244186ea-b0f6-4e65-aea7-5ab476896725 Jul 16 23:25:52 devstack sudo[97938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:52 devstack sudo[97938]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-244186ea-b0f6-4e65-aea7-5ab476896725" returned: 0 in 0.556s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:52 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Lock "cinder-quobyte-244186ea-b0f6-4e65-aea7-5ab476896725" released by "_copy_volume_from_snapshot" :: held 11.301s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:25:52 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Lock "cinder-quobyte-d825ced7-1eb3-4c3b-85ca-324c41ab3d57-244186ea-b0f6-4e65-aea7-5ab476896725" released by "_create_volume_from_snapshot" :: held 11.366s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:25:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.394s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:25:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c8b6f457-6c66-4178-b8f9-8fb68159156f tempest-VolumesSnapshotListTestJSON-279322147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.012s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:25:52 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-c8b6f457-6c66-4178-b8f9-8fb68159156f tempest-VolumesSnapshotListTestJSON-279322147 None] Creating offline snapshot 75e7783a-d92f-496e-912a-15111af72d28 of volume 821f3599-9b67-419d-864f-7274e62ff31c {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:25:52 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f21920-7b2c-4073-a1fa-bd59da6d7bd8]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:25:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c8b6f457-6c66-4178-b8f9-8fb68159156f tempest-VolumesSnapshotListTestJSON-279322147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:52 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (967cb4c5-4802-4e87-b3f6-6b40f75e6636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-244186ea-b0f6-4e65-aea7-5ab476896725', 'volume_size': 1, 'snapshot_id': 'd825ced7-1eb3-4c3b-85ca-324c41ab3d57'}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:25:53 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d054080a-87dc-4ce2-99e1-ff9381499bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:25:53 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Volume volume-244186ea-b0f6-4e65-aea7-5ab476896725 (244186ea-b0f6-4e65-aea7-5ab476896725): created successfully Jul 16 23:25:53 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d054080a-87dc-4ce2-99e1-ff9381499bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:25:53 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Flow 'volume_create_manager' (97106563-4bbc-4909-9de0-64c548311948) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:25:53 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-b1bf8fbc-6f79-445a-b51f-f7bd7c6a1976 tempest-TestStampPattern-699542814 None] Created volume successfully. Jul 16 23:25:53 devstack sudo[97953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c Jul 16 23:25:53 devstack sudo[97953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:53 devstack sudo[97953]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c8b6f457-6c66-4178-b8f9-8fb68159156f tempest-VolumesSnapshotListTestJSON-279322147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c" returned: 0 in 0.754s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c8b6f457-6c66-4178-b8f9-8fb68159156f tempest-VolumesSnapshotListTestJSON-279322147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.75e7783a-d92f-496e-912a-15111af72d28 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:53 devstack sudo[97964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.75e7783a-d92f-496e-912a-15111af72d28 1G Jul 16 23:25:53 devstack sudo[97964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:54 devstack sudo[97964]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c8b6f457-6c66-4178-b8f9-8fb68159156f tempest-VolumesSnapshotListTestJSON-279322147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.75e7783a-d92f-496e-912a-15111af72d28 1G" returned: 0 in 1.186s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c8b6f457-6c66-4178-b8f9-8fb68159156f tempest-VolumesSnapshotListTestJSON-279322147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-821f3599-9b67-419d-864f-7274e62ff31c -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.75e7783a-d92f-496e-912a-15111af72d28 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:54 devstack sudo[97999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-821f3599-9b67-419d-864f-7274e62ff31c -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.75e7783a-d92f-496e-912a-15111af72d28 Jul 16 23:25:54 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:55 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c8b6f457-6c66-4178-b8f9-8fb68159156f tempest-VolumesSnapshotListTestJSON-279322147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-821f3599-9b67-419d-864f-7274e62ff31c -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.75e7783a-d92f-496e-912a-15111af72d28" returned: 0 in 0.666s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:55 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-c8b6f457-6c66-4178-b8f9-8fb68159156f tempest-VolumesSnapshotListTestJSON-279322147 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.75e7783a-d92f-496e-912a-15111af72d28 is being set with open permissions: ugo+rw Jul 16 23:25:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c8b6f457-6c66-4178-b8f9-8fb68159156f tempest-VolumesSnapshotListTestJSON-279322147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.75e7783a-d92f-496e-912a-15111af72d28 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:55 devstack sudo[98008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.75e7783a-d92f-496e-912a-15111af72d28 Jul 16 23:25:55 devstack sudo[98008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:55 devstack sudo[98008]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c8b6f457-6c66-4178-b8f9-8fb68159156f tempest-VolumesSnapshotListTestJSON-279322147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.75e7783a-d92f-496e-912a-15111af72d28" returned: 0 in 0.390s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c8b6f457-6c66-4178-b8f9-8fb68159156f tempest-VolumesSnapshotListTestJSON-279322147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:56 devstack sudo[98013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.info Jul 16 23:25:56 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:56 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c8b6f457-6c66-4178-b8f9-8fb68159156f tempest-VolumesSnapshotListTestJSON-279322147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.info" returned: 0 in 0.645s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:56 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-c8b6f457-6c66-4178-b8f9-8fb68159156f tempest-VolumesSnapshotListTestJSON-279322147 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.info is being set with open permissions: ugo+rw Jul 16 23:25:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c8b6f457-6c66-4178-b8f9-8fb68159156f tempest-VolumesSnapshotListTestJSON-279322147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:56 devstack sudo[98051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.info Jul 16 23:25:56 devstack sudo[98051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:57 devstack sudo[98051]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c8b6f457-6c66-4178-b8f9-8fb68159156f tempest-VolumesSnapshotListTestJSON-279322147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.info" returned: 0 in 0.447s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c8b6f457-6c66-4178-b8f9-8fb68159156f tempest-VolumesSnapshotListTestJSON-279322147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.339s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:25:57 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-c8b6f457-6c66-4178-b8f9-8fb68159156f tempest-VolumesSnapshotListTestJSON-279322147 None] Create snapshot completed successfully Jul 16 23:25:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-89ce8e26-8a50-4460-87e8-d9e7f3e5e735 tempest-VolumesSnapshotListTestJSON-279322147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:25:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-89ce8e26-8a50-4460-87e8-d9e7f3e5e735 tempest-VolumesSnapshotListTestJSON-279322147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:25:58 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-89ce8e26-8a50-4460-87e8-d9e7f3e5e735 tempest-VolumesSnapshotListTestJSON-279322147 None] Creating offline snapshot 310f2c25-ddf0-43f1-b9f6-b08fdf307230 of volume 821f3599-9b67-419d-864f-7274e62ff31c {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:25:58 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fdad73-4654-47e3-b333-66c72a3902b5]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:25:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-89ce8e26-8a50-4460-87e8-d9e7f3e5e735 tempest-VolumesSnapshotListTestJSON-279322147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.75e7783a-d92f-496e-912a-15111af72d28 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:58 devstack sudo[98078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.75e7783a-d92f-496e-912a-15111af72d28 Jul 16 23:25:58 devstack sudo[98078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:58 devstack sudo[98078]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-89ce8e26-8a50-4460-87e8-d9e7f3e5e735 tempest-VolumesSnapshotListTestJSON-279322147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.75e7783a-d92f-496e-912a-15111af72d28" returned: 0 in 0.426s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:58 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-89ce8e26-8a50-4460-87e8-d9e7f3e5e735 tempest-VolumesSnapshotListTestJSON-279322147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-821f3599-9b67-419d-864f-7274e62ff31c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:25:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-89ce8e26-8a50-4460-87e8-d9e7f3e5e735 tempest-VolumesSnapshotListTestJSON-279322147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.75e7783a-d92f-496e-912a-15111af72d28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.310f2c25-ddf0-43f1-b9f6-b08fdf307230 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:58 devstack sudo[98084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.75e7783a-d92f-496e-912a-15111af72d28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.310f2c25-ddf0-43f1-b9f6-b08fdf307230 1G Jul 16 23:25:58 devstack sudo[98084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:25:59 devstack sudo[98084]: pam_unix(sudo:session): session closed for user root Jul 16 23:25:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-89ce8e26-8a50-4460-87e8-d9e7f3e5e735 tempest-VolumesSnapshotListTestJSON-279322147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.75e7783a-d92f-496e-912a-15111af72d28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.310f2c25-ddf0-43f1-b9f6-b08fdf307230 1G" returned: 0 in 0.778s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:25:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-89ce8e26-8a50-4460-87e8-d9e7f3e5e735 tempest-VolumesSnapshotListTestJSON-279322147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-821f3599-9b67-419d-864f-7274e62ff31c.75e7783a-d92f-496e-912a-15111af72d28 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.310f2c25-ddf0-43f1-b9f6-b08fdf307230 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:25:59 devstack sudo[98090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-821f3599-9b67-419d-864f-7274e62ff31c.75e7783a-d92f-496e-912a-15111af72d28 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.310f2c25-ddf0-43f1-b9f6-b08fdf307230 Jul 16 23:25:59 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:00 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-89ce8e26-8a50-4460-87e8-d9e7f3e5e735 tempest-VolumesSnapshotListTestJSON-279322147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-821f3599-9b67-419d-864f-7274e62ff31c.75e7783a-d92f-496e-912a-15111af72d28 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.310f2c25-ddf0-43f1-b9f6-b08fdf307230" returned: 0 in 0.385s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:00 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-89ce8e26-8a50-4460-87e8-d9e7f3e5e735 tempest-VolumesSnapshotListTestJSON-279322147 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.310f2c25-ddf0-43f1-b9f6-b08fdf307230 is being set with open permissions: ugo+rw Jul 16 23:26:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-89ce8e26-8a50-4460-87e8-d9e7f3e5e735 tempest-VolumesSnapshotListTestJSON-279322147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.310f2c25-ddf0-43f1-b9f6-b08fdf307230 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:00 devstack sudo[98096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.310f2c25-ddf0-43f1-b9f6-b08fdf307230 Jul 16 23:26:00 devstack sudo[98096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:00 devstack sudo[98096]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-89ce8e26-8a50-4460-87e8-d9e7f3e5e735 tempest-VolumesSnapshotListTestJSON-279322147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.310f2c25-ddf0-43f1-b9f6-b08fdf307230" returned: 0 in 0.405s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-89ce8e26-8a50-4460-87e8-d9e7f3e5e735 tempest-VolumesSnapshotListTestJSON-279322147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.136s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:26:00 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-89ce8e26-8a50-4460-87e8-d9e7f3e5e735 tempest-VolumesSnapshotListTestJSON-279322147 None] Create snapshot completed successfully Jul 16 23:26:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bb1dfa4c-ec0c-4b58-9784-7e15cb9da94d tempest-VolumesSnapshotListTestJSON-279322147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:26:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bb1dfa4c-ec0c-4b58-9784-7e15cb9da94d tempest-VolumesSnapshotListTestJSON-279322147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:26:01 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-bb1dfa4c-ec0c-4b58-9784-7e15cb9da94d tempest-VolumesSnapshotListTestJSON-279322147 None] Creating offline snapshot 2312ae67-d95f-4864-8da2-6f5942b9688d of volume 821f3599-9b67-419d-864f-7274e62ff31c {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:26:01 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[c440dcf6-df2b-4154-b4a2-d6f69f727e25]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:26:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bb1dfa4c-ec0c-4b58-9784-7e15cb9da94d tempest-VolumesSnapshotListTestJSON-279322147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.310f2c25-ddf0-43f1-b9f6-b08fdf307230 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:02 devstack sudo[98100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.310f2c25-ddf0-43f1-b9f6-b08fdf307230 Jul 16 23:26:02 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:02 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bb1dfa4c-ec0c-4b58-9784-7e15cb9da94d tempest-VolumesSnapshotListTestJSON-279322147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.310f2c25-ddf0-43f1-b9f6-b08fdf307230" returned: 0 in 0.695s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:02 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-bb1dfa4c-ec0c-4b58-9784-7e15cb9da94d tempest-VolumesSnapshotListTestJSON-279322147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-821f3599-9b67-419d-864f-7274e62ff31c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:26:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bb1dfa4c-ec0c-4b58-9784-7e15cb9da94d tempest-VolumesSnapshotListTestJSON-279322147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.310f2c25-ddf0-43f1-b9f6-b08fdf307230,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.2312ae67-d95f-4864-8da2-6f5942b9688d 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:02 devstack sudo[98108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.310f2c25-ddf0-43f1-b9f6-b08fdf307230,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.2312ae67-d95f-4864-8da2-6f5942b9688d 1G Jul 16 23:26:02 devstack sudo[98108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:03 devstack sudo[98108]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bb1dfa4c-ec0c-4b58-9784-7e15cb9da94d tempest-VolumesSnapshotListTestJSON-279322147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.310f2c25-ddf0-43f1-b9f6-b08fdf307230,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.2312ae67-d95f-4864-8da2-6f5942b9688d 1G" returned: 0 in 0.733s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bb1dfa4c-ec0c-4b58-9784-7e15cb9da94d tempest-VolumesSnapshotListTestJSON-279322147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-821f3599-9b67-419d-864f-7274e62ff31c.310f2c25-ddf0-43f1-b9f6-b08fdf307230 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.2312ae67-d95f-4864-8da2-6f5942b9688d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:03 devstack sudo[98115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-821f3599-9b67-419d-864f-7274e62ff31c.310f2c25-ddf0-43f1-b9f6-b08fdf307230 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.2312ae67-d95f-4864-8da2-6f5942b9688d Jul 16 23:26:03 devstack sudo[98115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:03 devstack sudo[98115]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bb1dfa4c-ec0c-4b58-9784-7e15cb9da94d tempest-VolumesSnapshotListTestJSON-279322147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-821f3599-9b67-419d-864f-7274e62ff31c.310f2c25-ddf0-43f1-b9f6-b08fdf307230 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.2312ae67-d95f-4864-8da2-6f5942b9688d" returned: 0 in 0.492s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:03 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-bb1dfa4c-ec0c-4b58-9784-7e15cb9da94d tempest-VolumesSnapshotListTestJSON-279322147 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.2312ae67-d95f-4864-8da2-6f5942b9688d is being set with open permissions: ugo+rw Jul 16 23:26:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bb1dfa4c-ec0c-4b58-9784-7e15cb9da94d tempest-VolumesSnapshotListTestJSON-279322147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.2312ae67-d95f-4864-8da2-6f5942b9688d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:03 devstack sudo[98120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.2312ae67-d95f-4864-8da2-6f5942b9688d Jul 16 23:26:03 devstack sudo[98120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:04 devstack sudo[98120]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bb1dfa4c-ec0c-4b58-9784-7e15cb9da94d tempest-VolumesSnapshotListTestJSON-279322147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.2312ae67-d95f-4864-8da2-6f5942b9688d" returned: 0 in 0.289s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:04 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:SELECT=72,cinder:UPDATE=52,cinder:DELETE=9,cinder:INSERT=13 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:26:04 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:SELECT=69,cinder:UPDATE=62,cinder:INSERT=15,cinder:DELETE=2 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:26:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bb1dfa4c-ec0c-4b58-9784-7e15cb9da94d tempest-VolumesSnapshotListTestJSON-279322147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.335s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:26:04 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-bb1dfa4c-ec0c-4b58-9784-7e15cb9da94d tempest-VolumesSnapshotListTestJSON-279322147 None] Create snapshot completed successfully Jul 16 23:26:05 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-171707c1-20b2-4455-b1bc-f4bc5b1b01c2 tempest-VolumesSnapshotListTestJSON-279322147 None] Acquiring lock "cinder-2312ae67-d95f-4864-8da2-6f5942b9688d-delete_snapshot" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:26:05 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-171707c1-20b2-4455-b1bc-f4bc5b1b01c2 tempest-VolumesSnapshotListTestJSON-279322147 None] Lock "cinder-2312ae67-d95f-4864-8da2-6f5942b9688d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:26:05 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-171707c1-20b2-4455-b1bc-f4bc5b1b01c2 tempest-VolumesSnapshotListTestJSON-279322147 None] Acquiring lock "cinder-quobyte-821f3599-9b67-419d-864f-7274e62ff31c" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:26:05 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-171707c1-20b2-4455-b1bc-f4bc5b1b01c2 tempest-VolumesSnapshotListTestJSON-279322147 None] Lock "cinder-quobyte-821f3599-9b67-419d-864f-7274e62ff31c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:26:05 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-171707c1-20b2-4455-b1bc-f4bc5b1b01c2 tempest-VolumesSnapshotListTestJSON-279322147 None] Acquiring lock "cinder-quobyte-2312ae67-d95f-4864-8da2-6f5942b9688d" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:26:05 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-171707c1-20b2-4455-b1bc-f4bc5b1b01c2 tempest-VolumesSnapshotListTestJSON-279322147 None] Lock "cinder-quobyte-2312ae67-d95f-4864-8da2-6f5942b9688d" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:26:05 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-171707c1-20b2-4455-b1bc-f4bc5b1b01c2 tempest-VolumesSnapshotListTestJSON-279322147 None] Deleting offline snapshot 2312ae67-d95f-4864-8da2-6f5942b9688d of volume 821f3599-9b67-419d-864f-7274e62ff31c {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:26:05 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-171707c1-20b2-4455-b1bc-f4bc5b1b01c2 tempest-VolumesSnapshotListTestJSON-279322147 None] snapshot_file for this snap is: volume-821f3599-9b67-419d-864f-7274e62ff31c.2312ae67-d95f-4864-8da2-6f5942b9688d {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:26:05 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7acf97a-3620-4c5c-a458-89b33c588a6d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:26:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-171707c1-20b2-4455-b1bc-f4bc5b1b01c2 tempest-VolumesSnapshotListTestJSON-279322147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.2312ae67-d95f-4864-8da2-6f5942b9688d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:06 devstack sudo[98123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.2312ae67-d95f-4864-8da2-6f5942b9688d Jul 16 23:26:06 devstack sudo[98123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:06 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-6de9d3fb-d67c-48b4-8829-e721677fb9fc tempest-VolumeQuotasAdminTestJSON-400010913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:26:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6de9d3fb-d67c-48b4-8829-e721677fb9fc tempest-VolumeQuotasAdminTestJSON-400010913 None] Flow 'volume_create_manager' (0abd30f5-222a-4223-b049-80344642fd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:26:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6de9d3fb-d67c-48b4-8829-e721677fb9fc tempest-VolumeQuotasAdminTestJSON-400010913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (490d8210-fe9a-480c-bc04-19c6f0cbb9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:26:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6de9d3fb-d67c-48b4-8829-e721677fb9fc tempest-VolumeQuotasAdminTestJSON-400010913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (490d8210-fe9a-480c-bc04-19c6f0cbb9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1058288032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64ca1c1e-e3e1-41a8-9d86-d176b76c33b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6291a011eafd4d568668867f5ce90952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:26:06Z,use_quota=True,user_id='b9ef817be73a40e88fa57ce515421f52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:26:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6de9d3fb-d67c-48b4-8829-e721677fb9fc tempest-VolumeQuotasAdminTestJSON-400010913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49e23403-3b20-408b-b6d1-81e453820166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:26:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6de9d3fb-d67c-48b4-8829-e721677fb9fc tempest-VolumeQuotasAdminTestJSON-400010913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49e23403-3b20-408b-b6d1-81e453820166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:26:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6de9d3fb-d67c-48b4-8829-e721677fb9fc tempest-VolumeQuotasAdminTestJSON-400010913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e191083b-be74-4941-b123-7c8e8cb56d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:26:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6de9d3fb-d67c-48b4-8829-e721677fb9fc tempest-VolumeQuotasAdminTestJSON-400010913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e191083b-be74-4941-b123-7c8e8cb56d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64ca1c1e-e3e1-41a8-9d86-d176b76c33b7', 'volume_name': 'volume-64ca1c1e-e3e1-41a8-9d86-d176b76c33b7', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:26:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6de9d3fb-d67c-48b4-8829-e721677fb9fc tempest-VolumeQuotasAdminTestJSON-400010913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16411eb3-a33c-4a1b-afa1-82a83c765778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:26:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6de9d3fb-d67c-48b4-8829-e721677fb9fc tempest-VolumeQuotasAdminTestJSON-400010913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16411eb3-a33c-4a1b-afa1-82a83c765778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:26:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6de9d3fb-d67c-48b4-8829-e721677fb9fc tempest-VolumeQuotasAdminTestJSON-400010913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a7333a5-1560-4d4d-847d-0f0f4d73d8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:26:06 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-6de9d3fb-d67c-48b4-8829-e721677fb9fc tempest-VolumeQuotasAdminTestJSON-400010913 None] Volume 64ca1c1e-e3e1-41a8-9d86-d176b76c33b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64ca1c1e-e3e1-41a8-9d86-d176b76c33b7', 'volume_size': 1} Jul 16 23:26:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6de9d3fb-d67c-48b4-8829-e721677fb9fc tempest-VolumeQuotasAdminTestJSON-400010913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:26:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6de9d3fb-d67c-48b4-8829-e721677fb9fc tempest-VolumeQuotasAdminTestJSON-400010913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:26:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-6de9d3fb-d67c-48b4-8829-e721677fb9fc tempest-VolumeQuotasAdminTestJSON-400010913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1058288032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64ca1c1e-e3e1-41a8-9d86-d176b76c33b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6291a011eafd4d568668867f5ce90952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:26:06Z,use_quota=True,user_id='b9ef817be73a40e88fa57ce515421f52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:26:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-6de9d3fb-d67c-48b4-8829-e721677fb9fc tempest-VolumeQuotasAdminTestJSON-400010913 None] Creating volume 64ca1c1e-e3e1-41a8-9d86-d176b76c33b7 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:26:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6de9d3fb-d67c-48b4-8829-e721677fb9fc tempest-VolumeQuotasAdminTestJSON-400010913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:26:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6de9d3fb-d67c-48b4-8829-e721677fb9fc tempest-VolumeQuotasAdminTestJSON-400010913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:26:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-6de9d3fb-d67c-48b4-8829-e721677fb9fc tempest-VolumeQuotasAdminTestJSON-400010913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:26:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-6de9d3fb-d67c-48b4-8829-e721677fb9fc tempest-VolumeQuotasAdminTestJSON-400010913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:26:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6de9d3fb-d67c-48b4-8829-e721677fb9fc tempest-VolumeQuotasAdminTestJSON-400010913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:26:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-6de9d3fb-d67c-48b4-8829-e721677fb9fc tempest-VolumeQuotasAdminTestJSON-400010913 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:26:06 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-6de9d3fb-d67c-48b4-8829-e721677fb9fc tempest-VolumeQuotasAdminTestJSON-400010913 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:26:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6de9d3fb-d67c-48b4-8829-e721677fb9fc tempest-VolumeQuotasAdminTestJSON-400010913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-64ca1c1e-e3e1-41a8-9d86-d176b76c33b7 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:06 devstack sudo[98123]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-171707c1-20b2-4455-b1bc-f4bc5b1b01c2 tempest-VolumesSnapshotListTestJSON-279322147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.2312ae67-d95f-4864-8da2-6f5942b9688d" returned: 0 in 0.385s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-171707c1-20b2-4455-b1bc-f4bc5b1b01c2 tempest-VolumesSnapshotListTestJSON-279322147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-821f3599-9b67-419d-864f-7274e62ff31c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:26:06 devstack sudo[98128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-64ca1c1e-e3e1-41a8-9d86-d176b76c33b7 1073741824 Jul 16 23:26:06 devstack sudo[98128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:06 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfda50c-c227-48a2-ac20-40db1acea986]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:26:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-171707c1-20b2-4455-b1bc-f4bc5b1b01c2 tempest-VolumesSnapshotListTestJSON-279322147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.310f2c25-ddf0-43f1-b9f6-b08fdf307230 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:06 devstack sudo[98130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.310f2c25-ddf0-43f1-b9f6-b08fdf307230 Jul 16 23:26:06 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:06 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:06 devstack sudo[98128]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-171707c1-20b2-4455-b1bc-f4bc5b1b01c2 tempest-VolumesSnapshotListTestJSON-279322147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.310f2c25-ddf0-43f1-b9f6-b08fdf307230" returned: 0 in 0.404s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-171707c1-20b2-4455-b1bc-f4bc5b1b01c2 tempest-VolumesSnapshotListTestJSON-279322147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-821f3599-9b67-419d-864f-7274e62ff31c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:26:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-171707c1-20b2-4455-b1bc-f4bc5b1b01c2 tempest-VolumesSnapshotListTestJSON-279322147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.2312ae67-d95f-4864-8da2-6f5942b9688d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6de9d3fb-d67c-48b4-8829-e721677fb9fc tempest-VolumeQuotasAdminTestJSON-400010913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-64ca1c1e-e3e1-41a8-9d86-d176b76c33b7 1073741824" returned: 0 in 0.460s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:06 devstack sudo[98138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.2312ae67-d95f-4864-8da2-6f5942b9688d Jul 16 23:26:06 devstack sudo[98138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6de9d3fb-d67c-48b4-8829-e721677fb9fc tempest-VolumeQuotasAdminTestJSON-400010913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-64ca1c1e-e3e1-41a8-9d86-d176b76c33b7 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:06 devstack sudo[98140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-64ca1c1e-e3e1-41a8-9d86-d176b76c33b7 Jul 16 23:26:06 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:07 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6de9d3fb-d67c-48b4-8829-e721677fb9fc tempest-VolumeQuotasAdminTestJSON-400010913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-64ca1c1e-e3e1-41a8-9d86-d176b76c33b7" returned: 0 in 0.305s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:07 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-6de9d3fb-d67c-48b4-8829-e721677fb9fc tempest-VolumeQuotasAdminTestJSON-400010913 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:26:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6de9d3fb-d67c-48b4-8829-e721677fb9fc tempest-VolumeQuotasAdminTestJSON-400010913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:26:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6de9d3fb-d67c-48b4-8829-e721677fb9fc tempest-VolumeQuotasAdminTestJSON-400010913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a7333a5-1560-4d4d-847d-0f0f4d73d8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64ca1c1e-e3e1-41a8-9d86-d176b76c33b7', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:26:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6de9d3fb-d67c-48b4-8829-e721677fb9fc tempest-VolumeQuotasAdminTestJSON-400010913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01bd7393-c58a-4a77-a77f-1ee43dc4fb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:26:07 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-6de9d3fb-d67c-48b4-8829-e721677fb9fc tempest-VolumeQuotasAdminTestJSON-400010913 None] Volume volume-64ca1c1e-e3e1-41a8-9d86-d176b76c33b7 (64ca1c1e-e3e1-41a8-9d86-d176b76c33b7): created successfully Jul 16 23:26:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6de9d3fb-d67c-48b4-8829-e721677fb9fc tempest-VolumeQuotasAdminTestJSON-400010913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01bd7393-c58a-4a77-a77f-1ee43dc4fb15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:26:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6de9d3fb-d67c-48b4-8829-e721677fb9fc tempest-VolumeQuotasAdminTestJSON-400010913 None] Flow 'volume_create_manager' (0abd30f5-222a-4223-b049-80344642fd61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:26:07 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-6de9d3fb-d67c-48b4-8829-e721677fb9fc tempest-VolumeQuotasAdminTestJSON-400010913 None] Created volume successfully. Jul 16 23:26:07 devstack sudo[98138]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-171707c1-20b2-4455-b1bc-f4bc5b1b01c2 tempest-VolumesSnapshotListTestJSON-279322147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.2312ae67-d95f-4864-8da2-6f5942b9688d" returned: 0 in 0.469s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-171707c1-20b2-4455-b1bc-f4bc5b1b01c2 tempest-VolumesSnapshotListTestJSON-279322147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.2312ae67-d95f-4864-8da2-6f5942b9688d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:07 devstack sudo[98146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.2312ae67-d95f-4864-8da2-6f5942b9688d Jul 16 23:26:07 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:07 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-171707c1-20b2-4455-b1bc-f4bc5b1b01c2 tempest-VolumesSnapshotListTestJSON-279322147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.2312ae67-d95f-4864-8da2-6f5942b9688d" returned: 0 in 0.244s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:07 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-171707c1-20b2-4455-b1bc-f4bc5b1b01c2 tempest-VolumesSnapshotListTestJSON-279322147 None] Lock "cinder-quobyte-2312ae67-d95f-4864-8da2-6f5942b9688d" released by "_delete_snapshot" :: held 1.610s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:26:07 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-171707c1-20b2-4455-b1bc-f4bc5b1b01c2 tempest-VolumesSnapshotListTestJSON-279322147 None] Lock "cinder-quobyte-821f3599-9b67-419d-864f-7274e62ff31c" released by "delete_snapshot" :: held 1.646s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:26:07 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-171707c1-20b2-4455-b1bc-f4bc5b1b01c2 tempest-VolumesSnapshotListTestJSON-279322147 None] Created reservations ['ecb441d1-a57b-47bf-ba74-1ed1cded6330', '0b786556-0a2d-4f79-b071-488401166893', 'c739d23b-8990-477d-b190-71762fb52f2e', 'ba731704-065f-43ef-9de6-5da6fb531a92'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:26:07 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-171707c1-20b2-4455-b1bc-f4bc5b1b01c2 tempest-VolumesSnapshotListTestJSON-279322147 None] Delete snapshot completed successfully. Jul 16 23:26:07 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-171707c1-20b2-4455-b1bc-f4bc5b1b01c2 tempest-VolumesSnapshotListTestJSON-279322147 None] Lock "cinder-2312ae67-d95f-4864-8da2-6f5942b9688d-delete_snapshot" released by "delete_snapshot" :: held 1.820s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:26:08 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1bedbeea-e1ea-4416-90cb-badea112dd25 tempest-VolumesSnapshotListTestJSON-279322147 None] Acquiring lock "cinder-310f2c25-ddf0-43f1-b9f6-b08fdf307230-delete_snapshot" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:26:08 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1bedbeea-e1ea-4416-90cb-badea112dd25 tempest-VolumesSnapshotListTestJSON-279322147 None] Lock "cinder-310f2c25-ddf0-43f1-b9f6-b08fdf307230-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:26:08 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1bedbeea-e1ea-4416-90cb-badea112dd25 tempest-VolumesSnapshotListTestJSON-279322147 None] Acquiring lock "cinder-quobyte-821f3599-9b67-419d-864f-7274e62ff31c" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:26:08 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1bedbeea-e1ea-4416-90cb-badea112dd25 tempest-VolumesSnapshotListTestJSON-279322147 None] Lock "cinder-quobyte-821f3599-9b67-419d-864f-7274e62ff31c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:26:08 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1bedbeea-e1ea-4416-90cb-badea112dd25 tempest-VolumesSnapshotListTestJSON-279322147 None] Acquiring lock "cinder-quobyte-310f2c25-ddf0-43f1-b9f6-b08fdf307230" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:26:08 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1bedbeea-e1ea-4416-90cb-badea112dd25 tempest-VolumesSnapshotListTestJSON-279322147 None] Lock "cinder-quobyte-310f2c25-ddf0-43f1-b9f6-b08fdf307230" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:26:08 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-1bedbeea-e1ea-4416-90cb-badea112dd25 tempest-VolumesSnapshotListTestJSON-279322147 None] Deleting offline snapshot 310f2c25-ddf0-43f1-b9f6-b08fdf307230 of volume 821f3599-9b67-419d-864f-7274e62ff31c {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:26:08 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-1bedbeea-e1ea-4416-90cb-badea112dd25 tempest-VolumesSnapshotListTestJSON-279322147 None] snapshot_file for this snap is: volume-821f3599-9b67-419d-864f-7274e62ff31c.310f2c25-ddf0-43f1-b9f6-b08fdf307230 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:26:08 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a941c99-ec76-4092-9617-262063b6162d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:26:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1bedbeea-e1ea-4416-90cb-badea112dd25 tempest-VolumesSnapshotListTestJSON-279322147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.310f2c25-ddf0-43f1-b9f6-b08fdf307230 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:08 devstack sudo[98149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.310f2c25-ddf0-43f1-b9f6-b08fdf307230 Jul 16 23:26:08 devstack sudo[98149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:08 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f95d883b-8a48-4d3f-afc9-5c354f1b1ca1 tempest-VolumeQuotasAdminTestJSON-400010913 None] Acquiring lock "cinder-64ca1c1e-e3e1-41a8-9d86-d176b76c33b7-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:26:08 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f95d883b-8a48-4d3f-afc9-5c354f1b1ca1 tempest-VolumeQuotasAdminTestJSON-400010913 None] Lock "cinder-64ca1c1e-e3e1-41a8-9d86-d176b76c33b7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:26:08 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f95d883b-8a48-4d3f-afc9-5c354f1b1ca1 tempest-VolumeQuotasAdminTestJSON-400010913 None] Acquiring lock "cinder-quobyte-64ca1c1e-e3e1-41a8-9d86-d176b76c33b7" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:26:08 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f95d883b-8a48-4d3f-afc9-5c354f1b1ca1 tempest-VolumeQuotasAdminTestJSON-400010913 None] Lock "cinder-quobyte-64ca1c1e-e3e1-41a8-9d86-d176b76c33b7" acquired by "delete_volume" :: waited 0.020s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:26:08 devstack sudo[98149]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1bedbeea-e1ea-4416-90cb-badea112dd25 tempest-VolumesSnapshotListTestJSON-279322147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.310f2c25-ddf0-43f1-b9f6-b08fdf307230" returned: 0 in 0.434s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:08 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-1bedbeea-e1ea-4416-90cb-badea112dd25 tempest-VolumesSnapshotListTestJSON-279322147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-821f3599-9b67-419d-864f-7274e62ff31c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:26:08 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3915f97-eb7a-452f-b1be-fbae54ec759c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:26:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f95d883b-8a48-4d3f-afc9-5c354f1b1ca1 tempest-VolumeQuotasAdminTestJSON-400010913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-64ca1c1e-e3e1-41a8-9d86-d176b76c33b7 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:08 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[58094dbd-2ff4-491c-b607-6185ed3e7d26]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:26:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1bedbeea-e1ea-4416-90cb-badea112dd25 tempest-VolumesSnapshotListTestJSON-279322147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.75e7783a-d92f-496e-912a-15111af72d28 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:08 devstack sudo[98159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-64ca1c1e-e3e1-41a8-9d86-d176b76c33b7 Jul 16 23:26:08 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:08 devstack sudo[98160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.75e7783a-d92f-496e-912a-15111af72d28 Jul 16 23:26:08 devstack sudo[98160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:08 devstack sudo[98160]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1bedbeea-e1ea-4416-90cb-badea112dd25 tempest-VolumesSnapshotListTestJSON-279322147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.75e7783a-d92f-496e-912a-15111af72d28" returned: 0 in 0.362s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:08 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-1bedbeea-e1ea-4416-90cb-badea112dd25 tempest-VolumesSnapshotListTestJSON-279322147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-821f3599-9b67-419d-864f-7274e62ff31c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:26:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1bedbeea-e1ea-4416-90cb-badea112dd25 tempest-VolumesSnapshotListTestJSON-279322147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.310f2c25-ddf0-43f1-b9f6-b08fdf307230 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:08 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f95d883b-8a48-4d3f-afc9-5c354f1b1ca1 tempest-VolumeQuotasAdminTestJSON-400010913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-64ca1c1e-e3e1-41a8-9d86-d176b76c33b7" returned: 0 in 0.398s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f95d883b-8a48-4d3f-afc9-5c354f1b1ca1 tempest-VolumeQuotasAdminTestJSON-400010913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-64ca1c1e-e3e1-41a8-9d86-d176b76c33b7 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:08 devstack sudo[98170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.310f2c25-ddf0-43f1-b9f6-b08fdf307230 Jul 16 23:26:08 devstack sudo[98170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:08 devstack sudo[98172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-64ca1c1e-e3e1-41a8-9d86-d176b76c33b7 Jul 16 23:26:09 devstack sudo[98172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:09 devstack sudo[98172]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f95d883b-8a48-4d3f-afc9-5c354f1b1ca1 tempest-VolumeQuotasAdminTestJSON-400010913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-64ca1c1e-e3e1-41a8-9d86-d176b76c33b7" returned: 0 in 0.268s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:09 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f95d883b-8a48-4d3f-afc9-5c354f1b1ca1 tempest-VolumeQuotasAdminTestJSON-400010913 None] Lock "cinder-quobyte-64ca1c1e-e3e1-41a8-9d86-d176b76c33b7" released by "delete_volume" :: held 0.724s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:26:09 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-f95d883b-8a48-4d3f-afc9-5c354f1b1ca1 tempest-VolumeQuotasAdminTestJSON-400010913 None] Created reservations ['d7817340-8059-4e82-b813-214e925ef5a9', '92b97f17-94c6-4fe9-94cb-b3e3d9bdbcf2', 'fb25693c-b338-4bdb-8aca-c8d97ff055dc', '19b0638b-a428-46f4-b7a5-55102db75bd2'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:26:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f95d883b-8a48-4d3f-afc9-5c354f1b1ca1 tempest-VolumeQuotasAdminTestJSON-400010913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:26:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f95d883b-8a48-4d3f-afc9-5c354f1b1ca1 tempest-VolumeQuotasAdminTestJSON-400010913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:26:09 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f95d883b-8a48-4d3f-afc9-5c354f1b1ca1 tempest-VolumeQuotasAdminTestJSON-400010913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:26:09 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f95d883b-8a48-4d3f-afc9-5c354f1b1ca1 tempest-VolumeQuotasAdminTestJSON-400010913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:26:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f95d883b-8a48-4d3f-afc9-5c354f1b1ca1 tempest-VolumeQuotasAdminTestJSON-400010913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:26:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f95d883b-8a48-4d3f-afc9-5c354f1b1ca1 tempest-VolumeQuotasAdminTestJSON-400010913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:09 devstack sudo[98170]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1bedbeea-e1ea-4416-90cb-badea112dd25 tempest-VolumesSnapshotListTestJSON-279322147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.310f2c25-ddf0-43f1-b9f6-b08fdf307230" returned: 0 in 0.454s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1bedbeea-e1ea-4416-90cb-badea112dd25 tempest-VolumesSnapshotListTestJSON-279322147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.310f2c25-ddf0-43f1-b9f6-b08fdf307230 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:09 devstack sudo[98179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:26:09 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:09 devstack sudo[98180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.310f2c25-ddf0-43f1-b9f6-b08fdf307230 Jul 16 23:26:09 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:09 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1bedbeea-e1ea-4416-90cb-badea112dd25 tempest-VolumesSnapshotListTestJSON-279322147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.310f2c25-ddf0-43f1-b9f6-b08fdf307230" returned: 0 in 0.290s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:09 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f95d883b-8a48-4d3f-afc9-5c354f1b1ca1 tempest-VolumeQuotasAdminTestJSON-400010913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.340s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:09 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-f95d883b-8a48-4d3f-afc9-5c354f1b1ca1 tempest-VolumeQuotasAdminTestJSON-400010913 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:26:09 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1bedbeea-e1ea-4416-90cb-badea112dd25 tempest-VolumesSnapshotListTestJSON-279322147 None] Lock "cinder-quobyte-310f2c25-ddf0-43f1-b9f6-b08fdf307230" released by "_delete_snapshot" :: held 1.649s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:26:09 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-f95d883b-8a48-4d3f-afc9-5c354f1b1ca1 tempest-VolumeQuotasAdminTestJSON-400010913 None] Deleted volume successfully. Jul 16 23:26:09 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1bedbeea-e1ea-4416-90cb-badea112dd25 tempest-VolumesSnapshotListTestJSON-279322147 None] Lock "cinder-quobyte-821f3599-9b67-419d-864f-7274e62ff31c" released by "delete_snapshot" :: held 1.682s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:26:09 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f95d883b-8a48-4d3f-afc9-5c354f1b1ca1 tempest-VolumeQuotasAdminTestJSON-400010913 None] Lock "cinder-64ca1c1e-e3e1-41a8-9d86-d176b76c33b7-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:26:09 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-1bedbeea-e1ea-4416-90cb-badea112dd25 tempest-VolumesSnapshotListTestJSON-279322147 None] Created reservations ['6f9d67c4-63bb-4db2-b1b2-47d6c177b00d', '1933d759-5bb1-43aa-97b1-c548a39903cf', '21f0776f-96ce-4bad-a946-f41f2da58d25', '751fa552-34af-4d47-8199-29b531d41f74'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:26:09 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-1bedbeea-e1ea-4416-90cb-badea112dd25 tempest-VolumesSnapshotListTestJSON-279322147 None] Delete snapshot completed successfully. Jul 16 23:26:09 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1bedbeea-e1ea-4416-90cb-badea112dd25 tempest-VolumesSnapshotListTestJSON-279322147 None] Lock "cinder-310f2c25-ddf0-43f1-b9f6-b08fdf307230-delete_snapshot" released by "delete_snapshot" :: held 1.855s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:26:10 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-69ce4877-b9b2-4a05-ad84-9265aa9887eb tempest-VolumeQuotasAdminTestJSON-400010913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:26:10 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-69ce4877-b9b2-4a05-ad84-9265aa9887eb tempest-VolumeQuotasAdminTestJSON-400010913 None] Flow 'volume_create_manager' (b8d99df5-3cc8-4aec-a8da-46fe1e1f6195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:26:10 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-69ce4877-b9b2-4a05-ad84-9265aa9887eb tempest-VolumeQuotasAdminTestJSON-400010913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (708c1a72-6e28-4752-a67f-03b233e93722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:26:10 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-111494a8-5947-42b3-8003-3e4fe3c035df tempest-VolumesSnapshotListTestJSON-279322147 None] Acquiring lock "cinder-75e7783a-d92f-496e-912a-15111af72d28-delete_snapshot" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:26:10 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-69ce4877-b9b2-4a05-ad84-9265aa9887eb tempest-VolumeQuotasAdminTestJSON-400010913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (708c1a72-6e28-4752-a67f-03b233e93722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2066814978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09ef6670-0822-4403-a066-4967a1ec156a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6291a011eafd4d568668867f5ce90952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:26:10Z,use_quota=True,user_id='b9ef817be73a40e88fa57ce515421f52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:26:10 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-69ce4877-b9b2-4a05-ad84-9265aa9887eb tempest-VolumeQuotasAdminTestJSON-400010913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d977a01b-99ab-4ff2-8795-e13be7c3eb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:26:10 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-69ce4877-b9b2-4a05-ad84-9265aa9887eb tempest-VolumeQuotasAdminTestJSON-400010913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d977a01b-99ab-4ff2-8795-e13be7c3eb7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:26:10 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-69ce4877-b9b2-4a05-ad84-9265aa9887eb tempest-VolumeQuotasAdminTestJSON-400010913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e0448be-3c25-49a6-a1ba-990e4cf2cb71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:26:10 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-69ce4877-b9b2-4a05-ad84-9265aa9887eb tempest-VolumeQuotasAdminTestJSON-400010913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e0448be-3c25-49a6-a1ba-990e4cf2cb71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09ef6670-0822-4403-a066-4967a1ec156a', 'volume_name': 'volume-09ef6670-0822-4403-a066-4967a1ec156a', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:26:10 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-69ce4877-b9b2-4a05-ad84-9265aa9887eb tempest-VolumeQuotasAdminTestJSON-400010913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2487f1e1-62dc-4a31-9cc5-f76bb45fe3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:26:10 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-69ce4877-b9b2-4a05-ad84-9265aa9887eb tempest-VolumeQuotasAdminTestJSON-400010913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2487f1e1-62dc-4a31-9cc5-f76bb45fe3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:26:10 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-69ce4877-b9b2-4a05-ad84-9265aa9887eb tempest-VolumeQuotasAdminTestJSON-400010913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1e98fd2-ea71-451c-91bc-f02043e0a395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:26:10 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-69ce4877-b9b2-4a05-ad84-9265aa9887eb tempest-VolumeQuotasAdminTestJSON-400010913 None] Volume 09ef6670-0822-4403-a066-4967a1ec156a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09ef6670-0822-4403-a066-4967a1ec156a', 'volume_size': 1} Jul 16 23:26:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-69ce4877-b9b2-4a05-ad84-9265aa9887eb tempest-VolumeQuotasAdminTestJSON-400010913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:26:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-69ce4877-b9b2-4a05-ad84-9265aa9887eb tempest-VolumeQuotasAdminTestJSON-400010913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:26:10 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-69ce4877-b9b2-4a05-ad84-9265aa9887eb tempest-VolumeQuotasAdminTestJSON-400010913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2066814978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09ef6670-0822-4403-a066-4967a1ec156a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6291a011eafd4d568668867f5ce90952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:26:10Z,use_quota=True,user_id='b9ef817be73a40e88fa57ce515421f52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:26:10 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-69ce4877-b9b2-4a05-ad84-9265aa9887eb tempest-VolumeQuotasAdminTestJSON-400010913 None] Creating volume 09ef6670-0822-4403-a066-4967a1ec156a {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:26:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-69ce4877-b9b2-4a05-ad84-9265aa9887eb tempest-VolumeQuotasAdminTestJSON-400010913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:26:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-69ce4877-b9b2-4a05-ad84-9265aa9887eb tempest-VolumeQuotasAdminTestJSON-400010913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:26:10 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-69ce4877-b9b2-4a05-ad84-9265aa9887eb tempest-VolumeQuotasAdminTestJSON-400010913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:26:10 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-69ce4877-b9b2-4a05-ad84-9265aa9887eb tempest-VolumeQuotasAdminTestJSON-400010913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:26:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-69ce4877-b9b2-4a05-ad84-9265aa9887eb tempest-VolumeQuotasAdminTestJSON-400010913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:26:10 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-69ce4877-b9b2-4a05-ad84-9265aa9887eb tempest-VolumeQuotasAdminTestJSON-400010913 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:26:10 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-69ce4877-b9b2-4a05-ad84-9265aa9887eb tempest-VolumeQuotasAdminTestJSON-400010913 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:26:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-69ce4877-b9b2-4a05-ad84-9265aa9887eb tempest-VolumeQuotasAdminTestJSON-400010913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-09ef6670-0822-4403-a066-4967a1ec156a 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:10 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-111494a8-5947-42b3-8003-3e4fe3c035df tempest-VolumesSnapshotListTestJSON-279322147 None] Lock "cinder-75e7783a-d92f-496e-912a-15111af72d28-delete_snapshot" acquired by "delete_snapshot" :: waited 0.077s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:26:10 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-111494a8-5947-42b3-8003-3e4fe3c035df tempest-VolumesSnapshotListTestJSON-279322147 None] Acquiring lock "cinder-quobyte-821f3599-9b67-419d-864f-7274e62ff31c" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:26:10 devstack sudo[98192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-09ef6670-0822-4403-a066-4967a1ec156a 1073741824 Jul 16 23:26:10 devstack sudo[98192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:10 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-111494a8-5947-42b3-8003-3e4fe3c035df tempest-VolumesSnapshotListTestJSON-279322147 None] Lock "cinder-quobyte-821f3599-9b67-419d-864f-7274e62ff31c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:26:10 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-111494a8-5947-42b3-8003-3e4fe3c035df tempest-VolumesSnapshotListTestJSON-279322147 None] Acquiring lock "cinder-quobyte-75e7783a-d92f-496e-912a-15111af72d28" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:26:10 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-111494a8-5947-42b3-8003-3e4fe3c035df tempest-VolumesSnapshotListTestJSON-279322147 None] Lock "cinder-quobyte-75e7783a-d92f-496e-912a-15111af72d28" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:26:10 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-111494a8-5947-42b3-8003-3e4fe3c035df tempest-VolumesSnapshotListTestJSON-279322147 None] Deleting offline snapshot 75e7783a-d92f-496e-912a-15111af72d28 of volume 821f3599-9b67-419d-864f-7274e62ff31c {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:26:10 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-111494a8-5947-42b3-8003-3e4fe3c035df tempest-VolumesSnapshotListTestJSON-279322147 None] snapshot_file for this snap is: volume-821f3599-9b67-419d-864f-7274e62ff31c.75e7783a-d92f-496e-912a-15111af72d28 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:26:10 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cf1a6f-68a0-4f56-960e-3beb2e8e3e5d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:26:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-111494a8-5947-42b3-8003-3e4fe3c035df tempest-VolumesSnapshotListTestJSON-279322147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.75e7783a-d92f-496e-912a-15111af72d28 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:10 devstack sudo[98194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.75e7783a-d92f-496e-912a-15111af72d28 Jul 16 23:26:10 devstack sudo[98194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:10 devstack sudo[98192]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-69ce4877-b9b2-4a05-ad84-9265aa9887eb tempest-VolumeQuotasAdminTestJSON-400010913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-09ef6670-0822-4403-a066-4967a1ec156a 1073741824" returned: 0 in 0.469s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:10 devstack sudo[98194]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-111494a8-5947-42b3-8003-3e4fe3c035df tempest-VolumesSnapshotListTestJSON-279322147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.75e7783a-d92f-496e-912a-15111af72d28" returned: 0 in 0.398s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:10 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-111494a8-5947-42b3-8003-3e4fe3c035df tempest-VolumesSnapshotListTestJSON-279322147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-821f3599-9b67-419d-864f-7274e62ff31c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:26:10 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac40e273-7f05-459c-9b67-3f6e48b3cf87]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:26:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-111494a8-5947-42b3-8003-3e4fe3c035df tempest-VolumesSnapshotListTestJSON-279322147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-69ce4877-b9b2-4a05-ad84-9265aa9887eb tempest-VolumeQuotasAdminTestJSON-400010913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-09ef6670-0822-4403-a066-4967a1ec156a {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:10 devstack sudo[98206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-09ef6670-0822-4403-a066-4967a1ec156a Jul 16 23:26:10 devstack sudo[98206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:10 devstack sudo[98205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c Jul 16 23:26:10 devstack sudo[98205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:11 devstack sudo[98206]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-69ce4877-b9b2-4a05-ad84-9265aa9887eb tempest-VolumeQuotasAdminTestJSON-400010913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-09ef6670-0822-4403-a066-4967a1ec156a" returned: 0 in 0.406s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:11 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-69ce4877-b9b2-4a05-ad84-9265aa9887eb tempest-VolumeQuotasAdminTestJSON-400010913 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:26:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-69ce4877-b9b2-4a05-ad84-9265aa9887eb tempest-VolumeQuotasAdminTestJSON-400010913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:26:11 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-69ce4877-b9b2-4a05-ad84-9265aa9887eb tempest-VolumeQuotasAdminTestJSON-400010913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1e98fd2-ea71-451c-91bc-f02043e0a395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09ef6670-0822-4403-a066-4967a1ec156a', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:26:11 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-69ce4877-b9b2-4a05-ad84-9265aa9887eb tempest-VolumeQuotasAdminTestJSON-400010913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a5772f1-d56e-4aea-9901-57661e90a72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:26:11 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-69ce4877-b9b2-4a05-ad84-9265aa9887eb tempest-VolumeQuotasAdminTestJSON-400010913 None] Volume volume-09ef6670-0822-4403-a066-4967a1ec156a (09ef6670-0822-4403-a066-4967a1ec156a): created successfully Jul 16 23:26:11 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-69ce4877-b9b2-4a05-ad84-9265aa9887eb tempest-VolumeQuotasAdminTestJSON-400010913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a5772f1-d56e-4aea-9901-57661e90a72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:26:11 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-69ce4877-b9b2-4a05-ad84-9265aa9887eb tempest-VolumeQuotasAdminTestJSON-400010913 None] Flow 'volume_create_manager' (b8d99df5-3cc8-4aec-a8da-46fe1e1f6195) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:26:11 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-69ce4877-b9b2-4a05-ad84-9265aa9887eb tempest-VolumeQuotasAdminTestJSON-400010913 None] Created volume successfully. Jul 16 23:26:11 devstack sudo[98205]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-111494a8-5947-42b3-8003-3e4fe3c035df tempest-VolumesSnapshotListTestJSON-279322147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c" returned: 0 in 0.565s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-111494a8-5947-42b3-8003-3e4fe3c035df tempest-VolumesSnapshotListTestJSON-279322147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.75e7783a-d92f-496e-912a-15111af72d28 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:11 devstack sudo[98227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.75e7783a-d92f-496e-912a-15111af72d28 Jul 16 23:26:11 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:11 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-111494a8-5947-42b3-8003-3e4fe3c035df tempest-VolumesSnapshotListTestJSON-279322147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.75e7783a-d92f-496e-912a-15111af72d28" returned: 0 in 0.469s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-111494a8-5947-42b3-8003-3e4fe3c035df tempest-VolumesSnapshotListTestJSON-279322147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.75e7783a-d92f-496e-912a-15111af72d28 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:11 devstack sudo[98244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.75e7783a-d92f-496e-912a-15111af72d28 Jul 16 23:26:11 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:12 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-111494a8-5947-42b3-8003-3e4fe3c035df tempest-VolumesSnapshotListTestJSON-279322147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c.75e7783a-d92f-496e-912a-15111af72d28" returned: 0 in 0.264s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:12 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-111494a8-5947-42b3-8003-3e4fe3c035df tempest-VolumesSnapshotListTestJSON-279322147 None] Lock "cinder-quobyte-75e7783a-d92f-496e-912a-15111af72d28" released by "_delete_snapshot" :: held 1.820s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:26:12 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-111494a8-5947-42b3-8003-3e4fe3c035df tempest-VolumesSnapshotListTestJSON-279322147 None] Lock "cinder-quobyte-821f3599-9b67-419d-864f-7274e62ff31c" released by "delete_snapshot" :: held 1.848s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:26:12 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-111494a8-5947-42b3-8003-3e4fe3c035df tempest-VolumesSnapshotListTestJSON-279322147 None] Created reservations ['9e13a25d-362f-4a07-b8aa-1819bf28f6e9', '7c2537df-7c7a-4f4b-91fd-caa1fdd2375a', 'f26e08f3-ee67-4531-980a-96db039dffff', '37e7f261-3cb9-4d2a-a71f-8ac1769c9c1a'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:26:12 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-111494a8-5947-42b3-8003-3e4fe3c035df tempest-VolumesSnapshotListTestJSON-279322147 None] Delete snapshot completed successfully. Jul 16 23:26:12 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-111494a8-5947-42b3-8003-3e4fe3c035df tempest-VolumesSnapshotListTestJSON-279322147 None] Lock "cinder-75e7783a-d92f-496e-912a-15111af72d28-delete_snapshot" released by "delete_snapshot" :: held 2.027s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:26:12 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-97183e90-0400-46dd-9432-9ddc2eb567da tempest-VolumesSnapshotListTestJSON-279322147 None] Acquiring lock "cinder-821f3599-9b67-419d-864f-7274e62ff31c-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:26:12 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-97183e90-0400-46dd-9432-9ddc2eb567da tempest-VolumesSnapshotListTestJSON-279322147 None] Lock "cinder-821f3599-9b67-419d-864f-7274e62ff31c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:26:12 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-97183e90-0400-46dd-9432-9ddc2eb567da tempest-VolumesSnapshotListTestJSON-279322147 None] Acquiring lock "cinder-quobyte-821f3599-9b67-419d-864f-7274e62ff31c" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:26:12 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-97183e90-0400-46dd-9432-9ddc2eb567da tempest-VolumesSnapshotListTestJSON-279322147 None] Lock "cinder-quobyte-821f3599-9b67-419d-864f-7274e62ff31c" acquired by "delete_volume" :: waited 0.047s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:26:12 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[5974607b-9729-46f1-8520-647b12afdd72]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:26:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-97183e90-0400-46dd-9432-9ddc2eb567da tempest-VolumesSnapshotListTestJSON-279322147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:12 devstack sudo[98250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c Jul 16 23:26:12 devstack sudo[98250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:13 devstack sudo[98250]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-97183e90-0400-46dd-9432-9ddc2eb567da tempest-VolumesSnapshotListTestJSON-279322147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c" returned: 0 in 0.406s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-97183e90-0400-46dd-9432-9ddc2eb567da tempest-VolumesSnapshotListTestJSON-279322147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:13 devstack sudo[98255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c Jul 16 23:26:13 devstack sudo[98255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:13 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-73d99093-f79e-46fa-8ebb-5550ea34d4c9 tempest-VolumeQuotasAdminTestJSON-1073998133 None] Transfer volume completed successfully. Jul 16 23:26:13 devstack sudo[98255]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-97183e90-0400-46dd-9432-9ddc2eb567da tempest-VolumesSnapshotListTestJSON-279322147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-821f3599-9b67-419d-864f-7274e62ff31c" returned: 0 in 0.268s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:13 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-97183e90-0400-46dd-9432-9ddc2eb567da tempest-VolumesSnapshotListTestJSON-279322147 None] Lock "cinder-quobyte-821f3599-9b67-419d-864f-7274e62ff31c" released by "delete_volume" :: held 0.757s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:26:13 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-97183e90-0400-46dd-9432-9ddc2eb567da tempest-VolumesSnapshotListTestJSON-279322147 None] Created reservations ['e4a62ed5-98a7-4aef-be14-87099c07c945', '31ad3d71-ab39-423a-bcdc-6515367808e9', '85672449-acb5-458c-b7cc-0159f942263b', 'f67d2c95-24d1-4d9f-b0e4-9ad834bdb35d'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:26:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-97183e90-0400-46dd-9432-9ddc2eb567da tempest-VolumesSnapshotListTestJSON-279322147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:26:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-97183e90-0400-46dd-9432-9ddc2eb567da tempest-VolumesSnapshotListTestJSON-279322147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:26:13 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-97183e90-0400-46dd-9432-9ddc2eb567da tempest-VolumesSnapshotListTestJSON-279322147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:26:13 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-97183e90-0400-46dd-9432-9ddc2eb567da tempest-VolumesSnapshotListTestJSON-279322147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:26:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-97183e90-0400-46dd-9432-9ddc2eb567da tempest-VolumesSnapshotListTestJSON-279322147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:26:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-97183e90-0400-46dd-9432-9ddc2eb567da tempest-VolumesSnapshotListTestJSON-279322147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:13 devstack sudo[98258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:26:13 devstack sudo[98258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:13 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-88a39645-3439-4867-9198-081b187d4917 tempest-VolumeQuotasAdminTestJSON-50184744 None] Acquiring lock "cinder-09ef6670-0822-4403-a066-4967a1ec156a-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:26:13 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-88a39645-3439-4867-9198-081b187d4917 tempest-VolumeQuotasAdminTestJSON-50184744 None] Lock "cinder-09ef6670-0822-4403-a066-4967a1ec156a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:26:13 devstack sudo[98258]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:13 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-88a39645-3439-4867-9198-081b187d4917 tempest-VolumeQuotasAdminTestJSON-50184744 None] Acquiring lock "cinder-quobyte-09ef6670-0822-4403-a066-4967a1ec156a" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:26:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-97183e90-0400-46dd-9432-9ddc2eb567da tempest-VolumesSnapshotListTestJSON-279322147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.352s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:13 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-97183e90-0400-46dd-9432-9ddc2eb567da tempest-VolumesSnapshotListTestJSON-279322147 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:26:13 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-97183e90-0400-46dd-9432-9ddc2eb567da tempest-VolumesSnapshotListTestJSON-279322147 None] Deleted volume successfully. Jul 16 23:26:13 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-88a39645-3439-4867-9198-081b187d4917 tempest-VolumeQuotasAdminTestJSON-50184744 None] Lock "cinder-quobyte-09ef6670-0822-4403-a066-4967a1ec156a" acquired by "delete_volume" :: waited 0.021s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:26:13 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-97183e90-0400-46dd-9432-9ddc2eb567da tempest-VolumesSnapshotListTestJSON-279322147 None] Lock "cinder-821f3599-9b67-419d-864f-7274e62ff31c-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:26:13 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c73539-2adc-4515-923b-46fca91a0b83]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:26:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-88a39645-3439-4867-9198-081b187d4917 tempest-VolumeQuotasAdminTestJSON-50184744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-09ef6670-0822-4403-a066-4967a1ec156a {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:14 devstack sudo[98261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-09ef6670-0822-4403-a066-4967a1ec156a Jul 16 23:26:14 devstack sudo[98261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:14 devstack sudo[98261]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-88a39645-3439-4867-9198-081b187d4917 tempest-VolumeQuotasAdminTestJSON-50184744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-09ef6670-0822-4403-a066-4967a1ec156a" returned: 0 in 0.408s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-88a39645-3439-4867-9198-081b187d4917 tempest-VolumeQuotasAdminTestJSON-50184744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-09ef6670-0822-4403-a066-4967a1ec156a {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:14 devstack sudo[98267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-09ef6670-0822-4403-a066-4967a1ec156a Jul 16 23:26:14 devstack sudo[98267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:14 devstack sudo[98267]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-88a39645-3439-4867-9198-081b187d4917 tempest-VolumeQuotasAdminTestJSON-50184744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-09ef6670-0822-4403-a066-4967a1ec156a" returned: 0 in 0.310s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:14 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-88a39645-3439-4867-9198-081b187d4917 tempest-VolumeQuotasAdminTestJSON-50184744 None] Lock "cinder-quobyte-09ef6670-0822-4403-a066-4967a1ec156a" released by "delete_volume" :: held 0.787s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:26:14 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-88a39645-3439-4867-9198-081b187d4917 tempest-VolumeQuotasAdminTestJSON-50184744 None] Created reservations ['b471a018-7650-4bd0-9137-259200772442', '59a07051-1e14-4fb6-a804-9a68d32102ae', 'acc85e69-d896-4ee6-918a-490fab0b537f', '6780f4d5-d358-4367-a49f-ce4ffeb2f46c'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:26:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-88a39645-3439-4867-9198-081b187d4917 tempest-VolumeQuotasAdminTestJSON-50184744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:26:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-88a39645-3439-4867-9198-081b187d4917 tempest-VolumeQuotasAdminTestJSON-50184744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:26:14 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-88a39645-3439-4867-9198-081b187d4917 tempest-VolumeQuotasAdminTestJSON-50184744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:26:14 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-88a39645-3439-4867-9198-081b187d4917 tempest-VolumeQuotasAdminTestJSON-50184744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:26:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-88a39645-3439-4867-9198-081b187d4917 tempest-VolumeQuotasAdminTestJSON-50184744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:26:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-88a39645-3439-4867-9198-081b187d4917 tempest-VolumeQuotasAdminTestJSON-50184744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:14 devstack sudo[98270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:26:14 devstack sudo[98270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:15 devstack sudo[98270]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-88a39645-3439-4867-9198-081b187d4917 tempest-VolumeQuotasAdminTestJSON-50184744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.341s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:15 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-88a39645-3439-4867-9198-081b187d4917 tempest-VolumeQuotasAdminTestJSON-50184744 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:26:15 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-88a39645-3439-4867-9198-081b187d4917 tempest-VolumeQuotasAdminTestJSON-50184744 None] Deleted volume successfully. Jul 16 23:26:15 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-88a39645-3439-4867-9198-081b187d4917 tempest-VolumeQuotasAdminTestJSON-50184744 None] Lock "cinder-09ef6670-0822-4403-a066-4967a1ec156a-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:26:15 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-35c81989-1164-4326-ba21-2fb111d15cc1 req-99231039-72a1-4226-93e4-2609be4ef307 tempest-AttachVolumeNegativeTest-552460454 None] Terminate volume connection completed successfully. Jul 16 23:26:15 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-35c81989-1164-4326-ba21-2fb111d15cc1 req-99231039-72a1-4226-93e4-2609be4ef307 tempest-AttachVolumeNegativeTest-552460454 None] Deleting attachment 41cbdc69-4b89-41c1-bd4d-c8e4851ba6e6. {{(pid=87607) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 23:26:18 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bb7e944-4f8b-4ceb-8142-22f55288ce25 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:26:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4bb7e944-4f8b-4ceb-8142-22f55288ce25 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Flow 'volume_create_manager' (47b22678-d1eb-4c72-9f17-29163e85f45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:26:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4bb7e944-4f8b-4ceb-8142-22f55288ce25 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9660c104-29b7-4c55-b700-8db0c4491b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:26:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4bb7e944-4f8b-4ceb-8142-22f55288ce25 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9660c104-29b7-4c55-b700-8db0c4491b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2060866985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e5c585f-c8d5-47c9-88f9-56054b361bb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f1bf39fe5124bf99d0a83893cdfcc90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:26:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:26:18Z,use_quota=True,user_id='c7529f8921a44e439a1c58211b754aa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:26:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4bb7e944-4f8b-4ceb-8142-22f55288ce25 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58a23be8-da1b-443e-b033-67e51f11eae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:26:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4bb7e944-4f8b-4ceb-8142-22f55288ce25 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58a23be8-da1b-443e-b033-67e51f11eae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:26:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4bb7e944-4f8b-4ceb-8142-22f55288ce25 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0d4453c-707e-4994-9b7a-053d36ba0ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:26:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4bb7e944-4f8b-4ceb-8142-22f55288ce25 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0d4453c-707e-4994-9b7a-053d36ba0ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e5c585f-c8d5-47c9-88f9-56054b361bb2', 'volume_name': 'volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2', 'volume_size': 2}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:26:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4bb7e944-4f8b-4ceb-8142-22f55288ce25 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ae5c97-f494-49d3-93f6-912bcbc294df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:26:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4bb7e944-4f8b-4ceb-8142-22f55288ce25 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ae5c97-f494-49d3-93f6-912bcbc294df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:26:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4bb7e944-4f8b-4ceb-8142-22f55288ce25 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26a0891f-de57-43c4-a8b4-968c592a660c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:26:18 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-4bb7e944-4f8b-4ceb-8142-22f55288ce25 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Volume 3e5c585f-c8d5-47c9-88f9-56054b361bb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2', 'volume_size': 2} Jul 16 23:26:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4bb7e944-4f8b-4ceb-8142-22f55288ce25 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:26:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4bb7e944-4f8b-4ceb-8142-22f55288ce25 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:26:18 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4bb7e944-4f8b-4ceb-8142-22f55288ce25 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2060866985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e5c585f-c8d5-47c9-88f9-56054b361bb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f1bf39fe5124bf99d0a83893cdfcc90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:26:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:26:18Z,use_quota=True,user_id='c7529f8921a44e439a1c58211b754aa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:26:18 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-4bb7e944-4f8b-4ceb-8142-22f55288ce25 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Creating volume 3e5c585f-c8d5-47c9-88f9-56054b361bb2 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:26:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4bb7e944-4f8b-4ceb-8142-22f55288ce25 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:26:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4bb7e944-4f8b-4ceb-8142-22f55288ce25 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:26:18 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4bb7e944-4f8b-4ceb-8142-22f55288ce25 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:26:18 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4bb7e944-4f8b-4ceb-8142-22f55288ce25 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:26:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4bb7e944-4f8b-4ceb-8142-22f55288ce25 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:26:18 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4bb7e944-4f8b-4ceb-8142-22f55288ce25 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:26:18 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-4bb7e944-4f8b-4ceb-8142-22f55288ce25 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:26:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4bb7e944-4f8b-4ceb-8142-22f55288ce25 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2 2147483648 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:18 devstack sudo[98299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2 2147483648 Jul 16 23:26:18 devstack sudo[98299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:19 devstack sudo[98299]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4bb7e944-4f8b-4ceb-8142-22f55288ce25 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2 2147483648" returned: 0 in 0.607s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4bb7e944-4f8b-4ceb-8142-22f55288ce25 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:19 devstack sudo[98306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2 Jul 16 23:26:19 devstack sudo[98306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:19 devstack sudo[98306]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4bb7e944-4f8b-4ceb-8142-22f55288ce25 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2" returned: 0 in 0.298s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:19 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4bb7e944-4f8b-4ceb-8142-22f55288ce25 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:26:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4bb7e944-4f8b-4ceb-8142-22f55288ce25 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:26:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4bb7e944-4f8b-4ceb-8142-22f55288ce25 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26a0891f-de57-43c4-a8b4-968c592a660c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2', 'volume_size': 2}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:26:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4bb7e944-4f8b-4ceb-8142-22f55288ce25 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58202eb9-66da-4e49-b758-1751d5111076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:26:19 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-4bb7e944-4f8b-4ceb-8142-22f55288ce25 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Volume volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2 (3e5c585f-c8d5-47c9-88f9-56054b361bb2): created successfully Jul 16 23:26:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4bb7e944-4f8b-4ceb-8142-22f55288ce25 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58202eb9-66da-4e49-b758-1751d5111076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:26:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4bb7e944-4f8b-4ceb-8142-22f55288ce25 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Flow 'volume_create_manager' (47b22678-d1eb-4c72-9f17-29163e85f45c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:26:19 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-4bb7e944-4f8b-4ceb-8142-22f55288ce25 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Created volume successfully. Jul 16 23:26:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a53f11fa-b6f7-4857-9a2f-6e0d7c346eda tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:26:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a53f11fa-b6f7-4857-9a2f-6e0d7c346eda tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:26:20 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-a53f11fa-b6f7-4857-9a2f-6e0d7c346eda tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Creating offline snapshot 0149bc83-a84a-4b8e-93b2-627f4e649520 of volume 3e5c585f-c8d5-47c9-88f9-56054b361bb2 {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:26:20 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d998e56-7fe5-404a-869c-1850219d8854]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:26:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a53f11fa-b6f7-4857-9a2f-6e0d7c346eda tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:20 devstack sudo[98309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2 Jul 16 23:26:20 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:21 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a53f11fa-b6f7-4857-9a2f-6e0d7c346eda tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2" returned: 0 in 0.436s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a53f11fa-b6f7-4857-9a2f-6e0d7c346eda tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2.0149bc83-a84a-4b8e-93b2-627f4e649520 2G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:21 devstack sudo[98314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2.0149bc83-a84a-4b8e-93b2-627f4e649520 2G Jul 16 23:26:21 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:21 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a53f11fa-b6f7-4857-9a2f-6e0d7c346eda tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2.0149bc83-a84a-4b8e-93b2-627f4e649520 2G" returned: 0 in 0.494s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a53f11fa-b6f7-4857-9a2f-6e0d7c346eda tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2.0149bc83-a84a-4b8e-93b2-627f4e649520 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:21 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2.0149bc83-a84a-4b8e-93b2-627f4e649520 Jul 16 23:26:21 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:22 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a53f11fa-b6f7-4857-9a2f-6e0d7c346eda tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2.0149bc83-a84a-4b8e-93b2-627f4e649520" returned: 0 in 0.456s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:22 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-a53f11fa-b6f7-4857-9a2f-6e0d7c346eda tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2.0149bc83-a84a-4b8e-93b2-627f4e649520 is being set with open permissions: ugo+rw Jul 16 23:26:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a53f11fa-b6f7-4857-9a2f-6e0d7c346eda tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2.0149bc83-a84a-4b8e-93b2-627f4e649520 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:22 devstack sudo[98326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2.0149bc83-a84a-4b8e-93b2-627f4e649520 Jul 16 23:26:22 devstack sudo[98326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:22 devstack sudo[98326]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a53f11fa-b6f7-4857-9a2f-6e0d7c346eda tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2.0149bc83-a84a-4b8e-93b2-627f4e649520" returned: 0 in 0.326s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a53f11fa-b6f7-4857-9a2f-6e0d7c346eda tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:22 devstack sudo[98329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2.info Jul 16 23:26:22 devstack sudo[98329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:22 devstack sudo[98329]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a53f11fa-b6f7-4857-9a2f-6e0d7c346eda tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2.info" returned: 0 in 0.394s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:22 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-a53f11fa-b6f7-4857-9a2f-6e0d7c346eda tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2.info is being set with open permissions: ugo+rw Jul 16 23:26:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a53f11fa-b6f7-4857-9a2f-6e0d7c346eda tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:22 devstack sudo[98332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2.info Jul 16 23:26:22 devstack sudo[98332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:23 devstack sudo[98332]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a53f11fa-b6f7-4857-9a2f-6e0d7c346eda tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2.info" returned: 0 in 0.314s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a53f11fa-b6f7-4857-9a2f-6e0d7c346eda tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.524s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:26:23 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-a53f11fa-b6f7-4857-9a2f-6e0d7c346eda tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Create snapshot completed successfully Jul 16 23:26:23 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:26:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Flow 'volume_create_manager' (7532ec69-7a8b-4d08-8aaf-444fd0dd6d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:26:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78017c62-2b68-4ca9-a798-dbca7cc83ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:26:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78017c62-2b68-4ca9-a798-dbca7cc83ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2107375373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3139d67-d4e4-4a30-bf96-74651ae0dbc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d3c3c4c615540f880e9d679a7d78e29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:26:24Z,use_quota=True,user_id='ab8d3fb5781f4b6a84126e2c691321ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:26:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54800b35-db40-4ccf-8c95-3fe3425fe72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:26:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54800b35-db40-4ccf-8c95-3fe3425fe72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:26:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d58d56ec-d0f5-419e-8ca0-e085ebe1af87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:26:23 devstack cinder-volume[87607]: DEBUG cinder.image.glance [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Creating Keystone auth plugin from conf {{(pid=87607) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 16 23:26:24 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-a863e3c8-90aa-4e15-8f68-fb100ac37bf6 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Acquiring lock "cinder-0149bc83-a84a-4b8e-93b2-627f4e649520-delete_snapshot" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:26:24 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-a863e3c8-90aa-4e15-8f68-fb100ac37bf6 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Lock "cinder-0149bc83-a84a-4b8e-93b2-627f4e649520-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:26:24 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-a863e3c8-90aa-4e15-8f68-fb100ac37bf6 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Acquiring lock "cinder-quobyte-3e5c585f-c8d5-47c9-88f9-56054b361bb2" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:26:24 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-a863e3c8-90aa-4e15-8f68-fb100ac37bf6 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Lock "cinder-quobyte-3e5c585f-c8d5-47c9-88f9-56054b361bb2" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:26:24 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-a863e3c8-90aa-4e15-8f68-fb100ac37bf6 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Acquiring lock "cinder-quobyte-0149bc83-a84a-4b8e-93b2-627f4e649520" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:26:24 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-a863e3c8-90aa-4e15-8f68-fb100ac37bf6 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Lock "cinder-quobyte-0149bc83-a84a-4b8e-93b2-627f4e649520" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:26:24 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-a863e3c8-90aa-4e15-8f68-fb100ac37bf6 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Deleting offline snapshot 0149bc83-a84a-4b8e-93b2-627f4e649520 of volume 3e5c585f-c8d5-47c9-88f9-56054b361bb2 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:26:24 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-a863e3c8-90aa-4e15-8f68-fb100ac37bf6 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] snapshot_file for this snap is: volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2.0149bc83-a84a-4b8e-93b2-627f4e649520 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:26:24 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cba7164-630a-4e86-9bcf-f5bce741637c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:26:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a863e3c8-90aa-4e15-8f68-fb100ac37bf6 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2.0149bc83-a84a-4b8e-93b2-627f4e649520 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:24 devstack sudo[98338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2.0149bc83-a84a-4b8e-93b2-627f4e649520 Jul 16 23:26:24 devstack sudo[98338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:24 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d58d56ec-d0f5-419e-8ca0-e085ebe1af87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f3139d67-d4e4-4a30-bf96-74651ae0dbc1', 'volume_name': 'volume-f3139d67-d4e4-4a30-bf96-74651ae0dbc1', 'volume_size': 1, 'image_id': '6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3319c84d612344f1b9ca29a92bf5a474', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'created_at': datetime.datetime(2026, 7, 16, 21, 12, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 21, 12, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6519f5ae-0b5b-4a63-9b9b-0adb6304882e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:26:24 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e57bb5d-9682-47d5-aa6f-38b683ef4b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:26:24 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e57bb5d-9682-47d5-aa6f-38b683ef4b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:26:24 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2a5ea7-c2a8-4719-a76d-d39b1f3647e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:26:24 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Volume f3139d67-d4e4-4a30-bf96-74651ae0dbc1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f3139d67-d4e4-4a30-bf96-74651ae0dbc1', 'volume_size': 1, 'image_id': '6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3319c84d612344f1b9ca29a92bf5a474', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'created_at': datetime.datetime(2026, 7, 16, 21, 12, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 21, 12, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6519f5ae-0b5b-4a63-9b9b-0adb6304882e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 16 23:26:24 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Trying to clone f3139d67-d4e4-4a30-bf96-74651ae0dbc1 from image 6519f5ae-0b5b-4a63-9b9b-0adb6304882e at location (None, [{'url': 'file:///opt/stack/data/glance/images/6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'metadata': {}}]). {{(pid=87607) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 16 23:26:24 devstack sudo[98338]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a863e3c8-90aa-4e15-8f68-fb100ac37bf6 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2.0149bc83-a84a-4b8e-93b2-627f4e649520" returned: 0 in 0.449s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:24 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-a863e3c8-90aa-4e15-8f68-fb100ac37bf6 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:26:24 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e655dc0-4034-4901-bab6-a7729c3f8d1f]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:26:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a863e3c8-90aa-4e15-8f68-fb100ac37bf6 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:24 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_mvreqs98devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87607) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 16 23:26:24 devstack cinder-volume[87607]: INFO cinder.image.image_utils [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Image download 20.69 MB at 20.69 MB/s Jul 16 23:26:24 devstack sudo[98344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2 Jul 16 23:26:24 devstack sudo[98344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:24 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[356c4441-efc5-4c20-b7b2-6a7e2c8300f0]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:26:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_mvreqs98devstack@QuobyteHD {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:24 devstack sudo[98351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_mvreqs98devstack@QuobyteHD Jul 16 23:26:25 devstack sudo[98351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:25 devstack sudo[98344]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a863e3c8-90aa-4e15-8f68-fb100ac37bf6 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2" returned: 0 in 0.565s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a863e3c8-90aa-4e15-8f68-fb100ac37bf6 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2.0149bc83-a84a-4b8e-93b2-627f4e649520 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:25 devstack sudo[98358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2.0149bc83-a84a-4b8e-93b2-627f4e649520 Jul 16 23:26:25 devstack sudo[98358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:25 devstack sudo[98351]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_mvreqs98devstack@QuobyteHD" returned: 0 in 0.460s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:25 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Temporary image 6519f5ae-0b5b-4a63-9b9b-0adb6304882e is fetched for user ab8d3fb5781f4b6a84126e2c691321ab. {{(pid=87607) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 16 23:26:25 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa854776-b373-41bf-8712-74b60e26c03d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:26:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_mvreqs98devstack@QuobyteHD {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:25 devstack sudo[98364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_mvreqs98devstack@QuobyteHD Jul 16 23:26:25 devstack sudo[98364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:25 devstack sudo[98358]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a863e3c8-90aa-4e15-8f68-fb100ac37bf6 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2.0149bc83-a84a-4b8e-93b2-627f4e649520" returned: 0 in 0.532s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a863e3c8-90aa-4e15-8f68-fb100ac37bf6 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2.0149bc83-a84a-4b8e-93b2-627f4e649520 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:25 devstack sudo[98371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2.0149bc83-a84a-4b8e-93b2-627f4e649520 Jul 16 23:26:25 devstack sudo[98371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:25 devstack sudo[98364]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_mvreqs98devstack@QuobyteHD" returned: 0 in 0.520s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:26:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:26:25 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2107375373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3139d67-d4e4-4a30-bf96-74651ae0dbc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d3c3c4c615540f880e9d679a7d78e29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:26:24Z,use_quota=True,user_id='ab8d3fb5781f4b6a84126e2c691321ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:26:25 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Creating volume f3139d67-d4e4-4a30-bf96-74651ae0dbc1 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:26:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:26:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:26:25 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:26:25 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:26:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:26:25 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:26:25 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:26:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f3139d67-d4e4-4a30-bf96-74651ae0dbc1 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:26 devstack sudo[98381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f3139d67-d4e4-4a30-bf96-74651ae0dbc1 1073741824 Jul 16 23:26:26 devstack sudo[98381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:26 devstack sudo[98371]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a863e3c8-90aa-4e15-8f68-fb100ac37bf6 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2.0149bc83-a84a-4b8e-93b2-627f4e649520" returned: 0 in 0.519s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:26 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-a863e3c8-90aa-4e15-8f68-fb100ac37bf6 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Lock "cinder-quobyte-0149bc83-a84a-4b8e-93b2-627f4e649520" released by "_delete_snapshot" :: held 2.239s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:26:26 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-a863e3c8-90aa-4e15-8f68-fb100ac37bf6 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Lock "cinder-quobyte-3e5c585f-c8d5-47c9-88f9-56054b361bb2" released by "delete_snapshot" :: held 2.268s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:26:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-ed0b7dac-40ee-4241-a236-d833d3885bd5 req-826baaa4-0070-4998-af20-5f48e77a884a tempest-TestStampPattern-699542814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:26:26 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-a863e3c8-90aa-4e15-8f68-fb100ac37bf6 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Created reservations ['ff6c652a-a53b-4bec-88f7-e40ff0a98a17', 'ad7bd223-d307-4852-8095-33c4710ed18a', '93581631-ad67-45a7-a103-8bbfb430a8df', '9f75fd5f-04cf-43c3-9283-52cea6f56144'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:26:26 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-a863e3c8-90aa-4e15-8f68-fb100ac37bf6 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Delete snapshot completed successfully. Jul 16 23:26:26 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-a863e3c8-90aa-4e15-8f68-fb100ac37bf6 tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Lock "cinder-0149bc83-a84a-4b8e-93b2-627f4e649520-delete_snapshot" released by "delete_snapshot" :: held 2.460s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:26:26 devstack sudo[98381]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f3139d67-d4e4-4a30-bf96-74651ae0dbc1 1073741824" returned: 0 in 0.692s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f3139d67-d4e4-4a30-bf96-74651ae0dbc1 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:26 devstack sudo[98408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f3139d67-d4e4-4a30-bf96-74651ae0dbc1 Jul 16 23:26:26 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:26 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f3139d67-d4e4-4a30-bf96-74651ae0dbc1" returned: 0 in 0.257s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:26 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:26:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:26:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-ed0b7dac-40ee-4241-a236-d833d3885bd5 req-826baaa4-0070-4998-af20-5f48e77a884a tempest-TestStampPattern-699542814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.629s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:26:27 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[64185de7-8c5e-432f-8362-3922b11e4736]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:26:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-ed0b7dac-40ee-4241-a236-d833d3885bd5 req-826baaa4-0070-4998-af20-5f48e77a884a tempest-TestStampPattern-699542814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-244186ea-b0f6-4e65-aea7-5ab476896725 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:27 devstack cinder-volume[87607]: DEBUG cinder.volume.volume_utils [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Attempting download of 6519f5ae-0b5b-4a63-9b9b-0adb6304882e ((None, [{'url': 'file:///opt/stack/data/glance/images/6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'metadata': {}}])) to volume f3139d67-d4e4-4a30-bf96-74651ae0dbc1. {{(pid=87607) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 16 23:26:27 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbbd2bf-893b-4823-b52e-823eef7c79e4]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:26:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_1m0p122l {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:27 devstack sudo[98411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-244186ea-b0f6-4e65-aea7-5ab476896725 Jul 16 23:26:27 devstack sudo[98411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:27 devstack sudo[98412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_1m0p122l Jul 16 23:26:27 devstack sudo[98412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:27 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ef90daab-72cd-409a-aad9-81f9687ac7bd tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Acquiring lock "cinder-3e5c585f-c8d5-47c9-88f9-56054b361bb2-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:26:27 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ef90daab-72cd-409a-aad9-81f9687ac7bd tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Lock "cinder-3e5c585f-c8d5-47c9-88f9-56054b361bb2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:26:27 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ef90daab-72cd-409a-aad9-81f9687ac7bd tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Acquiring lock "cinder-quobyte-3e5c585f-c8d5-47c9-88f9-56054b361bb2" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:26:27 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ef90daab-72cd-409a-aad9-81f9687ac7bd tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Lock "cinder-quobyte-3e5c585f-c8d5-47c9-88f9-56054b361bb2" acquired by "delete_volume" :: waited 0.018s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:26:27 devstack sudo[98411]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:27 devstack sudo[98412]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-ed0b7dac-40ee-4241-a236-d833d3885bd5 req-826baaa4-0070-4998-af20-5f48e77a884a tempest-TestStampPattern-699542814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-244186ea-b0f6-4e65-aea7-5ab476896725" returned: 0 in 0.473s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-ed0b7dac-40ee-4241-a236-d833d3885bd5 req-826baaa4-0070-4998-af20-5f48e77a884a tempest-TestStampPattern-699542814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.508s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:26:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_1m0p122l" returned: 0 in 0.404s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_1m0p122l {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:27 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[682e3896-59f9-4747-8b1d-1a4e649168bc]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:26:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ef90daab-72cd-409a-aad9-81f9687ac7bd tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-ed0b7dac-40ee-4241-a236-d833d3885bd5 req-826baaa4-0070-4998-af20-5f48e77a884a tempest-TestStampPattern-699542814 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72', 'name': 'volume-244186ea-b0f6-4e65-aea7-5ab476896725', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '46e34e00-d69b-443b-bf41-5a9402915558', 'enforce_multipath': True} {{(pid=87607) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 23:26:27 devstack sudo[98420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_1m0p122l Jul 16 23:26:27 devstack sudo[98420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:27 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-ed0b7dac-40ee-4241-a236-d833d3885bd5 req-826baaa4-0070-4998-af20-5f48e77a884a tempest-TestStampPattern-699542814 None] attachment_update completed successfully. Jul 16 23:26:27 devstack sudo[98421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2 Jul 16 23:26:27 devstack sudo[98421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:27 devstack sudo[98420]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_1m0p122l" returned: 1 in 0.450s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_1m0p122l' failed. Not Retrying. {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 23:26:27 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bc382c-9aed-4750-a18f-4c72e376de0e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:26:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_mvreqs98devstack@QuobyteHD {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:28 devstack sudo[98421]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ef90daab-72cd-409a-aad9-81f9687ac7bd tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2" returned: 0 in 0.513s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ef90daab-72cd-409a-aad9-81f9687ac7bd tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:28 devstack sudo[98498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2 Jul 16 23:26:28 devstack sudo[98498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:28 devstack sudo[98494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_mvreqs98devstack@QuobyteHD Jul 16 23:26:28 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:28 devstack sudo[98498]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ef90daab-72cd-409a-aad9-81f9687ac7bd tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3e5c585f-c8d5-47c9-88f9-56054b361bb2" returned: 0 in 0.368s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:28 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ef90daab-72cd-409a-aad9-81f9687ac7bd tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Lock "cinder-quobyte-3e5c585f-c8d5-47c9-88f9-56054b361bb2" released by "delete_volume" :: held 0.967s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:26:28 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_mvreqs98devstack@QuobyteHD" returned: 0 in 0.524s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:28 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] 6519f5ae-0b5b-4a63-9b9b-0adb6304882e was qcow2, converting to qcow2 {{(pid=87607) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 16 23:26:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_mvreqs98devstack@QuobyteHD /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f3139d67-d4e4-4a30-bf96-74651ae0dbc1 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:28 devstack sudo[98822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_mvreqs98devstack@QuobyteHD /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f3139d67-d4e4-4a30-bf96-74651ae0dbc1 Jul 16 23:26:28 devstack sudo[98822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:28 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-ef90daab-72cd-409a-aad9-81f9687ac7bd tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Created reservations ['2cd00c61-9d7f-4a83-9083-44294d8b71b1', '56ac56f7-9131-4c66-a6e6-8ffa9666295e', 'bf7cffd3-4c91-421c-96f0-0607506a281d', '23d7c2f7-ab13-4608-ac39-91a229d86180'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:26:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ef90daab-72cd-409a-aad9-81f9687ac7bd tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:26:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ef90daab-72cd-409a-aad9-81f9687ac7bd tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:26:28 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ef90daab-72cd-409a-aad9-81f9687ac7bd tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:26:28 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ef90daab-72cd-409a-aad9-81f9687ac7bd tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:26:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ef90daab-72cd-409a-aad9-81f9687ac7bd tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:26:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ef90daab-72cd-409a-aad9-81f9687ac7bd tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:28 devstack sudo[98824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:26:28 devstack sudo[98824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:29 devstack sudo[98824]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ef90daab-72cd-409a-aad9-81f9687ac7bd tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.560s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:29 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-ef90daab-72cd-409a-aad9-81f9687ac7bd tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:26:29 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-ef90daab-72cd-409a-aad9-81f9687ac7bd tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Deleted volume successfully. Jul 16 23:26:29 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ef90daab-72cd-409a-aad9-81f9687ac7bd tempest-VolumesSnapshotNegativeTestJSON-1884451402 None] Lock "cinder-3e5c585f-c8d5-47c9-88f9-56054b361bb2-delete_volume" released by "delete_volume" :: held 1.938s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:26:31 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-bf197210-f8ca-44bb-8d7b-0e6717bd24a4 req-c11d310a-31ff-4bc1-b693-6dfc239ac6b3 tempest-TestStampPattern-699542814 None] Terminate volume connection completed successfully. Jul 16 23:26:31 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-bf197210-f8ca-44bb-8d7b-0e6717bd24a4 req-c11d310a-31ff-4bc1-b693-6dfc239ac6b3 tempest-TestStampPattern-699542814 None] Deleting attachment 46e34e00-d69b-443b-bf41-5a9402915558. {{(pid=87607) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 23:26:31 devstack sudo[98822]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_mvreqs98devstack@QuobyteHD /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f3139d67-d4e4-4a30-bf96-74651ae0dbc1" returned: 0 in 3.396s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:31 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_mvreqs98devstack@QuobyteHD, size 112.00 MB, duration 3.40 sec, destination /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f3139d67-d4e4-4a30-bf96-74651ae0dbc1 {{(pid=87607) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 23:26:31 devstack cinder-volume[87607]: INFO cinder.image.image_utils [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Converted 112.00 MB image at 32.96 MB/s Jul 16 23:26:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f3139d67-d4e4-4a30-bf96-74651ae0dbc1 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:31 devstack sudo[98945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f3139d67-d4e4-4a30-bf96-74651ae0dbc1 1G Jul 16 23:26:31 devstack sudo[98945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:32 devstack sudo[98945]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f3139d67-d4e4-4a30-bf96-74651ae0dbc1 1G" returned: 0 in 0.561s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:32 devstack cinder-volume[87607]: DEBUG cinder.volume.volume_utils [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Downloaded image 6519f5ae-0b5b-4a63-9b9b-0adb6304882e ((None, [{'url': 'file:///opt/stack/data/glance/images/6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'metadata': {}}])) to volume f3139d67-d4e4-4a30-bf96-74651ae0dbc1 successfully. {{(pid=87607) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 16 23:26:32 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Temporary image 6519f5ae-0b5b-4a63-9b9b-0adb6304882e for user ab8d3fb5781f4b6a84126e2c691321ab is deleted. {{(pid=87607) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 16 23:26:32 devstack cinder-volume[87607]: DEBUG cinder.volume.volume_utils [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Marking volume f3139d67-d4e4-4a30-bf96-74651ae0dbc1 as bootable. {{(pid=87607) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 16 23:26:32 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Copying metadata from image 6519f5ae-0b5b-4a63-9b9b-0adb6304882e to f3139d67-d4e4-4a30-bf96-74651ae0dbc1. {{(pid=87607) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 16 23:26:32 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Creating volume glance metadata for volume f3139d67-d4e4-4a30-bf96-74651ae0dbc1 backed by image 6519f5ae-0b5b-4a63-9b9b-0adb6304882e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87607) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 16 23:26:32 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2a5ea7-c2a8-4719-a76d-d39b1f3647e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3139d67-d4e4-4a30-bf96-74651ae0dbc1', 'volume_size': 1, 'image_id': '6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3319c84d612344f1b9ca29a92bf5a474', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'created_at': datetime.datetime(2026, 7, 16, 21, 12, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 21, 12, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6519f5ae-0b5b-4a63-9b9b-0adb6304882e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:26:32 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e60c07f7-f0f0-472d-b2b8-70b437dc5c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:26:32 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Volume volume-f3139d67-d4e4-4a30-bf96-74651ae0dbc1 (f3139d67-d4e4-4a30-bf96-74651ae0dbc1): created successfully Jul 16 23:26:32 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e60c07f7-f0f0-472d-b2b8-70b437dc5c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:26:32 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Flow 'volume_create_manager' (7532ec69-7a8b-4d08-8aaf-444fd0dd6d6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:26:32 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-f90bb39b-33de-480e-bdf2-c075ed666433 tempest-VolumesImageMetadata-1578074050 None] Created volume successfully. Jul 16 23:26:34 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f508f696-16f4-4955-b058-601635e48a6b tempest-VolumesImageMetadata-1578074050 None] Acquiring lock "cinder-f3139d67-d4e4-4a30-bf96-74651ae0dbc1-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:26:34 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f508f696-16f4-4955-b058-601635e48a6b tempest-VolumesImageMetadata-1578074050 None] Lock "cinder-f3139d67-d4e4-4a30-bf96-74651ae0dbc1-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:26:34 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f508f696-16f4-4955-b058-601635e48a6b tempest-VolumesImageMetadata-1578074050 None] Acquiring lock "cinder-quobyte-f3139d67-d4e4-4a30-bf96-74651ae0dbc1" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:26:35 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f508f696-16f4-4955-b058-601635e48a6b tempest-VolumesImageMetadata-1578074050 None] Lock "cinder-quobyte-f3139d67-d4e4-4a30-bf96-74651ae0dbc1" acquired by "delete_volume" :: waited 0.036s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:26:35 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[599b1b80-a0da-49ec-9338-a86242f6cce4]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:26:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f508f696-16f4-4955-b058-601635e48a6b tempest-VolumesImageMetadata-1578074050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f3139d67-d4e4-4a30-bf96-74651ae0dbc1 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:35 devstack sudo[99008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f3139d67-d4e4-4a30-bf96-74651ae0dbc1 Jul 16 23:26:35 devstack sudo[99008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:35 devstack sudo[99008]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f508f696-16f4-4955-b058-601635e48a6b tempest-VolumesImageMetadata-1578074050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f3139d67-d4e4-4a30-bf96-74651ae0dbc1" returned: 0 in 0.700s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f508f696-16f4-4955-b058-601635e48a6b tempest-VolumesImageMetadata-1578074050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f3139d67-d4e4-4a30-bf96-74651ae0dbc1 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:35 devstack sudo[99017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f3139d67-d4e4-4a30-bf96-74651ae0dbc1 Jul 16 23:26:35 devstack sudo[99017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:36 devstack sudo[99017]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f508f696-16f4-4955-b058-601635e48a6b tempest-VolumesImageMetadata-1578074050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f3139d67-d4e4-4a30-bf96-74651ae0dbc1" returned: 0 in 0.388s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:36 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f508f696-16f4-4955-b058-601635e48a6b tempest-VolumesImageMetadata-1578074050 None] Lock "cinder-quobyte-f3139d67-d4e4-4a30-bf96-74651ae0dbc1" released by "delete_volume" :: held 1.195s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:26:36 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-f508f696-16f4-4955-b058-601635e48a6b tempest-VolumesImageMetadata-1578074050 None] Created reservations ['8e3eec68-252f-455d-8434-f3bc4695c335', '9bbb48df-5bd8-47f4-aeff-8924854a760f', 'e934a103-f955-422a-bc48-09d00c397906', '19bd9d2c-5190-4bba-b8fb-cf87f5e235b9'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:26:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f508f696-16f4-4955-b058-601635e48a6b tempest-VolumesImageMetadata-1578074050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:26:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f508f696-16f4-4955-b058-601635e48a6b tempest-VolumesImageMetadata-1578074050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:26:36 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f508f696-16f4-4955-b058-601635e48a6b tempest-VolumesImageMetadata-1578074050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:26:36 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f508f696-16f4-4955-b058-601635e48a6b tempest-VolumesImageMetadata-1578074050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:26:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f508f696-16f4-4955-b058-601635e48a6b tempest-VolumesImageMetadata-1578074050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:26:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f508f696-16f4-4955-b058-601635e48a6b tempest-VolumesImageMetadata-1578074050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:36 devstack sudo[99021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:26:36 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:36 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f508f696-16f4-4955-b058-601635e48a6b tempest-VolumesImageMetadata-1578074050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.471s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:36 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-f508f696-16f4-4955-b058-601635e48a6b tempest-VolumesImageMetadata-1578074050 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:26:36 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-f508f696-16f4-4955-b058-601635e48a6b tempest-VolumesImageMetadata-1578074050 None] Deleted volume successfully. Jul 16 23:26:36 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f508f696-16f4-4955-b058-601635e48a6b tempest-VolumesImageMetadata-1578074050 None] Lock "cinder-f3139d67-d4e4-4a30-bf96-74651ae0dbc1-delete_volume" released by "delete_volume" :: held 2.031s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:26:39 devstack cinder-volume[87607]: DEBUG oslo_service.periodic_task [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:26:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:26:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:26:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:26:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:26:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:26:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:39 devstack sudo[99026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:26:39 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:39 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-770245fb-26c8-4321-b4be-508feaefd5a7 tempest-TestStampPattern-699542814 None] Acquiring lock "cinder-244186ea-b0f6-4e65-aea7-5ab476896725-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:26:39 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.529s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:40 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:26:40 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-770245fb-26c8-4321-b4be-508feaefd5a7 tempest-TestStampPattern-699542814 None] Lock "cinder-244186ea-b0f6-4e65-aea7-5ab476896725-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:26:40 devstack cinder-volume[87607]: DEBUG oslo_service.periodic_task [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running periodic task VolumeManager._thread_info {{(pid=87607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:26:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] thread count: 28 {{(pid=87607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 23:26:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] thread info: [<_MainThread(MainThread, started 139090403627136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 23:26:40 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-770245fb-26c8-4321-b4be-508feaefd5a7 tempest-TestStampPattern-699542814 None] Acquiring lock "cinder-quobyte-244186ea-b0f6-4e65-aea7-5ab476896725" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:26:40 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-770245fb-26c8-4321-b4be-508feaefd5a7 tempest-TestStampPattern-699542814 None] Lock "cinder-quobyte-244186ea-b0f6-4e65-aea7-5ab476896725" acquired by "delete_volume" :: waited 0.033s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:26:40 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f35e28-ee29-4d76-940f-380d865e2c3c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:26:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-770245fb-26c8-4321-b4be-508feaefd5a7 tempest-TestStampPattern-699542814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-244186ea-b0f6-4e65-aea7-5ab476896725 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:40 devstack sudo[99029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-244186ea-b0f6-4e65-aea7-5ab476896725 Jul 16 23:26:40 devstack sudo[99029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:40 devstack sudo[99029]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-770245fb-26c8-4321-b4be-508feaefd5a7 tempest-TestStampPattern-699542814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-244186ea-b0f6-4e65-aea7-5ab476896725" returned: 0 in 0.426s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-770245fb-26c8-4321-b4be-508feaefd5a7 tempest-TestStampPattern-699542814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-244186ea-b0f6-4e65-aea7-5ab476896725 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:40 devstack sudo[99034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-244186ea-b0f6-4e65-aea7-5ab476896725 Jul 16 23:26:40 devstack sudo[99034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:40 devstack sudo[99034]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-770245fb-26c8-4321-b4be-508feaefd5a7 tempest-TestStampPattern-699542814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-244186ea-b0f6-4e65-aea7-5ab476896725" returned: 0 in 0.305s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:40 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-770245fb-26c8-4321-b4be-508feaefd5a7 tempest-TestStampPattern-699542814 None] Lock "cinder-quobyte-244186ea-b0f6-4e65-aea7-5ab476896725" released by "delete_volume" :: held 0.796s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:26:41 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-770245fb-26c8-4321-b4be-508feaefd5a7 tempest-TestStampPattern-699542814 None] Created reservations ['d2b06f94-5991-46dc-a5a8-47f7ef9dab84', 'db16474d-8f83-45c9-ba77-c4e36f01b083', '9ceedb61-5e5b-4f4d-a2bc-f906cb184bc7', 'dc05fccb-16d9-49ba-b260-b0cac017b689'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:26:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-770245fb-26c8-4321-b4be-508feaefd5a7 tempest-TestStampPattern-699542814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:26:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-770245fb-26c8-4321-b4be-508feaefd5a7 tempest-TestStampPattern-699542814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:26:41 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-770245fb-26c8-4321-b4be-508feaefd5a7 tempest-TestStampPattern-699542814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:26:41 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-770245fb-26c8-4321-b4be-508feaefd5a7 tempest-TestStampPattern-699542814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:26:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-770245fb-26c8-4321-b4be-508feaefd5a7 tempest-TestStampPattern-699542814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:26:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-770245fb-26c8-4321-b4be-508feaefd5a7 tempest-TestStampPattern-699542814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:41 devstack sudo[99037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:26:41 devstack sudo[99037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:41 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-daaf375e-b187-4095-aa66-89c28a75da07 tempest-TestStampPattern-699542814 None] Acquiring lock "cinder-d825ced7-1eb3-4c3b-85ca-324c41ab3d57-delete_snapshot" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:26:41 devstack sudo[99037]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-770245fb-26c8-4321-b4be-508feaefd5a7 tempest-TestStampPattern-699542814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.579s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:41 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-770245fb-26c8-4321-b4be-508feaefd5a7 tempest-TestStampPattern-699542814 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:26:41 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-770245fb-26c8-4321-b4be-508feaefd5a7 tempest-TestStampPattern-699542814 None] Deleted volume successfully. Jul 16 23:26:41 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-daaf375e-b187-4095-aa66-89c28a75da07 tempest-TestStampPattern-699542814 None] Lock "cinder-d825ced7-1eb3-4c3b-85ca-324c41ab3d57-delete_snapshot" acquired by "delete_snapshot" :: waited 0.098s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:26:41 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-daaf375e-b187-4095-aa66-89c28a75da07 tempest-TestStampPattern-699542814 None] Acquiring lock "cinder-quobyte-d2a74ad6-9996-4227-936e-f93dcce122a7" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:26:41 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-daaf375e-b187-4095-aa66-89c28a75da07 tempest-TestStampPattern-699542814 None] Lock "cinder-quobyte-d2a74ad6-9996-4227-936e-f93dcce122a7" acquired by "delete_snapshot" :: waited 0.064s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:26:41 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-daaf375e-b187-4095-aa66-89c28a75da07 tempest-TestStampPattern-699542814 None] Acquiring lock "cinder-quobyte-d825ced7-1eb3-4c3b-85ca-324c41ab3d57" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:26:41 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-770245fb-26c8-4321-b4be-508feaefd5a7 tempest-TestStampPattern-699542814 None] Lock "cinder-244186ea-b0f6-4e65-aea7-5ab476896725-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:26:41 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-daaf375e-b187-4095-aa66-89c28a75da07 tempest-TestStampPattern-699542814 None] Lock "cinder-quobyte-d825ced7-1eb3-4c3b-85ca-324c41ab3d57" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:26:41 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-daaf375e-b187-4095-aa66-89c28a75da07 tempest-TestStampPattern-699542814 None] Deleting offline snapshot d825ced7-1eb3-4c3b-85ca-324c41ab3d57 of volume d2a74ad6-9996-4227-936e-f93dcce122a7 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:26:41 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-daaf375e-b187-4095-aa66-89c28a75da07 tempest-TestStampPattern-699542814 None] snapshot_file for this snap is: volume-d2a74ad6-9996-4227-936e-f93dcce122a7.d825ced7-1eb3-4c3b-85ca-324c41ab3d57 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:26:41 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f39c6d-7911-4449-931a-5929d747affc]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:26:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-daaf375e-b187-4095-aa66-89c28a75da07 tempest-TestStampPattern-699542814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7.d825ced7-1eb3-4c3b-85ca-324c41ab3d57 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:42 devstack sudo[99040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7.d825ced7-1eb3-4c3b-85ca-324c41ab3d57 Jul 16 23:26:42 devstack sudo[99040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:42 devstack sudo[99040]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-daaf375e-b187-4095-aa66-89c28a75da07 tempest-TestStampPattern-699542814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7.d825ced7-1eb3-4c3b-85ca-324c41ab3d57" returned: 0 in 0.615s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:42 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-daaf375e-b187-4095-aa66-89c28a75da07 tempest-TestStampPattern-699542814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2a74ad6-9996-4227-936e-f93dcce122a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:26:42 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[5196421f-d83d-4a90-a2b5-178de0ab2c46]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:26:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-daaf375e-b187-4095-aa66-89c28a75da07 tempest-TestStampPattern-699542814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:42 devstack sudo[99047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7 Jul 16 23:26:42 devstack sudo[99047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:43 devstack sudo[99047]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-daaf375e-b187-4095-aa66-89c28a75da07 tempest-TestStampPattern-699542814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7" returned: 0 in 0.489s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-daaf375e-b187-4095-aa66-89c28a75da07 tempest-TestStampPattern-699542814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7.d825ced7-1eb3-4c3b-85ca-324c41ab3d57 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:43 devstack sudo[99052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7.d825ced7-1eb3-4c3b-85ca-324c41ab3d57 Jul 16 23:26:43 devstack sudo[99052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:43 devstack sudo[99052]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-daaf375e-b187-4095-aa66-89c28a75da07 tempest-TestStampPattern-699542814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7.d825ced7-1eb3-4c3b-85ca-324c41ab3d57" returned: 0 in 0.516s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-daaf375e-b187-4095-aa66-89c28a75da07 tempest-TestStampPattern-699542814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7.d825ced7-1eb3-4c3b-85ca-324c41ab3d57 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:43 devstack sudo[99075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7.d825ced7-1eb3-4c3b-85ca-324c41ab3d57 Jul 16 23:26:43 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:43 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-daaf375e-b187-4095-aa66-89c28a75da07 tempest-TestStampPattern-699542814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7.d825ced7-1eb3-4c3b-85ca-324c41ab3d57" returned: 0 in 0.295s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:43 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-daaf375e-b187-4095-aa66-89c28a75da07 tempest-TestStampPattern-699542814 None] Lock "cinder-quobyte-d825ced7-1eb3-4c3b-85ca-324c41ab3d57" released by "_delete_snapshot" :: held 2.099s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:26:43 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-daaf375e-b187-4095-aa66-89c28a75da07 tempest-TestStampPattern-699542814 None] Lock "cinder-quobyte-d2a74ad6-9996-4227-936e-f93dcce122a7" released by "delete_snapshot" :: held 2.152s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:26:44 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-daaf375e-b187-4095-aa66-89c28a75da07 tempest-TestStampPattern-699542814 None] Created reservations ['49c7b041-a27c-4d8a-964c-14728dc1f46c', 'e21c1f46-cd06-4393-8dbc-bfd17c15d2ed', '68eb78be-fdfe-49fc-bf19-c6509aedc929', 'bdb386e7-d34b-4994-bd22-8c076b868595'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:26:44 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-daaf375e-b187-4095-aa66-89c28a75da07 tempest-TestStampPattern-699542814 None] Delete snapshot completed successfully. Jul 16 23:26:44 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-daaf375e-b187-4095-aa66-89c28a75da07 tempest-TestStampPattern-699542814 None] Lock "cinder-d825ced7-1eb3-4c3b-85ca-324c41ab3d57-delete_snapshot" released by "delete_snapshot" :: held 2.374s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:26:45 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfabcb78-d074-4e87-8502-cbe2ba5240ed tempest-VolumesDeleteCascade-165231006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:26:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-dfabcb78-d074-4e87-8502-cbe2ba5240ed tempest-VolumesDeleteCascade-165231006 None] Flow 'volume_create_manager' (34ae3290-5070-4b18-b10e-f7ae558747d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:26:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-dfabcb78-d074-4e87-8502-cbe2ba5240ed tempest-VolumesDeleteCascade-165231006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2377cad5-d255-466d-a2e9-642bbcbc1d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:26:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-dfabcb78-d074-4e87-8502-cbe2ba5240ed tempest-VolumesDeleteCascade-165231006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2377cad5-d255-466d-a2e9-642bbcbc1d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1267688291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bdc726ed36747e8bcd23d011da669df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:26:45Z,use_quota=True,user_id='09faea5448b440d28c19bf8823dcafd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:26:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-dfabcb78-d074-4e87-8502-cbe2ba5240ed tempest-VolumesDeleteCascade-165231006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da5928e4-0641-4282-8198-ee63a9cef15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:26:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-dfabcb78-d074-4e87-8502-cbe2ba5240ed tempest-VolumesDeleteCascade-165231006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da5928e4-0641-4282-8198-ee63a9cef15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:26:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-dfabcb78-d074-4e87-8502-cbe2ba5240ed tempest-VolumesDeleteCascade-165231006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7cb0956-849b-4b5b-a0e6-8c62ee09b38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:26:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-dfabcb78-d074-4e87-8502-cbe2ba5240ed tempest-VolumesDeleteCascade-165231006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7cb0956-849b-4b5b-a0e6-8c62ee09b38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0', 'volume_name': 'volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:26:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-dfabcb78-d074-4e87-8502-cbe2ba5240ed tempest-VolumesDeleteCascade-165231006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f8c4b18-3826-4035-afb7-8091f77fe9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:26:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-dfabcb78-d074-4e87-8502-cbe2ba5240ed tempest-VolumesDeleteCascade-165231006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f8c4b18-3826-4035-afb7-8091f77fe9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:26:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-dfabcb78-d074-4e87-8502-cbe2ba5240ed tempest-VolumesDeleteCascade-165231006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faca90fc-4e1b-474a-876b-d8d752e33ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:26:45 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-dfabcb78-d074-4e87-8502-cbe2ba5240ed tempest-VolumesDeleteCascade-165231006 None] Volume f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0', 'volume_size': 1} Jul 16 23:26:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-dfabcb78-d074-4e87-8502-cbe2ba5240ed tempest-VolumesDeleteCascade-165231006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:26:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-dfabcb78-d074-4e87-8502-cbe2ba5240ed tempest-VolumesDeleteCascade-165231006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:26:45 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-dfabcb78-d074-4e87-8502-cbe2ba5240ed tempest-VolumesDeleteCascade-165231006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1267688291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bdc726ed36747e8bcd23d011da669df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:26:45Z,use_quota=True,user_id='09faea5448b440d28c19bf8823dcafd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:26:45 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-dfabcb78-d074-4e87-8502-cbe2ba5240ed tempest-VolumesDeleteCascade-165231006 None] Creating volume f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:26:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-dfabcb78-d074-4e87-8502-cbe2ba5240ed tempest-VolumesDeleteCascade-165231006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:26:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-dfabcb78-d074-4e87-8502-cbe2ba5240ed tempest-VolumesDeleteCascade-165231006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:26:45 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-dfabcb78-d074-4e87-8502-cbe2ba5240ed tempest-VolumesDeleteCascade-165231006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:26:45 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-dfabcb78-d074-4e87-8502-cbe2ba5240ed tempest-VolumesDeleteCascade-165231006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:26:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-dfabcb78-d074-4e87-8502-cbe2ba5240ed tempest-VolumesDeleteCascade-165231006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:26:45 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-dfabcb78-d074-4e87-8502-cbe2ba5240ed tempest-VolumesDeleteCascade-165231006 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:26:45 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-dfabcb78-d074-4e87-8502-cbe2ba5240ed tempest-VolumesDeleteCascade-165231006 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:26:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-dfabcb78-d074-4e87-8502-cbe2ba5240ed tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:45 devstack sudo[99079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0 1073741824 Jul 16 23:26:45 devstack sudo[99079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:45 devstack sudo[99079]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-dfabcb78-d074-4e87-8502-cbe2ba5240ed tempest-VolumesDeleteCascade-165231006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0 1073741824" returned: 0 in 0.518s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-dfabcb78-d074-4e87-8502-cbe2ba5240ed tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:46 devstack sudo[99086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0 Jul 16 23:26:46 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:46 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-dfabcb78-d074-4e87-8502-cbe2ba5240ed tempest-VolumesDeleteCascade-165231006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0" returned: 0 in 0.302s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:46 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-dfabcb78-d074-4e87-8502-cbe2ba5240ed tempest-VolumesDeleteCascade-165231006 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:26:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-dfabcb78-d074-4e87-8502-cbe2ba5240ed tempest-VolumesDeleteCascade-165231006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:26:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-dfabcb78-d074-4e87-8502-cbe2ba5240ed tempest-VolumesDeleteCascade-165231006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faca90fc-4e1b-474a-876b-d8d752e33ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:26:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-dfabcb78-d074-4e87-8502-cbe2ba5240ed tempest-VolumesDeleteCascade-165231006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3b1dd75-0fe7-4f30-8fac-88cb10b7f8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:26:46 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-dfabcb78-d074-4e87-8502-cbe2ba5240ed tempest-VolumesDeleteCascade-165231006 None] Volume volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0 (f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0): created successfully Jul 16 23:26:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-dfabcb78-d074-4e87-8502-cbe2ba5240ed tempest-VolumesDeleteCascade-165231006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3b1dd75-0fe7-4f30-8fac-88cb10b7f8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:26:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-dfabcb78-d074-4e87-8502-cbe2ba5240ed tempest-VolumesDeleteCascade-165231006 None] Flow 'volume_create_manager' (34ae3290-5070-4b18-b10e-f7ae558747d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:26:46 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-dfabcb78-d074-4e87-8502-cbe2ba5240ed tempest-VolumesDeleteCascade-165231006 None] Created volume successfully. Jul 16 23:26:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a66d9219-0437-4fea-abc0-74659c5e6fb9 tempest-VolumesDeleteCascade-165231006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:26:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a66d9219-0437-4fea-abc0-74659c5e6fb9 tempest-VolumesDeleteCascade-165231006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:26:47 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-a66d9219-0437-4fea-abc0-74659c5e6fb9 tempest-VolumesDeleteCascade-165231006 None] Creating offline snapshot 61329603-6157-4cba-b9e8-f4a377530bed of volume f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0 {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:26:47 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdd0580-0773-4028-a8a7-0c19580d314c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:26:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a66d9219-0437-4fea-abc0-74659c5e6fb9 tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:48 devstack sudo[99114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0 Jul 16 23:26:48 devstack sudo[99114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:48 devstack sudo[99114]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a66d9219-0437-4fea-abc0-74659c5e6fb9 tempest-VolumesDeleteCascade-165231006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0" returned: 0 in 0.614s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a66d9219-0437-4fea-abc0-74659c5e6fb9 tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.61329603-6157-4cba-b9e8-f4a377530bed 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:48 devstack sudo[99120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.61329603-6157-4cba-b9e8-f4a377530bed 1G Jul 16 23:26:48 devstack sudo[99120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:49 devstack sudo[99120]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a66d9219-0437-4fea-abc0-74659c5e6fb9 tempest-VolumesDeleteCascade-165231006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.61329603-6157-4cba-b9e8-f4a377530bed 1G" returned: 0 in 0.691s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a66d9219-0437-4fea-abc0-74659c5e6fb9 tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.61329603-6157-4cba-b9e8-f4a377530bed {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:49 devstack sudo[99128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.61329603-6157-4cba-b9e8-f4a377530bed Jul 16 23:26:49 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:49 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a66d9219-0437-4fea-abc0-74659c5e6fb9 tempest-VolumesDeleteCascade-165231006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.61329603-6157-4cba-b9e8-f4a377530bed" returned: 0 in 0.355s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:49 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-a66d9219-0437-4fea-abc0-74659c5e6fb9 tempest-VolumesDeleteCascade-165231006 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.61329603-6157-4cba-b9e8-f4a377530bed is being set with open permissions: ugo+rw Jul 16 23:26:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a66d9219-0437-4fea-abc0-74659c5e6fb9 tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.61329603-6157-4cba-b9e8-f4a377530bed {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:49 devstack sudo[99134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.61329603-6157-4cba-b9e8-f4a377530bed Jul 16 23:26:49 devstack sudo[99134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:49 devstack sudo[99134]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a66d9219-0437-4fea-abc0-74659c5e6fb9 tempest-VolumesDeleteCascade-165231006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.61329603-6157-4cba-b9e8-f4a377530bed" returned: 0 in 0.321s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a66d9219-0437-4fea-abc0-74659c5e6fb9 tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:50 devstack sudo[99143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.info Jul 16 23:26:50 devstack sudo[99143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:50 devstack sudo[99143]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a66d9219-0437-4fea-abc0-74659c5e6fb9 tempest-VolumesDeleteCascade-165231006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.info" returned: 0 in 0.304s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:50 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-a66d9219-0437-4fea-abc0-74659c5e6fb9 tempest-VolumesDeleteCascade-165231006 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.info is being set with open permissions: ugo+rw Jul 16 23:26:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a66d9219-0437-4fea-abc0-74659c5e6fb9 tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:50 devstack sudo[99146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.info Jul 16 23:26:50 devstack sudo[99146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c0853202-260c-4ff6-8048-3988d302625b tempest-TestStampPattern-699542814 None] Acquiring lock "cinder-d2a74ad6-9996-4227-936e-f93dcce122a7-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:26:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c0853202-260c-4ff6-8048-3988d302625b tempest-TestStampPattern-699542814 None] Lock "cinder-d2a74ad6-9996-4227-936e-f93dcce122a7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:26:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c0853202-260c-4ff6-8048-3988d302625b tempest-TestStampPattern-699542814 None] Acquiring lock "cinder-quobyte-d2a74ad6-9996-4227-936e-f93dcce122a7" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:26:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c0853202-260c-4ff6-8048-3988d302625b tempest-TestStampPattern-699542814 None] Lock "cinder-quobyte-d2a74ad6-9996-4227-936e-f93dcce122a7" acquired by "delete_volume" :: waited 0.026s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:26:50 devstack sudo[99146]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a66d9219-0437-4fea-abc0-74659c5e6fb9 tempest-VolumesDeleteCascade-165231006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.info" returned: 0 in 0.301s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a66d9219-0437-4fea-abc0-74659c5e6fb9 tempest-VolumesDeleteCascade-165231006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.697s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:26:50 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb69d69-a1a4-4c95-b3aa-f57735331602]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:26:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c0853202-260c-4ff6-8048-3988d302625b tempest-TestStampPattern-699542814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:50 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-a66d9219-0437-4fea-abc0-74659c5e6fb9 tempest-VolumesDeleteCascade-165231006 None] Create snapshot completed successfully Jul 16 23:26:50 devstack sudo[99149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7 Jul 16 23:26:50 devstack sudo[99149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:51 devstack sudo[99149]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c0853202-260c-4ff6-8048-3988d302625b tempest-TestStampPattern-699542814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7" returned: 0 in 0.411s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c0853202-260c-4ff6-8048-3988d302625b tempest-TestStampPattern-699542814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:51 devstack sudo[99154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7 Jul 16 23:26:51 devstack sudo[99154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3829376c-c0e5-4896-a6d7-512d1f1efb45 tempest-VolumesDeleteCascade-165231006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:26:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3829376c-c0e5-4896-a6d7-512d1f1efb45 tempest-VolumesDeleteCascade-165231006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:26:51 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-3829376c-c0e5-4896-a6d7-512d1f1efb45 tempest-VolumesDeleteCascade-165231006 None] Creating offline snapshot 745c54db-4b04-46d4-ab1b-f61d138fe651 of volume f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0 {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:26:51 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0a6076-dfe0-49ff-b6d5-44f30fcf487a]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:26:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3829376c-c0e5-4896-a6d7-512d1f1efb45 tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.61329603-6157-4cba-b9e8-f4a377530bed {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:51 devstack sudo[99154]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c0853202-260c-4ff6-8048-3988d302625b tempest-TestStampPattern-699542814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2a74ad6-9996-4227-936e-f93dcce122a7" returned: 0 in 0.419s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:51 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c0853202-260c-4ff6-8048-3988d302625b tempest-TestStampPattern-699542814 None] Lock "cinder-quobyte-d2a74ad6-9996-4227-936e-f93dcce122a7" released by "delete_volume" :: held 0.924s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:26:51 devstack sudo[99156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.61329603-6157-4cba-b9e8-f4a377530bed Jul 16 23:26:51 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:51 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-c0853202-260c-4ff6-8048-3988d302625b tempest-TestStampPattern-699542814 None] Created reservations ['23d932fb-1f29-4598-be37-9c593b351a04', 'df1e6989-acd1-4204-81fb-37fddb9bc965', 'ca8970cd-d6ae-4748-8bb3-93b5279a3bab', '4cbb8a24-24fd-45a1-9500-d93766e32f32'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:26:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c0853202-260c-4ff6-8048-3988d302625b tempest-TestStampPattern-699542814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:26:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c0853202-260c-4ff6-8048-3988d302625b tempest-TestStampPattern-699542814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:26:51 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-c0853202-260c-4ff6-8048-3988d302625b tempest-TestStampPattern-699542814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:26:51 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-c0853202-260c-4ff6-8048-3988d302625b tempest-TestStampPattern-699542814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:26:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c0853202-260c-4ff6-8048-3988d302625b tempest-TestStampPattern-699542814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:26:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c0853202-260c-4ff6-8048-3988d302625b tempest-TestStampPattern-699542814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:51 devstack sudo[99159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:26:51 devstack sudo[99159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:52 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3829376c-c0e5-4896-a6d7-512d1f1efb45 tempest-VolumesDeleteCascade-165231006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.61329603-6157-4cba-b9e8-f4a377530bed" returned: 0 in 0.648s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:52 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-3829376c-c0e5-4896-a6d7-512d1f1efb45 tempest-VolumesDeleteCascade-165231006 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:26:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3829376c-c0e5-4896-a6d7-512d1f1efb45 tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.61329603-6157-4cba-b9e8-f4a377530bed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.745c54db-4b04-46d4-ab1b-f61d138fe651 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:52 devstack sudo[99165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.61329603-6157-4cba-b9e8-f4a377530bed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.745c54db-4b04-46d4-ab1b-f61d138fe651 1G Jul 16 23:26:52 devstack sudo[99165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:52 devstack sudo[99159]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c0853202-260c-4ff6-8048-3988d302625b tempest-TestStampPattern-699542814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.348s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:52 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-c0853202-260c-4ff6-8048-3988d302625b tempest-TestStampPattern-699542814 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:26:52 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-c0853202-260c-4ff6-8048-3988d302625b tempest-TestStampPattern-699542814 None] Deleted volume successfully. Jul 16 23:26:52 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c0853202-260c-4ff6-8048-3988d302625b tempest-TestStampPattern-699542814 None] Lock "cinder-d2a74ad6-9996-4227-936e-f93dcce122a7-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:26:52 devstack sudo[99165]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3829376c-c0e5-4896-a6d7-512d1f1efb45 tempest-VolumesDeleteCascade-165231006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.61329603-6157-4cba-b9e8-f4a377530bed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.745c54db-4b04-46d4-ab1b-f61d138fe651 1G" returned: 0 in 0.491s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3829376c-c0e5-4896-a6d7-512d1f1efb45 tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.61329603-6157-4cba-b9e8-f4a377530bed -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.745c54db-4b04-46d4-ab1b-f61d138fe651 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:52 devstack sudo[99172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.61329603-6157-4cba-b9e8-f4a377530bed -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.745c54db-4b04-46d4-ab1b-f61d138fe651 Jul 16 23:26:52 devstack sudo[99172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:52 devstack sudo[99172]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3829376c-c0e5-4896-a6d7-512d1f1efb45 tempest-VolumesDeleteCascade-165231006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.61329603-6157-4cba-b9e8-f4a377530bed -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.745c54db-4b04-46d4-ab1b-f61d138fe651" returned: 0 in 0.357s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:52 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-3829376c-c0e5-4896-a6d7-512d1f1efb45 tempest-VolumesDeleteCascade-165231006 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.745c54db-4b04-46d4-ab1b-f61d138fe651 is being set with open permissions: ugo+rw Jul 16 23:26:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3829376c-c0e5-4896-a6d7-512d1f1efb45 tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.745c54db-4b04-46d4-ab1b-f61d138fe651 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:52 devstack sudo[99178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.745c54db-4b04-46d4-ab1b-f61d138fe651 Jul 16 23:26:52 devstack sudo[99178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:53 devstack sudo[99178]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3829376c-c0e5-4896-a6d7-512d1f1efb45 tempest-VolumesDeleteCascade-165231006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.745c54db-4b04-46d4-ab1b-f61d138fe651" returned: 0 in 0.377s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3829376c-c0e5-4896-a6d7-512d1f1efb45 tempest-VolumesDeleteCascade-165231006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.035s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:26:53 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-3829376c-c0e5-4896-a6d7-512d1f1efb45 tempest-VolumesDeleteCascade-165231006 None] Create snapshot completed successfully Jul 16 23:26:54 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Acquiring lock "cinder-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:26:54 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Lock "cinder-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:26:54 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Performing cascade delete. {{(pid=87607) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 16 23:26:54 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Acquiring lock "cinder-61329603-6157-4cba-b9e8-f4a377530bed-delete_snapshot" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:26:54 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Lock "cinder-61329603-6157-4cba-b9e8-f4a377530bed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:26:54 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Acquiring lock "cinder-quobyte-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:26:54 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Lock "cinder-quobyte-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:26:54 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Acquiring lock "cinder-quobyte-61329603-6157-4cba-b9e8-f4a377530bed" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:26:54 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Lock "cinder-quobyte-61329603-6157-4cba-b9e8-f4a377530bed" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:26:54 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Deleting offline snapshot 61329603-6157-4cba-b9e8-f4a377530bed of volume f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:26:54 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] snapshot_file for this snap is: volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.61329603-6157-4cba-b9e8-f4a377530bed {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:26:54 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e07798-fa26-40af-9fd2-de816f0613e5]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:26:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.61329603-6157-4cba-b9e8-f4a377530bed {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:54 devstack sudo[99181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.61329603-6157-4cba-b9e8-f4a377530bed Jul 16 23:26:54 devstack sudo[99181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:55 devstack sudo[99181]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.61329603-6157-4cba-b9e8-f4a377530bed" returned: 0 in 0.433s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:55 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:26:55 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a9ea36-e009-43d0-9469-353128a9e8e9]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:26:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:55 devstack sudo[99187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0 Jul 16 23:26:55 devstack sudo[99187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:55 devstack sudo[99187]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0" returned: 0 in 0.564s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:55 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cbe3ad-8931-48e8-8603-650e3d2f37f8]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:26:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.745c54db-4b04-46d4-ab1b-f61d138fe651 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:56 devstack sudo[99201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.745c54db-4b04-46d4-ab1b-f61d138fe651 Jul 16 23:26:56 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:56 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-572886b7-b07d-491b-a0d0-3893b7c40ba7 tempest-AttachVolumeNegativeTest-552460454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:26:56 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-572886b7-b07d-491b-a0d0-3893b7c40ba7 tempest-AttachVolumeNegativeTest-552460454 None] Flow 'volume_create_manager' (a63d935c-d9cf-427f-bc6f-33ebe05cd4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:26:56 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-572886b7-b07d-491b-a0d0-3893b7c40ba7 tempest-AttachVolumeNegativeTest-552460454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (541ab5bb-5600-42d1-a5bc-410d2b27ecb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:26:56 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-572886b7-b07d-491b-a0d0-3893b7c40ba7 tempest-AttachVolumeNegativeTest-552460454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (541ab5bb-5600-42d1-a5bc-410d2b27ecb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:26:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-649612802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47dceee9-6c81-49c4-9c1c-0609c5c82f23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad2eceaebf5b4204b9222188f3e0e98d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:26:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:26:56Z,use_quota=True,user_id='609a2cd5502a47deab0e97d228687a01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:26:56 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-572886b7-b07d-491b-a0d0-3893b7c40ba7 tempest-AttachVolumeNegativeTest-552460454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9980f0ca-b96b-4c2c-8d3d-1bebe3511c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:26:56 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-572886b7-b07d-491b-a0d0-3893b7c40ba7 tempest-AttachVolumeNegativeTest-552460454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9980f0ca-b96b-4c2c-8d3d-1bebe3511c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:26:56 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-572886b7-b07d-491b-a0d0-3893b7c40ba7 tempest-AttachVolumeNegativeTest-552460454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44a5c030-5e13-4388-82d9-62ab330ca2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:26:56 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-572886b7-b07d-491b-a0d0-3893b7c40ba7 tempest-AttachVolumeNegativeTest-552460454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44a5c030-5e13-4388-82d9-62ab330ca2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47dceee9-6c81-49c4-9c1c-0609c5c82f23', 'volume_name': 'volume-47dceee9-6c81-49c4-9c1c-0609c5c82f23', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:26:56 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-572886b7-b07d-491b-a0d0-3893b7c40ba7 tempest-AttachVolumeNegativeTest-552460454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d52c00af-b3d2-40a1-93dd-84144c3317e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:26:56 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-572886b7-b07d-491b-a0d0-3893b7c40ba7 tempest-AttachVolumeNegativeTest-552460454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d52c00af-b3d2-40a1-93dd-84144c3317e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:26:56 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-572886b7-b07d-491b-a0d0-3893b7c40ba7 tempest-AttachVolumeNegativeTest-552460454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (852c99f5-abd6-417e-9aa0-72df18e47e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:26:56 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-572886b7-b07d-491b-a0d0-3893b7c40ba7 tempest-AttachVolumeNegativeTest-552460454 None] Volume 47dceee9-6c81-49c4-9c1c-0609c5c82f23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47dceee9-6c81-49c4-9c1c-0609c5c82f23', 'volume_size': 1} Jul 16 23:26:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-572886b7-b07d-491b-a0d0-3893b7c40ba7 tempest-AttachVolumeNegativeTest-552460454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:26:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-572886b7-b07d-491b-a0d0-3893b7c40ba7 tempest-AttachVolumeNegativeTest-552460454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:26:56 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-572886b7-b07d-491b-a0d0-3893b7c40ba7 tempest-AttachVolumeNegativeTest-552460454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:26:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-649612802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47dceee9-6c81-49c4-9c1c-0609c5c82f23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad2eceaebf5b4204b9222188f3e0e98d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:26:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:26:56Z,use_quota=True,user_id='609a2cd5502a47deab0e97d228687a01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:26:56 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-572886b7-b07d-491b-a0d0-3893b7c40ba7 tempest-AttachVolumeNegativeTest-552460454 None] Creating volume 47dceee9-6c81-49c4-9c1c-0609c5c82f23 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:26:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-572886b7-b07d-491b-a0d0-3893b7c40ba7 tempest-AttachVolumeNegativeTest-552460454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:26:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-572886b7-b07d-491b-a0d0-3893b7c40ba7 tempest-AttachVolumeNegativeTest-552460454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:26:56 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-572886b7-b07d-491b-a0d0-3893b7c40ba7 tempest-AttachVolumeNegativeTest-552460454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:26:56 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-572886b7-b07d-491b-a0d0-3893b7c40ba7 tempest-AttachVolumeNegativeTest-552460454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:26:56 devstack sudo[99201]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-572886b7-b07d-491b-a0d0-3893b7c40ba7 tempest-AttachVolumeNegativeTest-552460454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:26:56 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-572886b7-b07d-491b-a0d0-3893b7c40ba7 tempest-AttachVolumeNegativeTest-552460454 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:26:56 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-572886b7-b07d-491b-a0d0-3893b7c40ba7 tempest-AttachVolumeNegativeTest-552460454 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:26:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-572886b7-b07d-491b-a0d0-3893b7c40ba7 tempest-AttachVolumeNegativeTest-552460454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-47dceee9-6c81-49c4-9c1c-0609c5c82f23 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.745c54db-4b04-46d4-ab1b-f61d138fe651" returned: 0 in 0.771s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:56 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:26:56 devstack sudo[99208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-47dceee9-6c81-49c4-9c1c-0609c5c82f23 1073741824 Jul 16 23:26:56 devstack sudo[99208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:56 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[51914214-8585-4d39-bdde-4863c9ca28cf]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:26:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.61329603-6157-4cba-b9e8-f4a377530bed {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:56 devstack sudo[99210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.61329603-6157-4cba-b9e8-f4a377530bed Jul 16 23:26:56 devstack sudo[99210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:57 devstack sudo[99208]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:57 devstack sudo[99210]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.61329603-6157-4cba-b9e8-f4a377530bed" returned: 0 in 0.538s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-572886b7-b07d-491b-a0d0-3893b7c40ba7 tempest-AttachVolumeNegativeTest-552460454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-47dceee9-6c81-49c4-9c1c-0609c5c82f23 1073741824" returned: 0 in 0.576s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:57 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:26:57 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd9d986-ef6e-4ff1-9a17-6c31563f08eb]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:26:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-572886b7-b07d-491b-a0d0-3893b7c40ba7 tempest-AttachVolumeNegativeTest-552460454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-47dceee9-6c81-49c4-9c1c-0609c5c82f23 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:57 devstack sudo[99220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-47dceee9-6c81-49c4-9c1c-0609c5c82f23 Jul 16 23:26:57 devstack sudo[99220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:57 devstack sudo[99219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0 Jul 16 23:26:57 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:57 devstack sudo[99220]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-572886b7-b07d-491b-a0d0-3893b7c40ba7 tempest-AttachVolumeNegativeTest-552460454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-47dceee9-6c81-49c4-9c1c-0609c5c82f23" returned: 0 in 0.351s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:57 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-572886b7-b07d-491b-a0d0-3893b7c40ba7 tempest-AttachVolumeNegativeTest-552460454 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:26:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-572886b7-b07d-491b-a0d0-3893b7c40ba7 tempest-AttachVolumeNegativeTest-552460454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:26:57 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-572886b7-b07d-491b-a0d0-3893b7c40ba7 tempest-AttachVolumeNegativeTest-552460454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (852c99f5-abd6-417e-9aa0-72df18e47e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47dceee9-6c81-49c4-9c1c-0609c5c82f23', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:26:57 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-572886b7-b07d-491b-a0d0-3893b7c40ba7 tempest-AttachVolumeNegativeTest-552460454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (989fdce5-de99-47f4-97e7-fd12e742233e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:26:57 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-572886b7-b07d-491b-a0d0-3893b7c40ba7 tempest-AttachVolumeNegativeTest-552460454 None] Volume volume-47dceee9-6c81-49c4-9c1c-0609c5c82f23 (47dceee9-6c81-49c4-9c1c-0609c5c82f23): created successfully Jul 16 23:26:57 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-572886b7-b07d-491b-a0d0-3893b7c40ba7 tempest-AttachVolumeNegativeTest-552460454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (989fdce5-de99-47f4-97e7-fd12e742233e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:26:57 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-572886b7-b07d-491b-a0d0-3893b7c40ba7 tempest-AttachVolumeNegativeTest-552460454 None] Flow 'volume_create_manager' (a63d935c-d9cf-427f-bc6f-33ebe05cd4a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:26:57 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-572886b7-b07d-491b-a0d0-3893b7c40ba7 tempest-AttachVolumeNegativeTest-552460454 None] Created volume successfully. Jul 16 23:26:57 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0" returned: 0 in 0.497s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.61329603-6157-4cba-b9e8-f4a377530bed {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:57 devstack sudo[99227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.61329603-6157-4cba-b9e8-f4a377530bed Jul 16 23:26:57 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:58 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.61329603-6157-4cba-b9e8-f4a377530bed" returned: 0 in 0.444s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.61329603-6157-4cba-b9e8-f4a377530bed {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:58 devstack sudo[99233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.61329603-6157-4cba-b9e8-f4a377530bed Jul 16 23:26:58 devstack sudo[99233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:58 devstack sudo[99233]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.61329603-6157-4cba-b9e8-f4a377530bed" returned: 0 in 0.318s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.745c54db-4b04-46d4-ab1b-f61d138fe651 -F qcow2 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:58 devstack sudo[99236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.745c54db-4b04-46d4-ab1b-f61d138fe651 -F qcow2 Jul 16 23:26:58 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:59 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root Jul 16 23:26:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.745c54db-4b04-46d4-ab1b-f61d138fe651 -F qcow2" returned: 0 in 0.532s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:26:59 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Lock "cinder-quobyte-61329603-6157-4cba-b9e8-f4a377530bed" released by "_delete_snapshot" :: held 4.395s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:26:59 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Lock "cinder-quobyte-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0" released by "delete_snapshot" :: held 4.442s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:26:59 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Created reservations ['adfd672d-e766-4330-901f-bc488c5a53b2', 'ea4e9c55-f646-4157-b014-fb167e6ea9eb', '44b2be83-dd3a-4045-8408-62947a113434', '23d2ff7d-cb6f-4700-ad67-d2801279c001'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:26:59 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Delete snapshot completed successfully. Jul 16 23:26:59 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Lock "cinder-61329603-6157-4cba-b9e8-f4a377530bed-delete_snapshot" released by "delete_snapshot" :: held 4.746s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:26:59 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Acquiring lock "cinder-745c54db-4b04-46d4-ab1b-f61d138fe651-delete_snapshot" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:26:59 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Lock "cinder-745c54db-4b04-46d4-ab1b-f61d138fe651-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:26:59 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Acquiring lock "cinder-quobyte-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:26:59 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Lock "cinder-quobyte-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:26:59 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Acquiring lock "cinder-quobyte-745c54db-4b04-46d4-ab1b-f61d138fe651" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:26:59 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Lock "cinder-quobyte-745c54db-4b04-46d4-ab1b-f61d138fe651" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:26:59 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Deleting offline snapshot 745c54db-4b04-46d4-ab1b-f61d138fe651 of volume f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:26:59 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] snapshot_file for this snap is: volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.745c54db-4b04-46d4-ab1b-f61d138fe651 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:26:59 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3da2b1-be72-479e-bfec-b0ca1a302ce0]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:26:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.745c54db-4b04-46d4-ab1b-f61d138fe651 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:26:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-162ca161-d160-4401-9804-d95e1ccd0135 req-fd86ad8c-b832-4acf-b7ad-5d56f5e7bd34 tempest-AttachVolumeNegativeTest-552460454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:26:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-162ca161-d160-4401-9804-d95e1ccd0135 req-fd86ad8c-b832-4acf-b7ad-5d56f5e7bd34 tempest-AttachVolumeNegativeTest-552460454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:26:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-162ca161-d160-4401-9804-d95e1ccd0135 req-fd86ad8c-b832-4acf-b7ad-5d56f5e7bd34 tempest-AttachVolumeNegativeTest-552460454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:26:59 devstack sudo[99253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.745c54db-4b04-46d4-ab1b-f61d138fe651 Jul 16 23:26:59 devstack sudo[99253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:26:59 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-162ca161-d160-4401-9804-d95e1ccd0135 req-fd86ad8c-b832-4acf-b7ad-5d56f5e7bd34 tempest-AttachVolumeNegativeTest-552460454 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72', 'name': 'volume-47dceee9-6c81-49c4-9c1c-0609c5c82f23', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aedbea65-f2bd-4432-a95d-d25889905725', 'enforce_multipath': True} {{(pid=87607) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 23:27:00 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-162ca161-d160-4401-9804-d95e1ccd0135 req-fd86ad8c-b832-4acf-b7ad-5d56f5e7bd34 tempest-AttachVolumeNegativeTest-552460454 None] attachment_update completed successfully. Jul 16 23:27:00 devstack sudo[99253]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.745c54db-4b04-46d4-ab1b-f61d138fe651" returned: 0 in 0.809s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:00 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:27:00 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a2cb7e-b2b7-4176-923a-e8835adb6e35]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:27:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:00 devstack sudo[99325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0 Jul 16 23:27:00 devstack sudo[99325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:01 devstack sudo[99325]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0" returned: 0 in 0.553s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.745c54db-4b04-46d4-ab1b-f61d138fe651 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:01 devstack sudo[99646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.745c54db-4b04-46d4-ab1b-f61d138fe651 Jul 16 23:27:01 devstack sudo[99646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:01 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-73cd30c8-3708-49b8-bd9d-3bf710eccf66 tempest-TestServerVolumeAttachmentScenario-804454518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:27:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-73cd30c8-3708-49b8-bd9d-3bf710eccf66 tempest-TestServerVolumeAttachmentScenario-804454518 None] Flow 'volume_create_manager' (fe0f0e16-78a1-4704-b60a-da37831ff0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:27:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-73cd30c8-3708-49b8-bd9d-3bf710eccf66 tempest-TestServerVolumeAttachmentScenario-804454518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b201046b-5766-45c5-b50b-5d15891fd825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-73cd30c8-3708-49b8-bd9d-3bf710eccf66 tempest-TestServerVolumeAttachmentScenario-804454518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b201046b-5766-45c5-b50b-5d15891fd825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-310912762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39c6db99-44f2-4ff9-a41f-f71a70725211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9ef0598dbe7467a9ef35615021715ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:27:01Z,use_quota=True,user_id='adce5a72d4ed409e8f9e73383fc88454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-73cd30c8-3708-49b8-bd9d-3bf710eccf66 tempest-TestServerVolumeAttachmentScenario-804454518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efa09896-1cff-459c-980b-e68684492378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-73cd30c8-3708-49b8-bd9d-3bf710eccf66 tempest-TestServerVolumeAttachmentScenario-804454518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efa09896-1cff-459c-980b-e68684492378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-73cd30c8-3708-49b8-bd9d-3bf710eccf66 tempest-TestServerVolumeAttachmentScenario-804454518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38041d6d-ccd5-4e04-b7dc-0d65182a4bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-73cd30c8-3708-49b8-bd9d-3bf710eccf66 tempest-TestServerVolumeAttachmentScenario-804454518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38041d6d-ccd5-4e04-b7dc-0d65182a4bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39c6db99-44f2-4ff9-a41f-f71a70725211', 'volume_name': 'volume-39c6db99-44f2-4ff9-a41f-f71a70725211', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-73cd30c8-3708-49b8-bd9d-3bf710eccf66 tempest-TestServerVolumeAttachmentScenario-804454518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50087203-7889-4c85-800d-6d415fc5d73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-73cd30c8-3708-49b8-bd9d-3bf710eccf66 tempest-TestServerVolumeAttachmentScenario-804454518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50087203-7889-4c85-800d-6d415fc5d73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-73cd30c8-3708-49b8-bd9d-3bf710eccf66 tempest-TestServerVolumeAttachmentScenario-804454518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (430709b9-8964-400a-b250-5ba5b5c439a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:01 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-73cd30c8-3708-49b8-bd9d-3bf710eccf66 tempest-TestServerVolumeAttachmentScenario-804454518 None] Volume 39c6db99-44f2-4ff9-a41f-f71a70725211: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39c6db99-44f2-4ff9-a41f-f71a70725211', 'volume_size': 1} Jul 16 23:27:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-73cd30c8-3708-49b8-bd9d-3bf710eccf66 tempest-TestServerVolumeAttachmentScenario-804454518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-73cd30c8-3708-49b8-bd9d-3bf710eccf66 tempest-TestServerVolumeAttachmentScenario-804454518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:01 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-73cd30c8-3708-49b8-bd9d-3bf710eccf66 tempest-TestServerVolumeAttachmentScenario-804454518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-310912762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39c6db99-44f2-4ff9-a41f-f71a70725211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9ef0598dbe7467a9ef35615021715ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:27:01Z,use_quota=True,user_id='adce5a72d4ed409e8f9e73383fc88454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:27:01 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-73cd30c8-3708-49b8-bd9d-3bf710eccf66 tempest-TestServerVolumeAttachmentScenario-804454518 None] Creating volume 39c6db99-44f2-4ff9-a41f-f71a70725211 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:27:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-73cd30c8-3708-49b8-bd9d-3bf710eccf66 tempest-TestServerVolumeAttachmentScenario-804454518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-73cd30c8-3708-49b8-bd9d-3bf710eccf66 tempest-TestServerVolumeAttachmentScenario-804454518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:01 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-73cd30c8-3708-49b8-bd9d-3bf710eccf66 tempest-TestServerVolumeAttachmentScenario-804454518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:27:01 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-73cd30c8-3708-49b8-bd9d-3bf710eccf66 tempest-TestServerVolumeAttachmentScenario-804454518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:27:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-73cd30c8-3708-49b8-bd9d-3bf710eccf66 tempest-TestServerVolumeAttachmentScenario-804454518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:01 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-73cd30c8-3708-49b8-bd9d-3bf710eccf66 tempest-TestServerVolumeAttachmentScenario-804454518 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:27:01 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-73cd30c8-3708-49b8-bd9d-3bf710eccf66 tempest-TestServerVolumeAttachmentScenario-804454518 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:27:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-73cd30c8-3708-49b8-bd9d-3bf710eccf66 tempest-TestServerVolumeAttachmentScenario-804454518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-39c6db99-44f2-4ff9-a41f-f71a70725211 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:01 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-39c6db99-44f2-4ff9-a41f-f71a70725211 1073741824 Jul 16 23:27:01 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:01 devstack sudo[99646]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.745c54db-4b04-46d4-ab1b-f61d138fe651" returned: 0 in 0.593s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.745c54db-4b04-46d4-ab1b-f61d138fe651 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:01 devstack sudo[99654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.745c54db-4b04-46d4-ab1b-f61d138fe651 Jul 16 23:27:01 devstack sudo[99654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:02 devstack sudo[99654]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0.745c54db-4b04-46d4-ab1b-f61d138fe651" returned: 0 in 0.428s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:02 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-4be46b07-3e76-4816-8eb8-0fb4e35204cb tempest-TestServerVolumeAttachmentScenario-804454518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:27:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4be46b07-3e76-4816-8eb8-0fb4e35204cb tempest-TestServerVolumeAttachmentScenario-804454518 None] Flow 'volume_create_manager' (c9a32f56-3971-4b2e-a588-45fd6a26b61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:27:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4be46b07-3e76-4816-8eb8-0fb4e35204cb tempest-TestServerVolumeAttachmentScenario-804454518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (444185e5-4dbe-4b71-9fd1-01fa122b70eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:02 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Lock "cinder-quobyte-745c54db-4b04-46d4-ab1b-f61d138fe651" released by "_delete_snapshot" :: held 2.635s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:27:02 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Lock "cinder-quobyte-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0" released by "delete_snapshot" :: held 2.686s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:27:02 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4be46b07-3e76-4816-8eb8-0fb4e35204cb tempest-TestServerVolumeAttachmentScenario-804454518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (444185e5-4dbe-4b71-9fd1-01fa122b70eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1528291322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1b33387-8a97-4ddb-999a-f311261152c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9ef0598dbe7467a9ef35615021715ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:27:02Z,use_quota=True,user_id='adce5a72d4ed409e8f9e73383fc88454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4be46b07-3e76-4816-8eb8-0fb4e35204cb tempest-TestServerVolumeAttachmentScenario-804454518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03430c0f-44e8-49b8-8476-789a7dc761fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4be46b07-3e76-4816-8eb8-0fb4e35204cb tempest-TestServerVolumeAttachmentScenario-804454518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03430c0f-44e8-49b8-8476-789a7dc761fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4be46b07-3e76-4816-8eb8-0fb4e35204cb tempest-TestServerVolumeAttachmentScenario-804454518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abe9d1a9-9708-413f-8c4f-4d6c705d8863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4be46b07-3e76-4816-8eb8-0fb4e35204cb tempest-TestServerVolumeAttachmentScenario-804454518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abe9d1a9-9708-413f-8c4f-4d6c705d8863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1b33387-8a97-4ddb-999a-f311261152c9', 'volume_name': 'volume-d1b33387-8a97-4ddb-999a-f311261152c9', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4be46b07-3e76-4816-8eb8-0fb4e35204cb tempest-TestServerVolumeAttachmentScenario-804454518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8abf747-7af7-49c3-a2e5-575bd9aa2e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4be46b07-3e76-4816-8eb8-0fb4e35204cb tempest-TestServerVolumeAttachmentScenario-804454518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8abf747-7af7-49c3-a2e5-575bd9aa2e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4be46b07-3e76-4816-8eb8-0fb4e35204cb tempest-TestServerVolumeAttachmentScenario-804454518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91a37bce-dba5-408d-b796-fbd4ecde9397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:02 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-4be46b07-3e76-4816-8eb8-0fb4e35204cb tempest-TestServerVolumeAttachmentScenario-804454518 None] Volume d1b33387-8a97-4ddb-999a-f311261152c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1b33387-8a97-4ddb-999a-f311261152c9', 'volume_size': 1} Jul 16 23:27:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4be46b07-3e76-4816-8eb8-0fb4e35204cb tempest-TestServerVolumeAttachmentScenario-804454518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-73cd30c8-3708-49b8-bd9d-3bf710eccf66 tempest-TestServerVolumeAttachmentScenario-804454518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-39c6db99-44f2-4ff9-a41f-f71a70725211 1073741824" returned: 0 in 0.714s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-73cd30c8-3708-49b8-bd9d-3bf710eccf66 tempest-TestServerVolumeAttachmentScenario-804454518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-39c6db99-44f2-4ff9-a41f-f71a70725211 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:02 devstack sudo[99662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-39c6db99-44f2-4ff9-a41f-f71a70725211 Jul 16 23:27:02 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:02 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Created reservations ['35d8ae2f-beeb-4fd0-a3f5-c49713be4559', '54e46c45-53b5-412c-8849-f2ad714cf01f', '23302958-63e2-45e8-95e3-f450a762588d', 'a097e840-3249-4fe9-98bc-536d5c810a55'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:27:02 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Delete snapshot completed successfully. Jul 16 23:27:02 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Lock "cinder-745c54db-4b04-46d4-ab1b-f61d138fe651-delete_snapshot" released by "delete_snapshot" :: held 3.084s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:27:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Snapshots deleted, issuing volume delete {{(pid=87607) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 16 23:27:02 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Acquiring lock "cinder-quobyte-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:27:02 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Lock "cinder-quobyte-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0" acquired by "delete_volume" :: waited 0.022s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:27:02 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f69f1a4-338a-49cf-8e2e-8986d2033991]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:27:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:02 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-73cd30c8-3708-49b8-bd9d-3bf710eccf66 tempest-TestServerVolumeAttachmentScenario-804454518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-39c6db99-44f2-4ff9-a41f-f71a70725211" returned: 0 in 0.481s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:02 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-73cd30c8-3708-49b8-bd9d-3bf710eccf66 tempest-TestServerVolumeAttachmentScenario-804454518 None] <== create_volume: return (1271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:27:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-73cd30c8-3708-49b8-bd9d-3bf710eccf66 tempest-TestServerVolumeAttachmentScenario-804454518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4be46b07-3e76-4816-8eb8-0fb4e35204cb tempest-TestServerVolumeAttachmentScenario-804454518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.561s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:02 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4be46b07-3e76-4816-8eb8-0fb4e35204cb tempest-TestServerVolumeAttachmentScenario-804454518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1528291322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1b33387-8a97-4ddb-999a-f311261152c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9ef0598dbe7467a9ef35615021715ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:27:02Z,use_quota=True,user_id='adce5a72d4ed409e8f9e73383fc88454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:27:02 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-4be46b07-3e76-4816-8eb8-0fb4e35204cb tempest-TestServerVolumeAttachmentScenario-804454518 None] Creating volume d1b33387-8a97-4ddb-999a-f311261152c9 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:27:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4be46b07-3e76-4816-8eb8-0fb4e35204cb tempest-TestServerVolumeAttachmentScenario-804454518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4be46b07-3e76-4816-8eb8-0fb4e35204cb tempest-TestServerVolumeAttachmentScenario-804454518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:02 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4be46b07-3e76-4816-8eb8-0fb4e35204cb tempest-TestServerVolumeAttachmentScenario-804454518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:27:02 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4be46b07-3e76-4816-8eb8-0fb4e35204cb tempest-TestServerVolumeAttachmentScenario-804454518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:27:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4be46b07-3e76-4816-8eb8-0fb4e35204cb tempest-TestServerVolumeAttachmentScenario-804454518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:02 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4be46b07-3e76-4816-8eb8-0fb4e35204cb tempest-TestServerVolumeAttachmentScenario-804454518 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:27:02 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-4be46b07-3e76-4816-8eb8-0fb4e35204cb tempest-TestServerVolumeAttachmentScenario-804454518 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:27:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4be46b07-3e76-4816-8eb8-0fb4e35204cb tempest-TestServerVolumeAttachmentScenario-804454518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d1b33387-8a97-4ddb-999a-f311261152c9 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:02 devstack sudo[99664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0 Jul 16 23:27:02 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-73cd30c8-3708-49b8-bd9d-3bf710eccf66 tempest-TestServerVolumeAttachmentScenario-804454518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (430709b9-8964-400a-b250-5ba5b5c439a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39c6db99-44f2-4ff9-a41f-f71a70725211', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-73cd30c8-3708-49b8-bd9d-3bf710eccf66 tempest-TestServerVolumeAttachmentScenario-804454518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b3ab6ec-4561-4fbe-ba4d-f2b88072c404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:02 devstack sudo[99667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d1b33387-8a97-4ddb-999a-f311261152c9 1073741824 Jul 16 23:27:02 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:02 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-73cd30c8-3708-49b8-bd9d-3bf710eccf66 tempest-TestServerVolumeAttachmentScenario-804454518 None] Volume volume-39c6db99-44f2-4ff9-a41f-f71a70725211 (39c6db99-44f2-4ff9-a41f-f71a70725211): created successfully Jul 16 23:27:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-73cd30c8-3708-49b8-bd9d-3bf710eccf66 tempest-TestServerVolumeAttachmentScenario-804454518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b3ab6ec-4561-4fbe-ba4d-f2b88072c404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-73cd30c8-3708-49b8-bd9d-3bf710eccf66 tempest-TestServerVolumeAttachmentScenario-804454518 None] Flow 'volume_create_manager' (fe0f0e16-78a1-4704-b60a-da37831ff0ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:27:02 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-73cd30c8-3708-49b8-bd9d-3bf710eccf66 tempest-TestServerVolumeAttachmentScenario-804454518 None] Created volume successfully. Jul 16 23:27:03 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-ebc36cb4-7e1a-41b9-acc2-25337c0fd98b req-6cf2ed9e-9da2-4fd8-93f7-a3b87d1a4aec tempest-AttachVolumeNegativeTest-552460454 None] Terminate volume connection completed successfully. Jul 16 23:27:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-ebc36cb4-7e1a-41b9-acc2-25337c0fd98b req-6cf2ed9e-9da2-4fd8-93f7-a3b87d1a4aec tempest-AttachVolumeNegativeTest-552460454 None] Deleting attachment aedbea65-f2bd-4432-a95d-d25889905725. {{(pid=87607) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 23:27:03 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0" returned: 0 in 0.688s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:03 devstack sudo[99701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0 Jul 16 23:27:03 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:03 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4be46b07-3e76-4816-8eb8-0fb4e35204cb tempest-TestServerVolumeAttachmentScenario-804454518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d1b33387-8a97-4ddb-999a-f311261152c9 1073741824" returned: 0 in 0.825s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4be46b07-3e76-4816-8eb8-0fb4e35204cb tempest-TestServerVolumeAttachmentScenario-804454518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d1b33387-8a97-4ddb-999a-f311261152c9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:03 devstack sudo[99703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d1b33387-8a97-4ddb-999a-f311261152c9 Jul 16 23:27:03 devstack sudo[99703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:03 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0" returned: 0 in 0.496s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:03 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Lock "cinder-quobyte-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0" released by "delete_volume" :: held 1.304s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:27:03 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Created reservations ['cbf1aa25-e3e3-4c4e-920f-fb683956d0f6', '25485faa-4415-45da-ba65-aceba83200bf', '3614944e-9a37-40ab-abaa-0ee62e5e8f57', '061f9f5f-0d01-409e-9e56-d7fa43423f19'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:27:04 devstack sudo[99703]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4be46b07-3e76-4816-8eb8-0fb4e35204cb tempest-TestServerVolumeAttachmentScenario-804454518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d1b33387-8a97-4ddb-999a-f311261152c9" returned: 0 in 0.384s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4be46b07-3e76-4816-8eb8-0fb4e35204cb tempest-TestServerVolumeAttachmentScenario-804454518 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:27:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4be46b07-3e76-4816-8eb8-0fb4e35204cb tempest-TestServerVolumeAttachmentScenario-804454518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.277s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:04 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4be46b07-3e76-4816-8eb8-0fb4e35204cb tempest-TestServerVolumeAttachmentScenario-804454518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91a37bce-dba5-408d-b796-fbd4ecde9397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1b33387-8a97-4ddb-999a-f311261152c9', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:04 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4be46b07-3e76-4816-8eb8-0fb4e35204cb tempest-TestServerVolumeAttachmentScenario-804454518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e2a455f-b6ba-4079-9a32-a79ace832c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:04 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-4be46b07-3e76-4816-8eb8-0fb4e35204cb tempest-TestServerVolumeAttachmentScenario-804454518 None] Volume volume-d1b33387-8a97-4ddb-999a-f311261152c9 (d1b33387-8a97-4ddb-999a-f311261152c9): created successfully Jul 16 23:27:04 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4be46b07-3e76-4816-8eb8-0fb4e35204cb tempest-TestServerVolumeAttachmentScenario-804454518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e2a455f-b6ba-4079-9a32-a79ace832c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:04 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4be46b07-3e76-4816-8eb8-0fb4e35204cb tempest-TestServerVolumeAttachmentScenario-804454518 None] Flow 'volume_create_manager' (c9a32f56-3971-4b2e-a588-45fd6a26b61c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:27:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:27:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:27:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:04 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-4be46b07-3e76-4816-8eb8-0fb4e35204cb tempest-TestServerVolumeAttachmentScenario-804454518 None] Created volume successfully. Jul 16 23:27:04 devstack sudo[99707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:27:04 devstack sudo[99707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:04 devstack sudo[99707]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.487s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:04 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:27:04 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Deleted volume successfully. Jul 16 23:27:04 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:SELECT=137,cinder:UPDATE=131,cinder:DELETE=13,cinder:INSERT=39 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:27:04 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ff36fe17-24b1-4b5b-96dd-36d7ef0a97f3 tempest-VolumesDeleteCascade-165231006 None] Lock "cinder-f1eeaf0c-2a4c-44b5-8082-e2c80b180ed0-delete_volume" released by "delete_volume" :: held 10.169s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:27:05 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:SELECT=116,cinder:UPDATE=142,cinder:INSERT=44,cinder:DELETE=7 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:27:05 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d8245b1-a37a-4383-b5f2-f3c994798c75 tempest-VolumesDeleteCascade-165231006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:27:05 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3d8245b1-a37a-4383-b5f2-f3c994798c75 tempest-VolumesDeleteCascade-165231006 None] Flow 'volume_create_manager' (71f674e9-60a3-4e9b-96da-894edf577856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:27:05 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3d8245b1-a37a-4383-b5f2-f3c994798c75 tempest-VolumesDeleteCascade-165231006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f358439d-a070-4feb-8563-7800443d063d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:05 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3d8245b1-a37a-4383-b5f2-f3c994798c75 tempest-VolumesDeleteCascade-165231006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f358439d-a070-4feb-8563-7800443d063d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1250941358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9907a7d-1e42-4756-a7df-551ed2063170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bdc726ed36747e8bcd23d011da669df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:27:05Z,use_quota=True,user_id='09faea5448b440d28c19bf8823dcafd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:05 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3d8245b1-a37a-4383-b5f2-f3c994798c75 tempest-VolumesDeleteCascade-165231006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3def7073-9440-4cbf-88e8-45f33bd313bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:05 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3d8245b1-a37a-4383-b5f2-f3c994798c75 tempest-VolumesDeleteCascade-165231006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3def7073-9440-4cbf-88e8-45f33bd313bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:05 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3d8245b1-a37a-4383-b5f2-f3c994798c75 tempest-VolumesDeleteCascade-165231006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe955d2c-c0a1-426f-a2d6-8004071a7180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:05 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3d8245b1-a37a-4383-b5f2-f3c994798c75 tempest-VolumesDeleteCascade-165231006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe955d2c-c0a1-426f-a2d6-8004071a7180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9907a7d-1e42-4756-a7df-551ed2063170', 'volume_name': 'volume-e9907a7d-1e42-4756-a7df-551ed2063170', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:05 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3d8245b1-a37a-4383-b5f2-f3c994798c75 tempest-VolumesDeleteCascade-165231006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cabaa1c-d867-4259-9a28-1e0cb4ac795c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:05 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3d8245b1-a37a-4383-b5f2-f3c994798c75 tempest-VolumesDeleteCascade-165231006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cabaa1c-d867-4259-9a28-1e0cb4ac795c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:05 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3d8245b1-a37a-4383-b5f2-f3c994798c75 tempest-VolumesDeleteCascade-165231006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9210fe7c-1694-454a-9bdb-a612552930dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:05 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-3d8245b1-a37a-4383-b5f2-f3c994798c75 tempest-VolumesDeleteCascade-165231006 None] Volume e9907a7d-1e42-4756-a7df-551ed2063170: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9907a7d-1e42-4756-a7df-551ed2063170', 'volume_size': 1} Jul 16 23:27:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3d8245b1-a37a-4383-b5f2-f3c994798c75 tempest-VolumesDeleteCascade-165231006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3d8245b1-a37a-4383-b5f2-f3c994798c75 tempest-VolumesDeleteCascade-165231006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:05 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3d8245b1-a37a-4383-b5f2-f3c994798c75 tempest-VolumesDeleteCascade-165231006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1250941358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9907a7d-1e42-4756-a7df-551ed2063170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bdc726ed36747e8bcd23d011da669df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:27:05Z,use_quota=True,user_id='09faea5448b440d28c19bf8823dcafd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:27:05 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-3d8245b1-a37a-4383-b5f2-f3c994798c75 tempest-VolumesDeleteCascade-165231006 None] Creating volume e9907a7d-1e42-4756-a7df-551ed2063170 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:27:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3d8245b1-a37a-4383-b5f2-f3c994798c75 tempest-VolumesDeleteCascade-165231006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3d8245b1-a37a-4383-b5f2-f3c994798c75 tempest-VolumesDeleteCascade-165231006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:05 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3d8245b1-a37a-4383-b5f2-f3c994798c75 tempest-VolumesDeleteCascade-165231006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:27:05 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3d8245b1-a37a-4383-b5f2-f3c994798c75 tempest-VolumesDeleteCascade-165231006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:27:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3d8245b1-a37a-4383-b5f2-f3c994798c75 tempest-VolumesDeleteCascade-165231006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:05 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3d8245b1-a37a-4383-b5f2-f3c994798c75 tempest-VolumesDeleteCascade-165231006 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:27:05 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-3d8245b1-a37a-4383-b5f2-f3c994798c75 tempest-VolumesDeleteCascade-165231006 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:27:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3d8245b1-a37a-4383-b5f2-f3c994798c75 tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:05 devstack sudo[99731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170 1073741824 Jul 16 23:27:05 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:06 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3d8245b1-a37a-4383-b5f2-f3c994798c75 tempest-VolumesDeleteCascade-165231006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170 1073741824" returned: 0 in 0.516s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3d8245b1-a37a-4383-b5f2-f3c994798c75 tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:06 devstack sudo[99737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170 Jul 16 23:27:06 devstack sudo[99737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:06 devstack sudo[99737]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3d8245b1-a37a-4383-b5f2-f3c994798c75 tempest-VolumesDeleteCascade-165231006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170" returned: 0 in 0.394s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3d8245b1-a37a-4383-b5f2-f3c994798c75 tempest-VolumesDeleteCascade-165231006 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:27:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3d8245b1-a37a-4383-b5f2-f3c994798c75 tempest-VolumesDeleteCascade-165231006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3d8245b1-a37a-4383-b5f2-f3c994798c75 tempest-VolumesDeleteCascade-165231006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9210fe7c-1694-454a-9bdb-a612552930dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9907a7d-1e42-4756-a7df-551ed2063170', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3d8245b1-a37a-4383-b5f2-f3c994798c75 tempest-VolumesDeleteCascade-165231006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6499f7ba-90dc-49fd-9fb5-9c9a62722b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:06 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-3d8245b1-a37a-4383-b5f2-f3c994798c75 tempest-VolumesDeleteCascade-165231006 None] Volume volume-e9907a7d-1e42-4756-a7df-551ed2063170 (e9907a7d-1e42-4756-a7df-551ed2063170): created successfully Jul 16 23:27:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3d8245b1-a37a-4383-b5f2-f3c994798c75 tempest-VolumesDeleteCascade-165231006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6499f7ba-90dc-49fd-9fb5-9c9a62722b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3d8245b1-a37a-4383-b5f2-f3c994798c75 tempest-VolumesDeleteCascade-165231006 None] Flow 'volume_create_manager' (71f674e9-60a3-4e9b-96da-894edf577856) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:27:06 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-3d8245b1-a37a-4383-b5f2-f3c994798c75 tempest-VolumesDeleteCascade-165231006 None] Created volume successfully. Jul 16 23:27:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-543dcc31-a2f6-4f02-95b4-2fee34ffb7bd tempest-VolumesDeleteCascade-165231006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-543dcc31-a2f6-4f02-95b4-2fee34ffb7bd tempest-VolumesDeleteCascade-165231006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:07 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-543dcc31-a2f6-4f02-95b4-2fee34ffb7bd tempest-VolumesDeleteCascade-165231006 None] Creating offline snapshot ab49267b-1607-40fc-aa99-c7510175cc58 of volume e9907a7d-1e42-4756-a7df-551ed2063170 {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:27:07 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[8429bc6b-f574-40cf-b1df-6df99bde5713]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:27:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-543dcc31-a2f6-4f02-95b4-2fee34ffb7bd tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:08 devstack sudo[99746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170 Jul 16 23:27:08 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:08 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-543dcc31-a2f6-4f02-95b4-2fee34ffb7bd tempest-VolumesDeleteCascade-165231006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170" returned: 0 in 0.538s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-543dcc31-a2f6-4f02-95b4-2fee34ffb7bd tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170.ab49267b-1607-40fc-aa99-c7510175cc58 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:08 devstack sudo[99751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170.ab49267b-1607-40fc-aa99-c7510175cc58 1G Jul 16 23:27:08 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:09 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-543dcc31-a2f6-4f02-95b4-2fee34ffb7bd tempest-VolumesDeleteCascade-165231006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170.ab49267b-1607-40fc-aa99-c7510175cc58 1G" returned: 0 in 0.649s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-543dcc31-a2f6-4f02-95b4-2fee34ffb7bd tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9907a7d-1e42-4756-a7df-551ed2063170 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170.ab49267b-1607-40fc-aa99-c7510175cc58 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:09 devstack sudo[99760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9907a7d-1e42-4756-a7df-551ed2063170 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170.ab49267b-1607-40fc-aa99-c7510175cc58 Jul 16 23:27:09 devstack sudo[99760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:09 devstack sudo[99760]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-543dcc31-a2f6-4f02-95b4-2fee34ffb7bd tempest-VolumesDeleteCascade-165231006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9907a7d-1e42-4756-a7df-551ed2063170 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170.ab49267b-1607-40fc-aa99-c7510175cc58" returned: 0 in 0.558s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:09 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-543dcc31-a2f6-4f02-95b4-2fee34ffb7bd tempest-VolumesDeleteCascade-165231006 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170.ab49267b-1607-40fc-aa99-c7510175cc58 is being set with open permissions: ugo+rw Jul 16 23:27:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-543dcc31-a2f6-4f02-95b4-2fee34ffb7bd tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170.ab49267b-1607-40fc-aa99-c7510175cc58 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:09 devstack sudo[99775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170.ab49267b-1607-40fc-aa99-c7510175cc58 Jul 16 23:27:09 devstack sudo[99775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:10 devstack sudo[99775]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-543dcc31-a2f6-4f02-95b4-2fee34ffb7bd tempest-VolumesDeleteCascade-165231006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170.ab49267b-1607-40fc-aa99-c7510175cc58" returned: 0 in 0.364s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-543dcc31-a2f6-4f02-95b4-2fee34ffb7bd tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:10 devstack sudo[99783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170.info Jul 16 23:27:10 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:10 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-543dcc31-a2f6-4f02-95b4-2fee34ffb7bd tempest-VolumesDeleteCascade-165231006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170.info" returned: 0 in 0.319s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:10 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-543dcc31-a2f6-4f02-95b4-2fee34ffb7bd tempest-VolumesDeleteCascade-165231006 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170.info is being set with open permissions: ugo+rw Jul 16 23:27:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-543dcc31-a2f6-4f02-95b4-2fee34ffb7bd tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:10 devstack sudo[99786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170.info Jul 16 23:27:10 devstack sudo[99786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:10 devstack sudo[99786]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-543dcc31-a2f6-4f02-95b4-2fee34ffb7bd tempest-VolumesDeleteCascade-165231006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170.info" returned: 0 in 0.339s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-543dcc31-a2f6-4f02-95b4-2fee34ffb7bd tempest-VolumesDeleteCascade-165231006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.923s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:10 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-543dcc31-a2f6-4f02-95b4-2fee34ffb7bd tempest-VolumesDeleteCascade-165231006 None] Create snapshot completed successfully Jul 16 23:27:11 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:27:11 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Flow 'volume_create_manager' (e3ac733d-d445-4274-9470-1938ba3a469e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:27:11 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8c1700f-ae06-411b-bf5e-b3bf7f0df5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:11 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8c1700f-ae06-411b-bf5e-b3bf7f0df5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-346141630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ec0bfd7-656c-43ce-a7f3-941a19c4659f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bdc726ed36747e8bcd23d011da669df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ab49267b-1607-40fc-aa99-c7510175cc58,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:27:12Z,use_quota=True,user_id='09faea5448b440d28c19bf8823dcafd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:11 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acb7ed27-7333-44e9-bc7d-73e1090690fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:11 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acb7ed27-7333-44e9-bc7d-73e1090690fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:11 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a16765cc-c2cb-4e57-bca3-464b66827dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:11 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a16765cc-c2cb-4e57-bca3-464b66827dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5ec0bfd7-656c-43ce-a7f3-941a19c4659f', 'volume_name': 'volume-5ec0bfd7-656c-43ce-a7f3-941a19c4659f', 'volume_size': 1, 'snapshot_id': 'ab49267b-1607-40fc-aa99-c7510175cc58'}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:11 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85a770a8-00b0-46fc-a4fa-8311f9360dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:11 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85a770a8-00b0-46fc-a4fa-8311f9360dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:11 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d38f1d1-3d3a-4f07-acf6-f4ed6046de3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:11 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Volume 5ec0bfd7-656c-43ce-a7f3-941a19c4659f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5ec0bfd7-656c-43ce-a7f3-941a19c4659f', 'volume_size': 1, 'snapshot_id': 'ab49267b-1607-40fc-aa99-c7510175cc58'} Jul 16 23:27:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:11 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Acquiring lock "cinder-quobyte-ab49267b-1607-40fc-aa99-c7510175cc58-5ec0bfd7-656c-43ce-a7f3-941a19c4659f" by "_create_volume_from_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:27:11 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Lock "cinder-quobyte-ab49267b-1607-40fc-aa99-c7510175cc58-5ec0bfd7-656c-43ce-a7f3-941a19c4659f" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:27:11 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Creating volume 5ec0bfd7-656c-43ce-a7f3-941a19c4659f from snapshot ab49267b-1607-40fc-aa99-c7510175cc58 {{(pid=87607) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 16 23:27:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:11 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:27:11 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:27:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:11 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:27:11 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Acquiring lock "cinder-quobyte-5ec0bfd7-656c-43ce-a7f3-941a19c4659f" by "_copy_volume_from_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:27:11 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Lock "cinder-quobyte-5ec0bfd7-656c-43ce-a7f3-941a19c4659f" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:27:11 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] snapshot: ab49267b-1607-40fc-aa99-c7510175cc58, volume: 5ec0bfd7-656c-43ce-a7f3-941a19c4659f, {{(pid=87607) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 16 23:27:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:12 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:27:12 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:27:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:12 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a12328c-afcf-48da-8f77-f6637d9f0ccb]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:27:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170.ab49267b-1607-40fc-aa99-c7510175cc58 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:12 devstack sudo[99790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170.ab49267b-1607-40fc-aa99-c7510175cc58 Jul 16 23:27:12 devstack sudo[99790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:12 devstack sudo[99790]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170.ab49267b-1607-40fc-aa99-c7510175cc58" returned: 0 in 0.524s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:12 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9907a7d-1e42-4756-a7df-551ed2063170(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:27:12 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170 {{(pid=87607) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 16 23:27:12 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Creating direct copy from snapshot {{(pid=87607) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 16 23:27:12 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09bfad4-61a2-4b81-bda8-551e47347ec4]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:27:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:12 devstack sudo[99795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170 Jul 16 23:27:12 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:13 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170" returned: 0 in 0.699s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:13 devstack cinder-volume[87607]: DEBUG cinder.utils [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Path /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5ec0bfd7-656c-43ce-a7f3-941a19c4659f not found in is_blk_device check {{(pid=87607) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 16 23:27:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5ec0bfd7-656c-43ce-a7f3-941a19c4659f {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:13 devstack sudo[99835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5ec0bfd7-656c-43ce-a7f3-941a19c4659f Jul 16 23:27:13 devstack sudo[99835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:21 devstack sudo[99835]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5ec0bfd7-656c-43ce-a7f3-941a19c4659f" returned: 0 in 8.397s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:21 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a501d59-0c9b-4f34-b3c6-8b6dac22ab09]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:27:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:21 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:INSERT=2,cinder:UPDATE=3,cinder:DELETE=2,cinder:SELECT=3 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:27:21 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:SELECT=12,cinder:UPDATE=6 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:27:21 devstack sudo[99901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170 Jul 16 23:27:21 devstack sudo[99901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:22 devstack sudo[99901]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170" returned: 0 in 1.216s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:22 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Image conversion details: src /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170, size 1024.00 MB, duration 8.40 sec, destination /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5ec0bfd7-656c-43ce-a7f3-941a19c4659f {{(pid=87607) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 23:27:22 devstack cinder-volume[87607]: INFO cinder.image.image_utils [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Converted 1024.00 MB image at 121.93 MB/s Jul 16 23:27:22 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5ec0bfd7-656c-43ce-a7f3-941a19c4659f is being set with open permissions: ugo+rw Jul 16 23:27:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5ec0bfd7-656c-43ce-a7f3-941a19c4659f {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:22 devstack sudo[99908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5ec0bfd7-656c-43ce-a7f3-941a19c4659f Jul 16 23:27:22 devstack sudo[99908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:23 devstack sudo[99908]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5ec0bfd7-656c-43ce-a7f3-941a19c4659f" returned: 0 in 0.455s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:23 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Lock "cinder-quobyte-5ec0bfd7-656c-43ce-a7f3-941a19c4659f" released by "_copy_volume_from_snapshot" :: held 11.449s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:27:23 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Lock "cinder-quobyte-ab49267b-1607-40fc-aa99-c7510175cc58-5ec0bfd7-656c-43ce-a7f3-941a19c4659f" released by "_create_volume_from_snapshot" :: held 11.494s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:27:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.511s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d38f1d1-3d3a-4f07-acf6-f4ed6046de3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ec0bfd7-656c-43ce-a7f3-941a19c4659f', 'volume_size': 1, 'snapshot_id': 'ab49267b-1607-40fc-aa99-c7510175cc58'}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c68bbaa7-350e-4536-b84b-2fb6f0d98820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:23 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Volume volume-5ec0bfd7-656c-43ce-a7f3-941a19c4659f (5ec0bfd7-656c-43ce-a7f3-941a19c4659f): created successfully Jul 16 23:27:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c68bbaa7-350e-4536-b84b-2fb6f0d98820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Flow 'volume_create_manager' (e3ac733d-d445-4274-9470-1938ba3a469e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:27:23 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-434ebf5a-c515-4466-ad6d-226a7c968b95 tempest-VolumesDeleteCascade-165231006 None] Created volume successfully. Jul 16 23:27:25 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4ea6aa0a-e8c3-4211-be05-26dc521372f3 tempest-VolumesDeleteCascade-165231006 None] Acquiring lock "cinder-e9907a7d-1e42-4756-a7df-551ed2063170-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:27:25 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4ea6aa0a-e8c3-4211-be05-26dc521372f3 tempest-VolumesDeleteCascade-165231006 None] Lock "cinder-e9907a7d-1e42-4756-a7df-551ed2063170-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:27:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4ea6aa0a-e8c3-4211-be05-26dc521372f3 tempest-VolumesDeleteCascade-165231006 None] Performing cascade delete. {{(pid=87607) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 16 23:27:25 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4ea6aa0a-e8c3-4211-be05-26dc521372f3 tempest-VolumesDeleteCascade-165231006 None] Acquiring lock "cinder-ab49267b-1607-40fc-aa99-c7510175cc58-delete_snapshot" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:27:25 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4ea6aa0a-e8c3-4211-be05-26dc521372f3 tempest-VolumesDeleteCascade-165231006 None] Lock "cinder-ab49267b-1607-40fc-aa99-c7510175cc58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:27:25 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4ea6aa0a-e8c3-4211-be05-26dc521372f3 tempest-VolumesDeleteCascade-165231006 None] Acquiring lock "cinder-quobyte-e9907a7d-1e42-4756-a7df-551ed2063170" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:27:25 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4ea6aa0a-e8c3-4211-be05-26dc521372f3 tempest-VolumesDeleteCascade-165231006 None] Lock "cinder-quobyte-e9907a7d-1e42-4756-a7df-551ed2063170" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:27:25 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4ea6aa0a-e8c3-4211-be05-26dc521372f3 tempest-VolumesDeleteCascade-165231006 None] Acquiring lock "cinder-quobyte-ab49267b-1607-40fc-aa99-c7510175cc58" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:27:25 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4ea6aa0a-e8c3-4211-be05-26dc521372f3 tempest-VolumesDeleteCascade-165231006 None] Lock "cinder-quobyte-ab49267b-1607-40fc-aa99-c7510175cc58" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:27:25 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-4ea6aa0a-e8c3-4211-be05-26dc521372f3 tempest-VolumesDeleteCascade-165231006 None] Deleting offline snapshot ab49267b-1607-40fc-aa99-c7510175cc58 of volume e9907a7d-1e42-4756-a7df-551ed2063170 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:27:25 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-4ea6aa0a-e8c3-4211-be05-26dc521372f3 tempest-VolumesDeleteCascade-165231006 None] snapshot_file for this snap is: volume-e9907a7d-1e42-4756-a7df-551ed2063170.ab49267b-1607-40fc-aa99-c7510175cc58 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:27:25 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cf76e7-8c36-481e-8918-886e31b1ddaf]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:27:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4ea6aa0a-e8c3-4211-be05-26dc521372f3 tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170.ab49267b-1607-40fc-aa99-c7510175cc58 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:25 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:27:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Flow 'volume_create_manager' (0341e9b8-33de-4bfb-a146-f4e372e2aad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:27:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e031569b-d5d5-4964-9fff-e36632321280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e031569b-d5d5-4964-9fff-e36632321280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb885353-2867-488e-9368-7e2dd2e4bb53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f78f27167ab4bab83075cb01f861c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:27:26Z,use_quota=True,user_id='d85a1d61477744edbe3b4bb5844d2b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f6d49cd-da35-4a1e-a56a-35a6c5c2c0d0),volume_type_id=3f6d49cd-da35-4a1e-a56a-35a6c5c2c0d0)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcfbe184-de5f-4e71-b28e-41fab9d599ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcfbe184-de5f-4e71-b28e-41fab9d599ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f135bb7-e095-41c1-8ebb-8a287c5dfc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:25 devstack cinder-volume[87607]: DEBUG cinder.image.glance [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Creating Keystone auth plugin from conf {{(pid=87607) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 16 23:27:25 devstack sudo[99952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170.ab49267b-1607-40fc-aa99-c7510175cc58 Jul 16 23:27:25 devstack sudo[99952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:26 devstack sudo[99952]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4ea6aa0a-e8c3-4211-be05-26dc521372f3 tempest-VolumesDeleteCascade-165231006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170.ab49267b-1607-40fc-aa99-c7510175cc58" returned: 0 in 1.097s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:26 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-4ea6aa0a-e8c3-4211-be05-26dc521372f3 tempest-VolumesDeleteCascade-165231006 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9907a7d-1e42-4756-a7df-551ed2063170(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:27:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f135bb7-e095-41c1-8ebb-8a287c5dfc3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fb885353-2867-488e-9368-7e2dd2e4bb53', 'volume_name': 'volume-fb885353-2867-488e-9368-7e2dd2e4bb53', 'volume_size': 1, 'image_id': 'd6a0b41f-36c6-41ff-bb95-30da9dd0a6b1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '45451469279c8995a276679879d7e55e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1f78f27167ab4bab83075cb01f861c30', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2805978ea7f3b8d8c206eb8a4839164750ff2ac54e4e20e197f11a2c370ba99e65f7ec7394d65a735d3d1c55b7af65317e410565813fe98520e09d724a0d604d', 'id': 'd6a0b41f-36c6-41ff-bb95-30da9dd0a6b1', 'created_at': datetime.datetime(2026, 7, 16, 21, 27, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 21, 27, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92c1c405-24ed-459a-add6-b3745f1ba526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92c1c405-24ed-459a-add6-b3745f1ba526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99810251-33dc-4f79-ae54-b5e312b5fb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:26 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Volume fb885353-2867-488e-9368-7e2dd2e4bb53: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fb885353-2867-488e-9368-7e2dd2e4bb53', 'volume_size': 1, 'image_id': 'd6a0b41f-36c6-41ff-bb95-30da9dd0a6b1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '45451469279c8995a276679879d7e55e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1f78f27167ab4bab83075cb01f861c30', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2805978ea7f3b8d8c206eb8a4839164750ff2ac54e4e20e197f11a2c370ba99e65f7ec7394d65a735d3d1c55b7af65317e410565813fe98520e09d724a0d604d', 'id': 'd6a0b41f-36c6-41ff-bb95-30da9dd0a6b1', 'created_at': datetime.datetime(2026, 7, 16, 21, 27, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 21, 27, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 16 23:27:26 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Trying to clone fb885353-2867-488e-9368-7e2dd2e4bb53 from image d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1', 'metadata': {}}]). {{(pid=87607) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 16 23:27:26 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[3329b0c2-66c5-4324-bf69-90df4fb876e6]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:27:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4ea6aa0a-e8c3-4211-be05-26dc521372f3 tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:27 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1_0nao1085devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87607) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 16 23:27:27 devstack cinder-volume[87607]: INFO cinder.image.image_utils [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Image download 0.00 MB at 0.00 MB/s Jul 16 23:27:27 devstack sudo[99983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170 Jul 16 23:27:27 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:27 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3532068-f0fa-4a07-b835-d3cc3ccaafbe]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:27:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1_0nao1085devstack@QuobyteHD {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:27 devstack sudo[99986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1_0nao1085devstack@QuobyteHD Jul 16 23:27:27 devstack sudo[99986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:27 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4ea6aa0a-e8c3-4211-be05-26dc521372f3 tempest-VolumesDeleteCascade-165231006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170" returned: 0 in 0.668s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4ea6aa0a-e8c3-4211-be05-26dc521372f3 tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170.ab49267b-1607-40fc-aa99-c7510175cc58 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:27 devstack sudo[99993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170.ab49267b-1607-40fc-aa99-c7510175cc58 Jul 16 23:27:27 devstack sudo[99993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:27 devstack sudo[99986]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1_0nao1085devstack@QuobyteHD" returned: 0 in 0.801s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1_0nao1085devstack@QuobyteHD {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:28 devstack sudo[99998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1_0nao1085devstack@QuobyteHD Jul 16 23:27:28 devstack sudo[99998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:28 devstack sudo[99993]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4ea6aa0a-e8c3-4211-be05-26dc521372f3 tempest-VolumesDeleteCascade-165231006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170.ab49267b-1607-40fc-aa99-c7510175cc58" returned: 0 in 0.594s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4ea6aa0a-e8c3-4211-be05-26dc521372f3 tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170.ab49267b-1607-40fc-aa99-c7510175cc58 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:28 devstack sudo[100002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170.ab49267b-1607-40fc-aa99-c7510175cc58 Jul 16 23:27:28 devstack sudo[100002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:28 devstack sudo[99998]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1_0nao1085devstack@QuobyteHD" returned: 1 in 0.414s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1_0nao1085devstack@QuobyteHD' failed. Not Retrying. {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 23:27:28 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Temporary image d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1 is fetched for user d85a1d61477744edbe3b4bb5844d2b6a. {{(pid=87607) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 16 23:27:28 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3b3651-25da-4ac8-afa5-026785699e87]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:27:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1_0nao1085devstack@QuobyteHD {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:28 devstack sudo[100002]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4ea6aa0a-e8c3-4211-be05-26dc521372f3 tempest-VolumesDeleteCascade-165231006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170.ab49267b-1607-40fc-aa99-c7510175cc58" returned: 0 in 0.323s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:28 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4ea6aa0a-e8c3-4211-be05-26dc521372f3 tempest-VolumesDeleteCascade-165231006 None] Lock "cinder-quobyte-ab49267b-1607-40fc-aa99-c7510175cc58" released by "_delete_snapshot" :: held 2.931s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:27:28 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4ea6aa0a-e8c3-4211-be05-26dc521372f3 tempest-VolumesDeleteCascade-165231006 None] Lock "cinder-quobyte-e9907a7d-1e42-4756-a7df-551ed2063170" released by "delete_snapshot" :: held 2.971s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:27:28 devstack sudo[100026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1_0nao1085devstack@QuobyteHD Jul 16 23:27:28 devstack sudo[100026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:28 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-4ea6aa0a-e8c3-4211-be05-26dc521372f3 tempest-VolumesDeleteCascade-165231006 None] Created reservations ['d2ffbc9d-cf7b-4df0-81bf-45229bc1ffaa', 'ad49daa5-fd42-4e73-983d-839cee5b3d66', 'd4659ec1-d7ba-4550-9995-212c8bac3c71', 'afed7a8f-eab5-4e03-b043-7cd8c6925e98'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:27:28 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-4ea6aa0a-e8c3-4211-be05-26dc521372f3 tempest-VolumesDeleteCascade-165231006 None] Delete snapshot completed successfully. Jul 16 23:27:28 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4ea6aa0a-e8c3-4211-be05-26dc521372f3 tempest-VolumesDeleteCascade-165231006 None] Lock "cinder-ab49267b-1607-40fc-aa99-c7510175cc58-delete_snapshot" released by "delete_snapshot" :: held 3.253s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:27:28 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4ea6aa0a-e8c3-4211-be05-26dc521372f3 tempest-VolumesDeleteCascade-165231006 None] Snapshots deleted, issuing volume delete {{(pid=87607) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 16 23:27:28 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4ea6aa0a-e8c3-4211-be05-26dc521372f3 tempest-VolumesDeleteCascade-165231006 None] Acquiring lock "cinder-quobyte-e9907a7d-1e42-4756-a7df-551ed2063170" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:27:28 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4ea6aa0a-e8c3-4211-be05-26dc521372f3 tempest-VolumesDeleteCascade-165231006 None] Lock "cinder-quobyte-e9907a7d-1e42-4756-a7df-551ed2063170" acquired by "delete_volume" :: waited 0.026s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:27:28 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[460cbc48-d120-41e9-9e26-c4c4ff8f482e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:27:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4ea6aa0a-e8c3-4211-be05-26dc521372f3 tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:28 devstack sudo[100026]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1_0nao1085devstack@QuobyteHD" returned: 0 in 0.532s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1_0nao1085devstack@QuobyteHD {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:28 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170 Jul 16 23:27:28 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:29 devstack sudo[100040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1_0nao1085devstack@QuobyteHD Jul 16 23:27:29 devstack sudo[100040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:29 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4ea6aa0a-e8c3-4211-be05-26dc521372f3 tempest-VolumesDeleteCascade-165231006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170" returned: 0 in 0.542s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4ea6aa0a-e8c3-4211-be05-26dc521372f3 tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:29 devstack sudo[100046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170 Jul 16 23:27:29 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:29 devstack sudo[100040]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1_0nao1085devstack@QuobyteHD" returned: 1 in 0.462s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1_0nao1085devstack@QuobyteHD' failed. Not Retrying. {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 23:27:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:29 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb885353-2867-488e-9368-7e2dd2e4bb53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f78f27167ab4bab83075cb01f861c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:27:26Z,use_quota=True,user_id='d85a1d61477744edbe3b4bb5844d2b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f6d49cd-da35-4a1e-a56a-35a6c5c2c0d0),volume_type_id=3f6d49cd-da35-4a1e-a56a-35a6c5c2c0d0)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:27:29 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Creating volume fb885353-2867-488e-9368-7e2dd2e4bb53 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:27:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:29 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:27:29 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:27:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:29 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:27:29 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:27:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-fb885353-2867-488e-9368-7e2dd2e4bb53 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:29 devstack sudo[100051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-fb885353-2867-488e-9368-7e2dd2e4bb53 1073741824 Jul 16 23:27:29 devstack sudo[100051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:29 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4ea6aa0a-e8c3-4211-be05-26dc521372f3 tempest-VolumesDeleteCascade-165231006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e9907a7d-1e42-4756-a7df-551ed2063170" returned: 0 in 0.286s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:29 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4ea6aa0a-e8c3-4211-be05-26dc521372f3 tempest-VolumesDeleteCascade-165231006 None] Lock "cinder-quobyte-e9907a7d-1e42-4756-a7df-551ed2063170" released by "delete_volume" :: held 0.910s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:27:29 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-4ea6aa0a-e8c3-4211-be05-26dc521372f3 tempest-VolumesDeleteCascade-165231006 None] Created reservations ['0a523279-772b-41f9-a7a1-d99e1780a558', '7145ed99-b102-4c69-b689-5c270be2769e', '02137161-1664-47d4-8464-bc206582d50b', '3a203a3e-e44c-48b6-bbce-25b85bfda965'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:27:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4ea6aa0a-e8c3-4211-be05-26dc521372f3 tempest-VolumesDeleteCascade-165231006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4ea6aa0a-e8c3-4211-be05-26dc521372f3 tempest-VolumesDeleteCascade-165231006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:29 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4ea6aa0a-e8c3-4211-be05-26dc521372f3 tempest-VolumesDeleteCascade-165231006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:27:29 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4ea6aa0a-e8c3-4211-be05-26dc521372f3 tempest-VolumesDeleteCascade-165231006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:27:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4ea6aa0a-e8c3-4211-be05-26dc521372f3 tempest-VolumesDeleteCascade-165231006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4ea6aa0a-e8c3-4211-be05-26dc521372f3 tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:29 devstack sudo[100057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:27:29 devstack sudo[100057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:30 devstack sudo[100051]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-fb885353-2867-488e-9368-7e2dd2e4bb53 1073741824" returned: 0 in 0.703s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:30 devstack sudo[100057]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4ea6aa0a-e8c3-4211-be05-26dc521372f3 tempest-VolumesDeleteCascade-165231006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.333s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:30 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-4ea6aa0a-e8c3-4211-be05-26dc521372f3 tempest-VolumesDeleteCascade-165231006 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:27:30 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-4ea6aa0a-e8c3-4211-be05-26dc521372f3 tempest-VolumesDeleteCascade-165231006 None] Deleted volume successfully. Jul 16 23:27:30 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4ea6aa0a-e8c3-4211-be05-26dc521372f3 tempest-VolumesDeleteCascade-165231006 None] Lock "cinder-e9907a7d-1e42-4756-a7df-551ed2063170-delete_volume" released by "delete_volume" :: held 5.000s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:27:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-fb885353-2867-488e-9368-7e2dd2e4bb53 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:30 devstack sudo[100063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-fb885353-2867-488e-9368-7e2dd2e4bb53 Jul 16 23:27:30 devstack sudo[100063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:30 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-154d818a-2bb9-4d78-8eac-246404ed7344 tempest-VolumesDeleteCascade-165231006 None] Acquiring lock "cinder-5ec0bfd7-656c-43ce-a7f3-941a19c4659f-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:27:30 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-154d818a-2bb9-4d78-8eac-246404ed7344 tempest-VolumesDeleteCascade-165231006 None] Lock "cinder-5ec0bfd7-656c-43ce-a7f3-941a19c4659f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:27:30 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-154d818a-2bb9-4d78-8eac-246404ed7344 tempest-VolumesDeleteCascade-165231006 None] Acquiring lock "cinder-quobyte-5ec0bfd7-656c-43ce-a7f3-941a19c4659f" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:27:30 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-154d818a-2bb9-4d78-8eac-246404ed7344 tempest-VolumesDeleteCascade-165231006 None] Lock "cinder-quobyte-5ec0bfd7-656c-43ce-a7f3-941a19c4659f" acquired by "delete_volume" :: waited 0.043s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:27:30 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba8dd2c-6266-454a-a391-ba34cf217d21]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:27:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-154d818a-2bb9-4d78-8eac-246404ed7344 tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5ec0bfd7-656c-43ce-a7f3-941a19c4659f {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:30 devstack sudo[100063]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-fb885353-2867-488e-9368-7e2dd2e4bb53" returned: 0 in 0.407s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:30 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:27:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:30 devstack cinder-volume[87607]: DEBUG cinder.volume.volume_utils [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Attempting download of d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1 ((None, [{'url': 'file:///opt/stack/data/glance/images/d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1', 'metadata': {}}])) to volume fb885353-2867-488e-9368-7e2dd2e4bb53. {{(pid=87607) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 16 23:27:30 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6c92c8-6dbe-4296-aa23-3fccb24cc5b1]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:27:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1_1q1wb1vv {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:30 devstack sudo[100067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5ec0bfd7-656c-43ce-a7f3-941a19c4659f Jul 16 23:27:30 devstack sudo[100067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:30 devstack sudo[100068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1_1q1wb1vv Jul 16 23:27:30 devstack sudo[100068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:31 devstack sudo[100067]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-154d818a-2bb9-4d78-8eac-246404ed7344 tempest-VolumesDeleteCascade-165231006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5ec0bfd7-656c-43ce-a7f3-941a19c4659f" returned: 0 in 0.575s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-154d818a-2bb9-4d78-8eac-246404ed7344 tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5ec0bfd7-656c-43ce-a7f3-941a19c4659f {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:31 devstack sudo[100075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5ec0bfd7-656c-43ce-a7f3-941a19c4659f Jul 16 23:27:31 devstack sudo[100075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:31 devstack sudo[100068]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1_1q1wb1vv" returned: 0 in 0.469s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1_1q1wb1vv {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:31 devstack sudo[100079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1_1q1wb1vv Jul 16 23:27:31 devstack sudo[100079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:31 devstack sudo[100075]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-154d818a-2bb9-4d78-8eac-246404ed7344 tempest-VolumesDeleteCascade-165231006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5ec0bfd7-656c-43ce-a7f3-941a19c4659f" returned: 0 in 0.299s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:31 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-154d818a-2bb9-4d78-8eac-246404ed7344 tempest-VolumesDeleteCascade-165231006 None] Lock "cinder-quobyte-5ec0bfd7-656c-43ce-a7f3-941a19c4659f" released by "delete_volume" :: held 0.964s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:27:31 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-154d818a-2bb9-4d78-8eac-246404ed7344 tempest-VolumesDeleteCascade-165231006 None] Created reservations ['f85c8148-6096-483d-845f-323f7ebabbbb', '1d4b78cc-3b31-48b0-ae32-03c6edc09ae0', '8ae7d603-1bc4-4cab-81b6-09cdf5b97bc0', '47b37e02-d552-48b9-b9cb-c0b7685c53e8'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:27:31 devstack sudo[100079]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1_1q1wb1vv" returned: 1 in 0.430s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1_1q1wb1vv' failed. Not Retrying. {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 23:27:31 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b1bb8b-4a43-44cb-a18d-96948342dfb4]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:27:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1_0nao1085devstack@QuobyteHD {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-154d818a-2bb9-4d78-8eac-246404ed7344 tempest-VolumesDeleteCascade-165231006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-154d818a-2bb9-4d78-8eac-246404ed7344 tempest-VolumesDeleteCascade-165231006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:31 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-154d818a-2bb9-4d78-8eac-246404ed7344 tempest-VolumesDeleteCascade-165231006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:27:31 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-154d818a-2bb9-4d78-8eac-246404ed7344 tempest-VolumesDeleteCascade-165231006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:27:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-154d818a-2bb9-4d78-8eac-246404ed7344 tempest-VolumesDeleteCascade-165231006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-154d818a-2bb9-4d78-8eac-246404ed7344 tempest-VolumesDeleteCascade-165231006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:31 devstack sudo[100085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:27:31 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:31 devstack sudo[100084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1_0nao1085devstack@QuobyteHD Jul 16 23:27:31 devstack sudo[100084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:31 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-154d818a-2bb9-4d78-8eac-246404ed7344 tempest-VolumesDeleteCascade-165231006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.247s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:31 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-154d818a-2bb9-4d78-8eac-246404ed7344 tempest-VolumesDeleteCascade-165231006 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:27:31 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-154d818a-2bb9-4d78-8eac-246404ed7344 tempest-VolumesDeleteCascade-165231006 None] Deleted volume successfully. Jul 16 23:27:32 devstack sudo[100084]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:32 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-154d818a-2bb9-4d78-8eac-246404ed7344 tempest-VolumesDeleteCascade-165231006 None] Lock "cinder-5ec0bfd7-656c-43ce-a7f3-941a19c4659f-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:27:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1_0nao1085devstack@QuobyteHD" returned: 0 in 0.355s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1_0nao1085devstack@QuobyteHD {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:32 devstack sudo[100091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1_0nao1085devstack@QuobyteHD Jul 16 23:27:32 devstack sudo[100091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:32 devstack sudo[100091]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1_0nao1085devstack@QuobyteHD" returned: 1 in 0.324s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1_0nao1085devstack@QuobyteHD' failed. Not Retrying. {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 23:27:32 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1 was raw, converting to qcow2 {{(pid=87607) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 16 23:27:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1_0nao1085devstack@QuobyteHD /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-fb885353-2867-488e-9368-7e2dd2e4bb53 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:32 devstack sudo[100096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1_0nao1085devstack@QuobyteHD /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-fb885353-2867-488e-9368-7e2dd2e4bb53 Jul 16 23:27:32 devstack sudo[100096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:32 devstack sudo[100096]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1_0nao1085devstack@QuobyteHD /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-fb885353-2867-488e-9368-7e2dd2e4bb53" returned: 0 in 0.443s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:32 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1_0nao1085devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-fb885353-2867-488e-9368-7e2dd2e4bb53 {{(pid=87607) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 23:27:32 devstack cinder-volume[87607]: INFO cinder.image.image_utils [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Converted 0.00 MB image at 0.00 MB/s Jul 16 23:27:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-fb885353-2867-488e-9368-7e2dd2e4bb53 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:32 devstack sudo[100101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-fb885353-2867-488e-9368-7e2dd2e4bb53 1G Jul 16 23:27:32 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:33 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-fb885353-2867-488e-9368-7e2dd2e4bb53 1G" returned: 0 in 0.339s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:33 devstack cinder-volume[87607]: DEBUG cinder.volume.volume_utils [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Downloaded image d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1 ((None, [{'url': 'file:///opt/stack/data/glance/images/d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1', 'metadata': {}}])) to volume fb885353-2867-488e-9368-7e2dd2e4bb53 successfully. {{(pid=87607) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 16 23:27:33 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Temporary image d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1 for user d85a1d61477744edbe3b4bb5844d2b6a is deleted. {{(pid=87607) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 16 23:27:33 devstack cinder-volume[87607]: DEBUG cinder.volume.volume_utils [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Marking volume fb885353-2867-488e-9368-7e2dd2e4bb53 as bootable. {{(pid=87607) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 16 23:27:33 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Copying metadata from image d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1 to fb885353-2867-488e-9368-7e2dd2e4bb53. {{(pid=87607) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 16 23:27:33 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Creating volume glance metadata for volume fb885353-2867-488e-9368-7e2dd2e4bb53 backed by image d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'd6a0b41f-36c6-41ff-bb95-30da9dd0a6b1', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '45451469279c8995a276679879d7e55e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87607) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 16 23:27:33 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99810251-33dc-4f79-ae54-b5e312b5fb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb885353-2867-488e-9368-7e2dd2e4bb53', 'volume_size': 1, 'image_id': 'd6a0b41f-36c6-41ff-bb95-30da9dd0a6b1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '45451469279c8995a276679879d7e55e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1f78f27167ab4bab83075cb01f861c30', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2805978ea7f3b8d8c206eb8a4839164750ff2ac54e4e20e197f11a2c370ba99e65f7ec7394d65a735d3d1c55b7af65317e410565813fe98520e09d724a0d604d', 'id': 'd6a0b41f-36c6-41ff-bb95-30da9dd0a6b1', 'created_at': datetime.datetime(2026, 7, 16, 21, 27, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 21, 27, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d6a0b41f-36c6-41ff-bb95-30da9dd0a6b1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:33 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ba99332-da54-43fb-afd1-e1d968e5e30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:33 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Volume volume-fb885353-2867-488e-9368-7e2dd2e4bb53 (fb885353-2867-488e-9368-7e2dd2e4bb53): created successfully Jul 16 23:27:33 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ba99332-da54-43fb-afd1-e1d968e5e30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:33 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Flow 'volume_create_manager' (0341e9b8-33de-4bfb-a146-f4e372e2aad9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:27:33 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-11d3db35-a264-4c68-91f4-5e8776d55e01 tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Created volume successfully. Jul 16 23:27:34 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1ffe9be0-f8c5-4c86-ba14-ef47abfde9aa tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Acquiring lock "cinder-fb885353-2867-488e-9368-7e2dd2e4bb53-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:27:34 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1ffe9be0-f8c5-4c86-ba14-ef47abfde9aa tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Lock "cinder-fb885353-2867-488e-9368-7e2dd2e4bb53-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:27:34 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1ffe9be0-f8c5-4c86-ba14-ef47abfde9aa tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Acquiring lock "cinder-quobyte-fb885353-2867-488e-9368-7e2dd2e4bb53" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:27:34 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1ffe9be0-f8c5-4c86-ba14-ef47abfde9aa tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Lock "cinder-quobyte-fb885353-2867-488e-9368-7e2dd2e4bb53" acquired by "delete_volume" :: waited 0.026s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:27:34 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3236b84-7d54-458c-a9d9-f76416e9b28d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:27:34 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1ffe9be0-f8c5-4c86-ba14-ef47abfde9aa tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-fb885353-2867-488e-9368-7e2dd2e4bb53 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:34 devstack sudo[100107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-fb885353-2867-488e-9368-7e2dd2e4bb53 Jul 16 23:27:34 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:35 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1ffe9be0-f8c5-4c86-ba14-ef47abfde9aa tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-fb885353-2867-488e-9368-7e2dd2e4bb53" returned: 0 in 0.409s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1ffe9be0-f8c5-4c86-ba14-ef47abfde9aa tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-fb885353-2867-488e-9368-7e2dd2e4bb53 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:35 devstack sudo[100112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-fb885353-2867-488e-9368-7e2dd2e4bb53 Jul 16 23:27:35 devstack sudo[100112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:35 devstack sudo[100112]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1ffe9be0-f8c5-4c86-ba14-ef47abfde9aa tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-fb885353-2867-488e-9368-7e2dd2e4bb53" returned: 0 in 0.312s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:35 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1ffe9be0-f8c5-4c86-ba14-ef47abfde9aa tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Lock "cinder-quobyte-fb885353-2867-488e-9368-7e2dd2e4bb53" released by "delete_volume" :: held 0.805s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:27:35 devstack cinder-volume[87607]: WARNING cinder.quota [None req-1ffe9be0-f8c5-4c86-ba14-ef47abfde9aa tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 16 23:27:35 devstack cinder-volume[87607]: WARNING cinder.quota [None req-1ffe9be0-f8c5-4c86-ba14-ef47abfde9aa tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 16 23:27:35 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-1ffe9be0-f8c5-4c86-ba14-ef47abfde9aa tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Created reservations ['a8ae2ef6-d0d1-4352-a844-40baac52a187', '2838d8b5-5c38-4a13-adf0-f6b40696337c', 'c60b0624-fa65-47c6-b7d2-1a38439d645b', '0feb0068-d219-4980-a05f-a5b87e332cf3'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:27:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1ffe9be0-f8c5-4c86-ba14-ef47abfde9aa tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1ffe9be0-f8c5-4c86-ba14-ef47abfde9aa tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:35 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1ffe9be0-f8c5-4c86-ba14-ef47abfde9aa tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:27:35 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1ffe9be0-f8c5-4c86-ba14-ef47abfde9aa tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:27:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1ffe9be0-f8c5-4c86-ba14-ef47abfde9aa tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1ffe9be0-f8c5-4c86-ba14-ef47abfde9aa tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:35 devstack sudo[100115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:27:35 devstack sudo[100115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:36 devstack sudo[100115]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1ffe9be0-f8c5-4c86-ba14-ef47abfde9aa tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.511s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:36 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-1ffe9be0-f8c5-4c86-ba14-ef47abfde9aa tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:27:36 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-1ffe9be0-f8c5-4c86-ba14-ef47abfde9aa tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Deleted volume successfully. Jul 16 23:27:36 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1ffe9be0-f8c5-4c86-ba14-ef47abfde9aa tempest-VolumeAndVolumeTypeFromImageTest-2017095047 None] Lock "cinder-fb885353-2867-488e-9368-7e2dd2e4bb53-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:27:36 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-0da33325-2caf-40f3-8409-12a7db64befd tempest-VolumesMetadataTest-960625014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:27:36 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0da33325-2caf-40f3-8409-12a7db64befd tempest-VolumesMetadataTest-960625014 None] Flow 'volume_create_manager' (e669e7b1-71fb-4f4b-9788-273ded6c3edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:27:36 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0da33325-2caf-40f3-8409-12a7db64befd tempest-VolumesMetadataTest-960625014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (099bb3ff-e460-4451-966e-2f1c21868f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:36 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0da33325-2caf-40f3-8409-12a7db64befd tempest-VolumesMetadataTest-960625014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (099bb3ff-e460-4451-966e-2f1c21868f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-18272708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75d3099d-d378-45b5-862d-e4d37529872c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21d5477714fd480ab78a602d0b01cb31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:27:37Z,use_quota=True,user_id='7be6b5489b524909bcce4e4f615977ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:36 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0da33325-2caf-40f3-8409-12a7db64befd tempest-VolumesMetadataTest-960625014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8152d6a0-0e76-4939-8cb3-2f61b225df47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:36 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0da33325-2caf-40f3-8409-12a7db64befd tempest-VolumesMetadataTest-960625014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8152d6a0-0e76-4939-8cb3-2f61b225df47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:36 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0da33325-2caf-40f3-8409-12a7db64befd tempest-VolumesMetadataTest-960625014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcfd1e0b-fc22-4e5f-b9a7-fa4e0efc0436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:36 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0da33325-2caf-40f3-8409-12a7db64befd tempest-VolumesMetadataTest-960625014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcfd1e0b-fc22-4e5f-b9a7-fa4e0efc0436) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75d3099d-d378-45b5-862d-e4d37529872c', 'volume_name': 'volume-75d3099d-d378-45b5-862d-e4d37529872c', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:36 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0da33325-2caf-40f3-8409-12a7db64befd tempest-VolumesMetadataTest-960625014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a2bb7b-6954-49cd-8fca-367b92ba42e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:36 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0da33325-2caf-40f3-8409-12a7db64befd tempest-VolumesMetadataTest-960625014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a2bb7b-6954-49cd-8fca-367b92ba42e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:36 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0da33325-2caf-40f3-8409-12a7db64befd tempest-VolumesMetadataTest-960625014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adc94a01-2881-4d02-a2fb-d9b62d3be09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:36 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-0da33325-2caf-40f3-8409-12a7db64befd tempest-VolumesMetadataTest-960625014 None] Volume 75d3099d-d378-45b5-862d-e4d37529872c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75d3099d-d378-45b5-862d-e4d37529872c', 'volume_size': 1} Jul 16 23:27:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0da33325-2caf-40f3-8409-12a7db64befd tempest-VolumesMetadataTest-960625014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0da33325-2caf-40f3-8409-12a7db64befd tempest-VolumesMetadataTest-960625014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:37 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0da33325-2caf-40f3-8409-12a7db64befd tempest-VolumesMetadataTest-960625014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-18272708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75d3099d-d378-45b5-862d-e4d37529872c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21d5477714fd480ab78a602d0b01cb31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:27:37Z,use_quota=True,user_id='7be6b5489b524909bcce4e4f615977ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:27:37 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-0da33325-2caf-40f3-8409-12a7db64befd tempest-VolumesMetadataTest-960625014 None] Creating volume 75d3099d-d378-45b5-862d-e4d37529872c {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:27:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0da33325-2caf-40f3-8409-12a7db64befd tempest-VolumesMetadataTest-960625014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0da33325-2caf-40f3-8409-12a7db64befd tempest-VolumesMetadataTest-960625014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:37 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0da33325-2caf-40f3-8409-12a7db64befd tempest-VolumesMetadataTest-960625014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:27:37 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0da33325-2caf-40f3-8409-12a7db64befd tempest-VolumesMetadataTest-960625014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:27:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0da33325-2caf-40f3-8409-12a7db64befd tempest-VolumesMetadataTest-960625014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:37 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0da33325-2caf-40f3-8409-12a7db64befd tempest-VolumesMetadataTest-960625014 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:27:37 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-0da33325-2caf-40f3-8409-12a7db64befd tempest-VolumesMetadataTest-960625014 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:27:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0da33325-2caf-40f3-8409-12a7db64befd tempest-VolumesMetadataTest-960625014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-75d3099d-d378-45b5-862d-e4d37529872c 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:37 devstack sudo[100154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-75d3099d-d378-45b5-862d-e4d37529872c 1073741824 Jul 16 23:27:37 devstack sudo[100154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:37 devstack sudo[100154]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0da33325-2caf-40f3-8409-12a7db64befd tempest-VolumesMetadataTest-960625014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-75d3099d-d378-45b5-862d-e4d37529872c 1073741824" returned: 0 in 0.496s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0da33325-2caf-40f3-8409-12a7db64befd tempest-VolumesMetadataTest-960625014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-75d3099d-d378-45b5-862d-e4d37529872c {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:37 devstack sudo[100160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-75d3099d-d378-45b5-862d-e4d37529872c Jul 16 23:27:37 devstack sudo[100160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:37 devstack sudo[100160]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0da33325-2caf-40f3-8409-12a7db64befd tempest-VolumesMetadataTest-960625014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-75d3099d-d378-45b5-862d-e4d37529872c" returned: 0 in 0.317s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:37 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0da33325-2caf-40f3-8409-12a7db64befd tempest-VolumesMetadataTest-960625014 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:27:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0da33325-2caf-40f3-8409-12a7db64befd tempest-VolumesMetadataTest-960625014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:37 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0da33325-2caf-40f3-8409-12a7db64befd tempest-VolumesMetadataTest-960625014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adc94a01-2881-4d02-a2fb-d9b62d3be09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75d3099d-d378-45b5-862d-e4d37529872c', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:37 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0da33325-2caf-40f3-8409-12a7db64befd tempest-VolumesMetadataTest-960625014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6f4882b-3a85-4033-97e8-9d3956978962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:37 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-0da33325-2caf-40f3-8409-12a7db64befd tempest-VolumesMetadataTest-960625014 None] Volume volume-75d3099d-d378-45b5-862d-e4d37529872c (75d3099d-d378-45b5-862d-e4d37529872c): created successfully Jul 16 23:27:37 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0da33325-2caf-40f3-8409-12a7db64befd tempest-VolumesMetadataTest-960625014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6f4882b-3a85-4033-97e8-9d3956978962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:37 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0da33325-2caf-40f3-8409-12a7db64befd tempest-VolumesMetadataTest-960625014 None] Flow 'volume_create_manager' (e669e7b1-71fb-4f4b-9788-273ded6c3edf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:27:37 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-0da33325-2caf-40f3-8409-12a7db64befd tempest-VolumesMetadataTest-960625014 None] Created volume successfully. Jul 16 23:27:39 devstack cinder-volume[87607]: DEBUG oslo_service.periodic_task [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:27:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:27:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:27:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:39 devstack sudo[100164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:27:39 devstack sudo[100164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:39 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-eba90eac-6d28-48d4-b9b2-d2412928ae1e tempest-VolumesMetadataTest-960625014 None] Acquiring lock "cinder-75d3099d-d378-45b5-862d-e4d37529872c-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:27:39 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-eba90eac-6d28-48d4-b9b2-d2412928ae1e tempest-VolumesMetadataTest-960625014 None] Lock "cinder-75d3099d-d378-45b5-862d-e4d37529872c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:27:39 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-eba90eac-6d28-48d4-b9b2-d2412928ae1e tempest-VolumesMetadataTest-960625014 None] Acquiring lock "cinder-quobyte-75d3099d-d378-45b5-862d-e4d37529872c" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:27:39 devstack sudo[100164]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.442s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:39 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:27:39 devstack cinder-volume[87607]: DEBUG oslo_service.periodic_task [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running periodic task VolumeManager._thread_info {{(pid=87607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:27:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] thread count: 28 {{(pid=87607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 23:27:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] thread info: [<_MainThread(MainThread, started 139090403627136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 23:27:39 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-eba90eac-6d28-48d4-b9b2-d2412928ae1e tempest-VolumesMetadataTest-960625014 None] Lock "cinder-quobyte-75d3099d-d378-45b5-862d-e4d37529872c" acquired by "delete_volume" :: waited 0.024s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:27:39 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25960fd-7e4f-478a-acb7-05118ca38f57]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:27:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-eba90eac-6d28-48d4-b9b2-d2412928ae1e tempest-VolumesMetadataTest-960625014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-75d3099d-d378-45b5-862d-e4d37529872c {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:40 devstack sudo[100178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-75d3099d-d378-45b5-862d-e4d37529872c Jul 16 23:27:40 devstack sudo[100178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:40 devstack sudo[100178]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-eba90eac-6d28-48d4-b9b2-d2412928ae1e tempest-VolumesMetadataTest-960625014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-75d3099d-d378-45b5-862d-e4d37529872c" returned: 0 in 0.414s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-eba90eac-6d28-48d4-b9b2-d2412928ae1e tempest-VolumesMetadataTest-960625014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-75d3099d-d378-45b5-862d-e4d37529872c {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:40 devstack sudo[100197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-75d3099d-d378-45b5-862d-e4d37529872c Jul 16 23:27:40 devstack sudo[100197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:40 devstack sudo[100197]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-eba90eac-6d28-48d4-b9b2-d2412928ae1e tempest-VolumesMetadataTest-960625014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-75d3099d-d378-45b5-862d-e4d37529872c" returned: 0 in 0.262s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:40 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-eba90eac-6d28-48d4-b9b2-d2412928ae1e tempest-VolumesMetadataTest-960625014 None] Lock "cinder-quobyte-75d3099d-d378-45b5-862d-e4d37529872c" released by "delete_volume" :: held 0.739s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:27:40 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-eba90eac-6d28-48d4-b9b2-d2412928ae1e tempest-VolumesMetadataTest-960625014 None] Created reservations ['01e035b4-e802-4560-a0f6-46dd2dd2eab6', '6c7e3783-4bb6-41d1-adbd-a8fd3c147a10', '398b1d16-9f5f-409f-b101-7c5a1fc65278', '7752982e-c24b-4591-aa71-da73f3c4a897'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:27:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-eba90eac-6d28-48d4-b9b2-d2412928ae1e tempest-VolumesMetadataTest-960625014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-eba90eac-6d28-48d4-b9b2-d2412928ae1e tempest-VolumesMetadataTest-960625014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:40 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-eba90eac-6d28-48d4-b9b2-d2412928ae1e tempest-VolumesMetadataTest-960625014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:27:40 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-eba90eac-6d28-48d4-b9b2-d2412928ae1e tempest-VolumesMetadataTest-960625014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:27:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-eba90eac-6d28-48d4-b9b2-d2412928ae1e tempest-VolumesMetadataTest-960625014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-eba90eac-6d28-48d4-b9b2-d2412928ae1e tempest-VolumesMetadataTest-960625014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:40 devstack sudo[100200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:27:40 devstack sudo[100200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:41 devstack sudo[100200]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-eba90eac-6d28-48d4-b9b2-d2412928ae1e tempest-VolumesMetadataTest-960625014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.252s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:41 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-eba90eac-6d28-48d4-b9b2-d2412928ae1e tempest-VolumesMetadataTest-960625014 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:27:41 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-eba90eac-6d28-48d4-b9b2-d2412928ae1e tempest-VolumesMetadataTest-960625014 None] Deleted volume successfully. Jul 16 23:27:41 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-eba90eac-6d28-48d4-b9b2-d2412928ae1e tempest-VolumesMetadataTest-960625014 None] Lock "cinder-75d3099d-d378-45b5-862d-e4d37529872c-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:27:41 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e851261-2d3e-4536-b687-5d65412802b0 tempest-CreateVolumesFromImageTest-1047476549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:27:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5e851261-2d3e-4536-b687-5d65412802b0 tempest-CreateVolumesFromImageTest-1047476549 None] Flow 'volume_create_manager' (087e6647-b22f-4931-9899-389b0da38830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:27:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5e851261-2d3e-4536-b687-5d65412802b0 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2e9304a-7469-4a84-ba0b-653672e58101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5e851261-2d3e-4536-b687-5d65412802b0 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2e9304a-7469-4a84-ba0b-653672e58101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-926629760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6651d60d-3b40-467c-91e3-fafa900af409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2688284f18b42fab2c0c5146b63c078',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:27:41Z,use_quota=True,user_id='789ef91e805540abb7594e09d52f12f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5e851261-2d3e-4536-b687-5d65412802b0 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d75b55f-dcce-40d2-b954-0a193377f78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5e851261-2d3e-4536-b687-5d65412802b0 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d75b55f-dcce-40d2-b954-0a193377f78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5e851261-2d3e-4536-b687-5d65412802b0 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a2d58b1-db10-4cbe-befe-3221487e379f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5e851261-2d3e-4536-b687-5d65412802b0 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a2d58b1-db10-4cbe-befe-3221487e379f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6651d60d-3b40-467c-91e3-fafa900af409', 'volume_name': 'volume-6651d60d-3b40-467c-91e3-fafa900af409', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5e851261-2d3e-4536-b687-5d65412802b0 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6639844e-fbd6-43ee-b1b5-df2ab3df75b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5e851261-2d3e-4536-b687-5d65412802b0 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6639844e-fbd6-43ee-b1b5-df2ab3df75b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5e851261-2d3e-4536-b687-5d65412802b0 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e327c9dc-01bf-4b11-b2fd-294d9b0753f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:41 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-5e851261-2d3e-4536-b687-5d65412802b0 tempest-CreateVolumesFromImageTest-1047476549 None] Volume 6651d60d-3b40-467c-91e3-fafa900af409: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6651d60d-3b40-467c-91e3-fafa900af409', 'volume_size': 1} Jul 16 23:27:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5e851261-2d3e-4536-b687-5d65412802b0 tempest-CreateVolumesFromImageTest-1047476549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5e851261-2d3e-4536-b687-5d65412802b0 tempest-CreateVolumesFromImageTest-1047476549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:41 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-5e851261-2d3e-4536-b687-5d65412802b0 tempest-CreateVolumesFromImageTest-1047476549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-926629760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6651d60d-3b40-467c-91e3-fafa900af409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2688284f18b42fab2c0c5146b63c078',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:27:41Z,use_quota=True,user_id='789ef91e805540abb7594e09d52f12f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:27:41 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-5e851261-2d3e-4536-b687-5d65412802b0 tempest-CreateVolumesFromImageTest-1047476549 None] Creating volume 6651d60d-3b40-467c-91e3-fafa900af409 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:27:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5e851261-2d3e-4536-b687-5d65412802b0 tempest-CreateVolumesFromImageTest-1047476549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5e851261-2d3e-4536-b687-5d65412802b0 tempest-CreateVolumesFromImageTest-1047476549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:41 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-5e851261-2d3e-4536-b687-5d65412802b0 tempest-CreateVolumesFromImageTest-1047476549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:27:41 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-5e851261-2d3e-4536-b687-5d65412802b0 tempest-CreateVolumesFromImageTest-1047476549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:27:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5e851261-2d3e-4536-b687-5d65412802b0 tempest-CreateVolumesFromImageTest-1047476549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:41 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-5e851261-2d3e-4536-b687-5d65412802b0 tempest-CreateVolumesFromImageTest-1047476549 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:27:41 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-5e851261-2d3e-4536-b687-5d65412802b0 tempest-CreateVolumesFromImageTest-1047476549 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:27:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5e851261-2d3e-4536-b687-5d65412802b0 tempest-CreateVolumesFromImageTest-1047476549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6651d60d-3b40-467c-91e3-fafa900af409 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:41 devstack sudo[100203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6651d60d-3b40-467c-91e3-fafa900af409 1073741824 Jul 16 23:27:41 devstack sudo[100203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:41 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-04551442-ab60-4a27-a814-aae0759e53d4 tempest-CreateVolumesFromImageTest-1047476549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:27:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-04551442-ab60-4a27-a814-aae0759e53d4 tempest-CreateVolumesFromImageTest-1047476549 None] Flow 'volume_create_manager' (7fd77464-3a3c-40e8-80c3-695e7a78bd59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:27:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-04551442-ab60-4a27-a814-aae0759e53d4 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b33f5027-1a2f-44b1-802b-eae2d0664b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-04551442-ab60-4a27-a814-aae0759e53d4 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b33f5027-1a2f-44b1-802b-eae2d0664b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2039468799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a16cd64-3843-4726-a773-115c2b7fcbb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2688284f18b42fab2c0c5146b63c078',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:27:42Z,use_quota=True,user_id='789ef91e805540abb7594e09d52f12f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-04551442-ab60-4a27-a814-aae0759e53d4 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10aacf4b-608b-4398-807e-c251dd400f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-04551442-ab60-4a27-a814-aae0759e53d4 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10aacf4b-608b-4398-807e-c251dd400f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-04551442-ab60-4a27-a814-aae0759e53d4 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df976b65-56df-4404-9c5a-16ffdafab01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-04551442-ab60-4a27-a814-aae0759e53d4 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df976b65-56df-4404-9c5a-16ffdafab01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a16cd64-3843-4726-a773-115c2b7fcbb3', 'volume_name': 'volume-4a16cd64-3843-4726-a773-115c2b7fcbb3', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-04551442-ab60-4a27-a814-aae0759e53d4 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6c6362a-41a3-4001-bfa0-3413d7223313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-04551442-ab60-4a27-a814-aae0759e53d4 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6c6362a-41a3-4001-bfa0-3413d7223313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-04551442-ab60-4a27-a814-aae0759e53d4 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d7c68c3-32a6-4204-8fa7-a3bc654d871f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:41 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-04551442-ab60-4a27-a814-aae0759e53d4 tempest-CreateVolumesFromImageTest-1047476549 None] Volume 4a16cd64-3843-4726-a773-115c2b7fcbb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a16cd64-3843-4726-a773-115c2b7fcbb3', 'volume_size': 1} Jul 16 23:27:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-04551442-ab60-4a27-a814-aae0759e53d4 tempest-CreateVolumesFromImageTest-1047476549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:42 devstack sudo[100203]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5e851261-2d3e-4536-b687-5d65412802b0 tempest-CreateVolumesFromImageTest-1047476549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6651d60d-3b40-467c-91e3-fafa900af409 1073741824" returned: 0 in 0.654s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5e851261-2d3e-4536-b687-5d65412802b0 tempest-CreateVolumesFromImageTest-1047476549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6651d60d-3b40-467c-91e3-fafa900af409 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:42 devstack sudo[100211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6651d60d-3b40-467c-91e3-fafa900af409 Jul 16 23:27:42 devstack sudo[100211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:42 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac184057-f0fa-4a94-92f9-aa394c22c509 tempest-CreateVolumesFromImageTest-1047476549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:27:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ac184057-f0fa-4a94-92f9-aa394c22c509 tempest-CreateVolumesFromImageTest-1047476549 None] Flow 'volume_create_manager' (3feda757-b0ee-4dfc-b645-e0c6b3b57d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:27:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ac184057-f0fa-4a94-92f9-aa394c22c509 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (586f05ac-88f2-4b1e-bb42-ec2790c7754f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ac184057-f0fa-4a94-92f9-aa394c22c509 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (586f05ac-88f2-4b1e-bb42-ec2790c7754f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1331486464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38b60364-03fa-4f4a-8e30-749ce66be1a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2688284f18b42fab2c0c5146b63c078',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:27:42Z,use_quota=True,user_id='789ef91e805540abb7594e09d52f12f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ac184057-f0fa-4a94-92f9-aa394c22c509 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb719d56-2200-47f9-881b-5a844f507b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ac184057-f0fa-4a94-92f9-aa394c22c509 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb719d56-2200-47f9-881b-5a844f507b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ac184057-f0fa-4a94-92f9-aa394c22c509 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04fbefd1-8b48-4156-a03e-fc441f1219d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ac184057-f0fa-4a94-92f9-aa394c22c509 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04fbefd1-8b48-4156-a03e-fc441f1219d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38b60364-03fa-4f4a-8e30-749ce66be1a1', 'volume_name': 'volume-38b60364-03fa-4f4a-8e30-749ce66be1a1', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ac184057-f0fa-4a94-92f9-aa394c22c509 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83b7bc85-66f9-4d6f-8c71-315298a3447a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ac184057-f0fa-4a94-92f9-aa394c22c509 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83b7bc85-66f9-4d6f-8c71-315298a3447a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ac184057-f0fa-4a94-92f9-aa394c22c509 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e678726e-3672-4f93-8edf-1dea4080d847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:42 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-ac184057-f0fa-4a94-92f9-aa394c22c509 tempest-CreateVolumesFromImageTest-1047476549 None] Volume 38b60364-03fa-4f4a-8e30-749ce66be1a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38b60364-03fa-4f4a-8e30-749ce66be1a1', 'volume_size': 1} Jul 16 23:27:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ac184057-f0fa-4a94-92f9-aa394c22c509 tempest-CreateVolumesFromImageTest-1047476549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:42 devstack sudo[100211]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5e851261-2d3e-4536-b687-5d65412802b0 tempest-CreateVolumesFromImageTest-1047476549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6651d60d-3b40-467c-91e3-fafa900af409" returned: 0 in 0.406s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:42 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-5e851261-2d3e-4536-b687-5d65412802b0 tempest-CreateVolumesFromImageTest-1047476549 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:27:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5e851261-2d3e-4536-b687-5d65412802b0 tempest-CreateVolumesFromImageTest-1047476549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-04551442-ab60-4a27-a814-aae0759e53d4 tempest-CreateVolumesFromImageTest-1047476549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.697s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:42 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-04551442-ab60-4a27-a814-aae0759e53d4 tempest-CreateVolumesFromImageTest-1047476549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2039468799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a16cd64-3843-4726-a773-115c2b7fcbb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2688284f18b42fab2c0c5146b63c078',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:27:42Z,use_quota=True,user_id='789ef91e805540abb7594e09d52f12f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:27:42 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-04551442-ab60-4a27-a814-aae0759e53d4 tempest-CreateVolumesFromImageTest-1047476549 None] Creating volume 4a16cd64-3843-4726-a773-115c2b7fcbb3 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:27:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-04551442-ab60-4a27-a814-aae0759e53d4 tempest-CreateVolumesFromImageTest-1047476549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-04551442-ab60-4a27-a814-aae0759e53d4 tempest-CreateVolumesFromImageTest-1047476549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:42 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-04551442-ab60-4a27-a814-aae0759e53d4 tempest-CreateVolumesFromImageTest-1047476549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:27:42 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-04551442-ab60-4a27-a814-aae0759e53d4 tempest-CreateVolumesFromImageTest-1047476549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:27:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-04551442-ab60-4a27-a814-aae0759e53d4 tempest-CreateVolumesFromImageTest-1047476549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:42 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-04551442-ab60-4a27-a814-aae0759e53d4 tempest-CreateVolumesFromImageTest-1047476549 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:27:42 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-04551442-ab60-4a27-a814-aae0759e53d4 tempest-CreateVolumesFromImageTest-1047476549 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:27:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-04551442-ab60-4a27-a814-aae0759e53d4 tempest-CreateVolumesFromImageTest-1047476549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4a16cd64-3843-4726-a773-115c2b7fcbb3 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5e851261-2d3e-4536-b687-5d65412802b0 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e327c9dc-01bf-4b11-b2fd-294d9b0753f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6651d60d-3b40-467c-91e3-fafa900af409', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:42 devstack sudo[100214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4a16cd64-3843-4726-a773-115c2b7fcbb3 1073741824 Jul 16 23:27:42 devstack sudo[100214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5e851261-2d3e-4536-b687-5d65412802b0 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eb3ec3d-3fdb-49b2-a9b4-7cce02cd5ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:42 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-5e851261-2d3e-4536-b687-5d65412802b0 tempest-CreateVolumesFromImageTest-1047476549 None] Volume volume-6651d60d-3b40-467c-91e3-fafa900af409 (6651d60d-3b40-467c-91e3-fafa900af409): created successfully Jul 16 23:27:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5e851261-2d3e-4536-b687-5d65412802b0 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eb3ec3d-3fdb-49b2-a9b4-7cce02cd5ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5e851261-2d3e-4536-b687-5d65412802b0 tempest-CreateVolumesFromImageTest-1047476549 None] Flow 'volume_create_manager' (087e6647-b22f-4931-9899-389b0da38830) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:27:42 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-5e851261-2d3e-4536-b687-5d65412802b0 tempest-CreateVolumesFromImageTest-1047476549 None] Created volume successfully. Jul 16 23:27:42 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-a204864e-e60e-42a7-b407-364db7e6c93b tempest-CreateVolumesFromImageTest-1047476549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:27:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a204864e-e60e-42a7-b407-364db7e6c93b tempest-CreateVolumesFromImageTest-1047476549 None] Flow 'volume_create_manager' (3a3e39fd-43fe-4d89-ad70-5656f93e5879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:27:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a204864e-e60e-42a7-b407-364db7e6c93b tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (906a50e1-c05f-4da7-b9dd-5f96709c3f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a204864e-e60e-42a7-b407-364db7e6c93b tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (906a50e1-c05f-4da7-b9dd-5f96709c3f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-875417280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ecf736b-8987-487a-9d5e-33f79d0f07df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2688284f18b42fab2c0c5146b63c078',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:27:43Z,use_quota=True,user_id='789ef91e805540abb7594e09d52f12f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a204864e-e60e-42a7-b407-364db7e6c93b tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (751692b1-51bb-467b-a557-77c9b6fd50ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a204864e-e60e-42a7-b407-364db7e6c93b tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (751692b1-51bb-467b-a557-77c9b6fd50ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a204864e-e60e-42a7-b407-364db7e6c93b tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cdc1149-6216-4161-88a7-060089dd258c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a204864e-e60e-42a7-b407-364db7e6c93b tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cdc1149-6216-4161-88a7-060089dd258c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ecf736b-8987-487a-9d5e-33f79d0f07df', 'volume_name': 'volume-5ecf736b-8987-487a-9d5e-33f79d0f07df', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a204864e-e60e-42a7-b407-364db7e6c93b tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e02a75af-8e93-42ac-b4fa-0296ab0d15c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a204864e-e60e-42a7-b407-364db7e6c93b tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e02a75af-8e93-42ac-b4fa-0296ab0d15c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a204864e-e60e-42a7-b407-364db7e6c93b tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9271f88-cdb1-4398-aa3c-27dc42948fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:43 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-a204864e-e60e-42a7-b407-364db7e6c93b tempest-CreateVolumesFromImageTest-1047476549 None] Volume 5ecf736b-8987-487a-9d5e-33f79d0f07df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ecf736b-8987-487a-9d5e-33f79d0f07df', 'volume_size': 1} Jul 16 23:27:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a204864e-e60e-42a7-b407-364db7e6c93b tempest-CreateVolumesFromImageTest-1047476549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:43 devstack sudo[100214]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-04551442-ab60-4a27-a814-aae0759e53d4 tempest-CreateVolumesFromImageTest-1047476549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4a16cd64-3843-4726-a773-115c2b7fcbb3 1073741824" returned: 0 in 0.736s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:43 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-de4d6f4d-e729-4fb4-b397-b1845ec72219 tempest-CreateVolumesFromImageTest-1047476549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:27:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-de4d6f4d-e729-4fb4-b397-b1845ec72219 tempest-CreateVolumesFromImageTest-1047476549 None] Flow 'volume_create_manager' (f6b8fd82-43b1-45c1-b9a9-de16e7f6eca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:27:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-de4d6f4d-e729-4fb4-b397-b1845ec72219 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b5c1e4-8053-41c6-bd09-929bc37551ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-de4d6f4d-e729-4fb4-b397-b1845ec72219 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b5c1e4-8053-41c6-bd09-929bc37551ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-831199877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e5fffd8-9a3a-42b7-87ba-1f43d6f31837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2688284f18b42fab2c0c5146b63c078',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:27:43Z,use_quota=True,user_id='789ef91e805540abb7594e09d52f12f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-de4d6f4d-e729-4fb4-b397-b1845ec72219 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71cdef8e-2a99-42e0-bc88-fc3848c823ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-de4d6f4d-e729-4fb4-b397-b1845ec72219 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71cdef8e-2a99-42e0-bc88-fc3848c823ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-de4d6f4d-e729-4fb4-b397-b1845ec72219 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fbe626c-1c5a-46e2-8c8b-a965e3ad3358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-de4d6f4d-e729-4fb4-b397-b1845ec72219 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fbe626c-1c5a-46e2-8c8b-a965e3ad3358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e5fffd8-9a3a-42b7-87ba-1f43d6f31837', 'volume_name': 'volume-1e5fffd8-9a3a-42b7-87ba-1f43d6f31837', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-de4d6f4d-e729-4fb4-b397-b1845ec72219 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (425d2d26-350b-491b-8af6-d21a8b861b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-de4d6f4d-e729-4fb4-b397-b1845ec72219 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (425d2d26-350b-491b-8af6-d21a8b861b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-de4d6f4d-e729-4fb4-b397-b1845ec72219 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a378687-16a4-4cd4-9c1f-764ea611ca97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:43 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-de4d6f4d-e729-4fb4-b397-b1845ec72219 tempest-CreateVolumesFromImageTest-1047476549 None] Volume 1e5fffd8-9a3a-42b7-87ba-1f43d6f31837: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e5fffd8-9a3a-42b7-87ba-1f43d6f31837', 'volume_size': 1} Jul 16 23:27:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-de4d6f4d-e729-4fb4-b397-b1845ec72219 tempest-CreateVolumesFromImageTest-1047476549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-04551442-ab60-4a27-a814-aae0759e53d4 tempest-CreateVolumesFromImageTest-1047476549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4a16cd64-3843-4726-a773-115c2b7fcbb3 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:43 devstack sudo[100223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4a16cd64-3843-4726-a773-115c2b7fcbb3 Jul 16 23:27:43 devstack sudo[100223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:43 devstack sudo[100223]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-04551442-ab60-4a27-a814-aae0759e53d4 tempest-CreateVolumesFromImageTest-1047476549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4a16cd64-3843-4726-a773-115c2b7fcbb3" returned: 0 in 0.305s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-04551442-ab60-4a27-a814-aae0759e53d4 tempest-CreateVolumesFromImageTest-1047476549 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:27:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-04551442-ab60-4a27-a814-aae0759e53d4 tempest-CreateVolumesFromImageTest-1047476549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ac184057-f0fa-4a94-92f9-aa394c22c509 tempest-CreateVolumesFromImageTest-1047476549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.465s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ac184057-f0fa-4a94-92f9-aa394c22c509 tempest-CreateVolumesFromImageTest-1047476549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1331486464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38b60364-03fa-4f4a-8e30-749ce66be1a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2688284f18b42fab2c0c5146b63c078',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:27:42Z,use_quota=True,user_id='789ef91e805540abb7594e09d52f12f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:27:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-ac184057-f0fa-4a94-92f9-aa394c22c509 tempest-CreateVolumesFromImageTest-1047476549 None] Creating volume 38b60364-03fa-4f4a-8e30-749ce66be1a1 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:27:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ac184057-f0fa-4a94-92f9-aa394c22c509 tempest-CreateVolumesFromImageTest-1047476549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ac184057-f0fa-4a94-92f9-aa394c22c509 tempest-CreateVolumesFromImageTest-1047476549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ac184057-f0fa-4a94-92f9-aa394c22c509 tempest-CreateVolumesFromImageTest-1047476549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:27:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ac184057-f0fa-4a94-92f9-aa394c22c509 tempest-CreateVolumesFromImageTest-1047476549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:27:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ac184057-f0fa-4a94-92f9-aa394c22c509 tempest-CreateVolumesFromImageTest-1047476549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ac184057-f0fa-4a94-92f9-aa394c22c509 tempest-CreateVolumesFromImageTest-1047476549 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:27:43 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-ac184057-f0fa-4a94-92f9-aa394c22c509 tempest-CreateVolumesFromImageTest-1047476549 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:27:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ac184057-f0fa-4a94-92f9-aa394c22c509 tempest-CreateVolumesFromImageTest-1047476549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-38b60364-03fa-4f4a-8e30-749ce66be1a1 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:43 devstack sudo[100227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-38b60364-03fa-4f4a-8e30-749ce66be1a1 1073741824 Jul 16 23:27:43 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-04551442-ab60-4a27-a814-aae0759e53d4 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d7c68c3-32a6-4204-8fa7-a3bc654d871f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a16cd64-3843-4726-a773-115c2b7fcbb3', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-04551442-ab60-4a27-a814-aae0759e53d4 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aef4fd6c-187d-4570-aac1-1a99d0f11774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:43 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-04551442-ab60-4a27-a814-aae0759e53d4 tempest-CreateVolumesFromImageTest-1047476549 None] Volume volume-4a16cd64-3843-4726-a773-115c2b7fcbb3 (4a16cd64-3843-4726-a773-115c2b7fcbb3): created successfully Jul 16 23:27:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-04551442-ab60-4a27-a814-aae0759e53d4 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aef4fd6c-187d-4570-aac1-1a99d0f11774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-04551442-ab60-4a27-a814-aae0759e53d4 tempest-CreateVolumesFromImageTest-1047476549 None] Flow 'volume_create_manager' (7fd77464-3a3c-40e8-80c3-695e7a78bd59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:27:43 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-04551442-ab60-4a27-a814-aae0759e53d4 tempest-CreateVolumesFromImageTest-1047476549 None] Created volume successfully. Jul 16 23:27:44 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ac184057-f0fa-4a94-92f9-aa394c22c509 tempest-CreateVolumesFromImageTest-1047476549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-38b60364-03fa-4f4a-8e30-749ce66be1a1 1073741824" returned: 0 in 0.500s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-a8db529e-66a5-4215-88f5-f596c9cd6f08 req-93d16e17-37de-4137-ab0c-eeb07050c107 tempest-TestServerVolumeAttachmentScenario-804454518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ac184057-f0fa-4a94-92f9-aa394c22c509 tempest-CreateVolumesFromImageTest-1047476549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-38b60364-03fa-4f4a-8e30-749ce66be1a1 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:44 devstack sudo[100241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-38b60364-03fa-4f4a-8e30-749ce66be1a1 Jul 16 23:27:44 devstack sudo[100241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:44 devstack sudo[100241]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ac184057-f0fa-4a94-92f9-aa394c22c509 tempest-CreateVolumesFromImageTest-1047476549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-38b60364-03fa-4f4a-8e30-749ce66be1a1" returned: 0 in 0.259s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:44 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ac184057-f0fa-4a94-92f9-aa394c22c509 tempest-CreateVolumesFromImageTest-1047476549 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:27:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ac184057-f0fa-4a94-92f9-aa394c22c509 tempest-CreateVolumesFromImageTest-1047476549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a204864e-e60e-42a7-b407-364db7e6c93b tempest-CreateVolumesFromImageTest-1047476549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.600s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:44 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a204864e-e60e-42a7-b407-364db7e6c93b tempest-CreateVolumesFromImageTest-1047476549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-875417280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ecf736b-8987-487a-9d5e-33f79d0f07df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2688284f18b42fab2c0c5146b63c078',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:27:43Z,use_quota=True,user_id='789ef91e805540abb7594e09d52f12f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:27:44 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-a204864e-e60e-42a7-b407-364db7e6c93b tempest-CreateVolumesFromImageTest-1047476549 None] Creating volume 5ecf736b-8987-487a-9d5e-33f79d0f07df {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:27:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a204864e-e60e-42a7-b407-364db7e6c93b tempest-CreateVolumesFromImageTest-1047476549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a204864e-e60e-42a7-b407-364db7e6c93b tempest-CreateVolumesFromImageTest-1047476549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:44 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a204864e-e60e-42a7-b407-364db7e6c93b tempest-CreateVolumesFromImageTest-1047476549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:27:44 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a204864e-e60e-42a7-b407-364db7e6c93b tempest-CreateVolumesFromImageTest-1047476549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:27:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a204864e-e60e-42a7-b407-364db7e6c93b tempest-CreateVolumesFromImageTest-1047476549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:44 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a204864e-e60e-42a7-b407-364db7e6c93b tempest-CreateVolumesFromImageTest-1047476549 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:27:44 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-a204864e-e60e-42a7-b407-364db7e6c93b tempest-CreateVolumesFromImageTest-1047476549 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:27:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a204864e-e60e-42a7-b407-364db7e6c93b tempest-CreateVolumesFromImageTest-1047476549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5ecf736b-8987-487a-9d5e-33f79d0f07df 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:44 devstack sudo[100244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5ecf736b-8987-487a-9d5e-33f79d0f07df 1073741824 Jul 16 23:27:44 devstack sudo[100244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ac184057-f0fa-4a94-92f9-aa394c22c509 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e678726e-3672-4f93-8edf-1dea4080d847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38b60364-03fa-4f4a-8e30-749ce66be1a1', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ac184057-f0fa-4a94-92f9-aa394c22c509 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fcdb643-ce13-4add-b9a4-363afa1600f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:44 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-ac184057-f0fa-4a94-92f9-aa394c22c509 tempest-CreateVolumesFromImageTest-1047476549 None] Volume volume-38b60364-03fa-4f4a-8e30-749ce66be1a1 (38b60364-03fa-4f4a-8e30-749ce66be1a1): created successfully Jul 16 23:27:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ac184057-f0fa-4a94-92f9-aa394c22c509 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fcdb643-ce13-4add-b9a4-363afa1600f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ac184057-f0fa-4a94-92f9-aa394c22c509 tempest-CreateVolumesFromImageTest-1047476549 None] Flow 'volume_create_manager' (3feda757-b0ee-4dfc-b645-e0c6b3b57d29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:27:44 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-ac184057-f0fa-4a94-92f9-aa394c22c509 tempest-CreateVolumesFromImageTest-1047476549 None] Created volume successfully. Jul 16 23:27:44 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:27:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Flow 'volume_create_manager' (41626441-9a53-4d76-9fa2-8c5e7e65686e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:27:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d25cc92e-75f0-4fbe-8762-c38beadac7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d25cc92e-75f0-4fbe-8762-c38beadac7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1249450924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6d4782a-e362-4944-994a-2d53e658101a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='229d3cae5d874e8e8361b29fbad375de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:27:45Z,use_quota=True,user_id='9af56d5ec6824772bd26b17da510e366',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74b9eea1-87cd-4599-8ba9-477567db21e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74b9eea1-87cd-4599-8ba9-477567db21e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2da5d256-e4c4-4779-9672-7a68e3bde97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:45 devstack cinder-volume[87607]: DEBUG cinder.image.glance [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Creating Keystone auth plugin from conf {{(pid=87607) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 16 23:27:45 devstack sudo[100244]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a204864e-e60e-42a7-b407-364db7e6c93b tempest-CreateVolumesFromImageTest-1047476549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5ecf736b-8987-487a-9d5e-33f79d0f07df 1073741824" returned: 0 in 0.491s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a204864e-e60e-42a7-b407-364db7e6c93b tempest-CreateVolumesFromImageTest-1047476549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5ecf736b-8987-487a-9d5e-33f79d0f07df {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:45 devstack sudo[100250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5ecf736b-8987-487a-9d5e-33f79d0f07df Jul 16 23:27:45 devstack sudo[100250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2da5d256-e4c4-4779-9672-7a68e3bde97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b6d4782a-e362-4944-994a-2d53e658101a', 'volume_name': 'volume-b6d4782a-e362-4944-994a-2d53e658101a', 'volume_size': 1, 'image_id': '6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3319c84d612344f1b9ca29a92bf5a474', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'created_at': datetime.datetime(2026, 7, 16, 21, 12, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 21, 12, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6519f5ae-0b5b-4a63-9b9b-0adb6304882e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (249dd6b0-afdc-4f87-a535-943a5e29373f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (249dd6b0-afdc-4f87-a535-943a5e29373f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0796e5ae-e8a1-496d-912f-2ae8c245533b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:45 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Volume b6d4782a-e362-4944-994a-2d53e658101a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b6d4782a-e362-4944-994a-2d53e658101a', 'volume_size': 1, 'image_id': '6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3319c84d612344f1b9ca29a92bf5a474', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'created_at': datetime.datetime(2026, 7, 16, 21, 12, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 21, 12, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6519f5ae-0b5b-4a63-9b9b-0adb6304882e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 16 23:27:45 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Trying to clone b6d4782a-e362-4944-994a-2d53e658101a from image 6519f5ae-0b5b-4a63-9b9b-0adb6304882e at location (None, [{'url': 'file:///opt/stack/data/glance/images/6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'metadata': {}}]). {{(pid=87607) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 16 23:27:45 devstack sudo[100250]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a204864e-e60e-42a7-b407-364db7e6c93b tempest-CreateVolumesFromImageTest-1047476549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5ecf736b-8987-487a-9d5e-33f79d0f07df" returned: 0 in 0.254s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:45 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a204864e-e60e-42a7-b407-364db7e6c93b tempest-CreateVolumesFromImageTest-1047476549 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:27:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a204864e-e60e-42a7-b407-364db7e6c93b tempest-CreateVolumesFromImageTest-1047476549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-de4d6f4d-e729-4fb4-b397-b1845ec72219 tempest-CreateVolumesFromImageTest-1047476549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.956s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:45 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-de4d6f4d-e729-4fb4-b397-b1845ec72219 tempest-CreateVolumesFromImageTest-1047476549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-831199877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e5fffd8-9a3a-42b7-87ba-1f43d6f31837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2688284f18b42fab2c0c5146b63c078',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:27:43Z,use_quota=True,user_id='789ef91e805540abb7594e09d52f12f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:27:45 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-de4d6f4d-e729-4fb4-b397-b1845ec72219 tempest-CreateVolumesFromImageTest-1047476549 None] Creating volume 1e5fffd8-9a3a-42b7-87ba-1f43d6f31837 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:27:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-de4d6f4d-e729-4fb4-b397-b1845ec72219 tempest-CreateVolumesFromImageTest-1047476549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-de4d6f4d-e729-4fb4-b397-b1845ec72219 tempest-CreateVolumesFromImageTest-1047476549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:45 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-de4d6f4d-e729-4fb4-b397-b1845ec72219 tempest-CreateVolumesFromImageTest-1047476549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:27:45 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-de4d6f4d-e729-4fb4-b397-b1845ec72219 tempest-CreateVolumesFromImageTest-1047476549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:27:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-de4d6f4d-e729-4fb4-b397-b1845ec72219 tempest-CreateVolumesFromImageTest-1047476549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:45 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-de4d6f4d-e729-4fb4-b397-b1845ec72219 tempest-CreateVolumesFromImageTest-1047476549 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:27:45 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-de4d6f4d-e729-4fb4-b397-b1845ec72219 tempest-CreateVolumesFromImageTest-1047476549 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:27:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-de4d6f4d-e729-4fb4-b397-b1845ec72219 tempest-CreateVolumesFromImageTest-1047476549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1e5fffd8-9a3a-42b7-87ba-1f43d6f31837 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:45 devstack sudo[100253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1e5fffd8-9a3a-42b7-87ba-1f43d6f31837 1073741824 Jul 16 23:27:45 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a204864e-e60e-42a7-b407-364db7e6c93b tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9271f88-cdb1-4398-aa3c-27dc42948fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ecf736b-8987-487a-9d5e-33f79d0f07df', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a204864e-e60e-42a7-b407-364db7e6c93b tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dc4a820-e4a4-487c-a917-da0d29a8176d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:45 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-a204864e-e60e-42a7-b407-364db7e6c93b tempest-CreateVolumesFromImageTest-1047476549 None] Volume volume-5ecf736b-8987-487a-9d5e-33f79d0f07df (5ecf736b-8987-487a-9d5e-33f79d0f07df): created successfully Jul 16 23:27:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a204864e-e60e-42a7-b407-364db7e6c93b tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dc4a820-e4a4-487c-a917-da0d29a8176d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a204864e-e60e-42a7-b407-364db7e6c93b tempest-CreateVolumesFromImageTest-1047476549 None] Flow 'volume_create_manager' (3a3e39fd-43fe-4d89-ad70-5656f93e5879) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:27:45 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-a204864e-e60e-42a7-b407-364db7e6c93b tempest-CreateVolumesFromImageTest-1047476549 None] Created volume successfully. Jul 16 23:27:45 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_j7ucl7grdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87607) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 16 23:27:45 devstack cinder-volume[87607]: INFO cinder.image.image_utils [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Image download 20.69 MB at 20.69 MB/s Jul 16 23:27:45 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2fc3e8-c966-4543-8fac-9d77c6564bd1]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:27:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_j7ucl7grdevstack@QuobyteHD {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:45 devstack sudo[100259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_j7ucl7grdevstack@QuobyteHD Jul 16 23:27:45 devstack sudo[100259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:45 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-de4d6f4d-e729-4fb4-b397-b1845ec72219 tempest-CreateVolumesFromImageTest-1047476549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1e5fffd8-9a3a-42b7-87ba-1f43d6f31837 1073741824" returned: 0 in 0.433s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-de4d6f4d-e729-4fb4-b397-b1845ec72219 tempest-CreateVolumesFromImageTest-1047476549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1e5fffd8-9a3a-42b7-87ba-1f43d6f31837 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:45 devstack sudo[100262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1e5fffd8-9a3a-42b7-87ba-1f43d6f31837 Jul 16 23:27:45 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:46 devstack sudo[100259]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_j7ucl7grdevstack@QuobyteHD" returned: 0 in 0.330s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:46 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Temporary image 6519f5ae-0b5b-4a63-9b9b-0adb6304882e is fetched for user 9af56d5ec6824772bd26b17da510e366. {{(pid=87607) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 16 23:27:46 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a4c2d6-f890-4ece-a2b1-2bb76dfbc79f]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:27:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_j7ucl7grdevstack@QuobyteHD {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:46 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-de4d6f4d-e729-4fb4-b397-b1845ec72219 tempest-CreateVolumesFromImageTest-1047476549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1e5fffd8-9a3a-42b7-87ba-1f43d6f31837" returned: 0 in 0.276s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:46 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-de4d6f4d-e729-4fb4-b397-b1845ec72219 tempest-CreateVolumesFromImageTest-1047476549 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:27:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-de4d6f4d-e729-4fb4-b397-b1845ec72219 tempest-CreateVolumesFromImageTest-1047476549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-a8db529e-66a5-4215-88f5-f596c9cd6f08 req-93d16e17-37de-4137-ab0c-eeb07050c107 tempest-TestServerVolumeAttachmentScenario-804454518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.837s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-de4d6f4d-e729-4fb4-b397-b1845ec72219 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a378687-16a4-4cd4-9c1f-764ea611ca97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e5fffd8-9a3a-42b7-87ba-1f43d6f31837', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-de4d6f4d-e729-4fb4-b397-b1845ec72219 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ee96f31-fd43-441d-a791-ea96ddaf4f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-a8db529e-66a5-4215-88f5-f596c9cd6f08 req-93d16e17-37de-4137-ab0c-eeb07050c107 tempest-TestServerVolumeAttachmentScenario-804454518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:46 devstack sudo[100267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_j7ucl7grdevstack@QuobyteHD Jul 16 23:27:46 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:46 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-de4d6f4d-e729-4fb4-b397-b1845ec72219 tempest-CreateVolumesFromImageTest-1047476549 None] Volume volume-1e5fffd8-9a3a-42b7-87ba-1f43d6f31837 (1e5fffd8-9a3a-42b7-87ba-1f43d6f31837): created successfully Jul 16 23:27:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-de4d6f4d-e729-4fb4-b397-b1845ec72219 tempest-CreateVolumesFromImageTest-1047476549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ee96f31-fd43-441d-a791-ea96ddaf4f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-de4d6f4d-e729-4fb4-b397-b1845ec72219 tempest-CreateVolumesFromImageTest-1047476549 None] Flow 'volume_create_manager' (f6b8fd82-43b1-45c1-b9a9-de16e7f6eca1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:27:46 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-de4d6f4d-e729-4fb4-b397-b1845ec72219 tempest-CreateVolumesFromImageTest-1047476549 None] Created volume successfully. Jul 16 23:27:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-a8db529e-66a5-4215-88f5-f596c9cd6f08 req-93d16e17-37de-4137-ab0c-eeb07050c107 tempest-TestServerVolumeAttachmentScenario-804454518 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72', 'name': 'volume-39c6db99-44f2-4ff9-a41f-f71a70725211', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4227dafb-5a1e-4203-8df5-821084d2f467', 'enforce_multipath': True} {{(pid=87607) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 23:27:46 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-a8db529e-66a5-4215-88f5-f596c9cd6f08 req-93d16e17-37de-4137-ab0c-eeb07050c107 tempest-TestServerVolumeAttachmentScenario-804454518 None] attachment_update completed successfully. Jul 16 23:27:46 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_j7ucl7grdevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:46 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1249450924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6d4782a-e362-4944-994a-2d53e658101a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='229d3cae5d874e8e8361b29fbad375de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:27:45Z,use_quota=True,user_id='9af56d5ec6824772bd26b17da510e366',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:27:46 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Creating volume b6d4782a-e362-4944-994a-2d53e658101a {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:27:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:46 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:27:46 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:27:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:46 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:27:46 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:27:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6d4782a-e362-4944-994a-2d53e658101a 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:46 devstack sudo[100306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6d4782a-e362-4944-994a-2d53e658101a 1073741824 Jul 16 23:27:46 devstack sudo[100306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:46 devstack sudo[100306]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6d4782a-e362-4944-994a-2d53e658101a 1073741824" returned: 0 in 0.478s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6d4782a-e362-4944-994a-2d53e658101a {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:47 devstack sudo[100665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6d4782a-e362-4944-994a-2d53e658101a Jul 16 23:27:47 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:47 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6d4782a-e362-4944-994a-2d53e658101a" returned: 0 in 0.282s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:47 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:27:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:47 devstack cinder-volume[87607]: DEBUG cinder.volume.volume_utils [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Attempting download of 6519f5ae-0b5b-4a63-9b9b-0adb6304882e ((None, [{'url': 'file:///opt/stack/data/glance/images/6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'metadata': {}}])) to volume b6d4782a-e362-4944-994a-2d53e658101a. {{(pid=87607) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 16 23:27:47 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-5357fc08-7612-4ae0-8317-3638d54eba6f tempest-CreateVolumesFromImageTest-1047476549 None] Acquiring lock "cinder-1e5fffd8-9a3a-42b7-87ba-1f43d6f31837-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:27:47 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-5357fc08-7612-4ae0-8317-3638d54eba6f tempest-CreateVolumesFromImageTest-1047476549 None] Lock "cinder-1e5fffd8-9a3a-42b7-87ba-1f43d6f31837-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:27:47 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[544fe39e-baf0-4ab8-840e-8199cab36644]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:27:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6519f5ae-0b5b-4a63-9b9b-0adb6304882e__p4_az35 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:47 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-5357fc08-7612-4ae0-8317-3638d54eba6f tempest-CreateVolumesFromImageTest-1047476549 None] Acquiring lock "cinder-quobyte-1e5fffd8-9a3a-42b7-87ba-1f43d6f31837" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:27:47 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-5357fc08-7612-4ae0-8317-3638d54eba6f tempest-CreateVolumesFromImageTest-1047476549 None] Lock "cinder-quobyte-1e5fffd8-9a3a-42b7-87ba-1f43d6f31837" acquired by "delete_volume" :: waited 0.015s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:27:47 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b163ec1-87ff-44d8-914b-231daee9a536]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:27:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5357fc08-7612-4ae0-8317-3638d54eba6f tempest-CreateVolumesFromImageTest-1047476549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1e5fffd8-9a3a-42b7-87ba-1f43d6f31837 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:47 devstack sudo[100668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6519f5ae-0b5b-4a63-9b9b-0adb6304882e__p4_az35 Jul 16 23:27:47 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:47 devstack sudo[100669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1e5fffd8-9a3a-42b7-87ba-1f43d6f31837 Jul 16 23:27:47 devstack sudo[100669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:47 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6519f5ae-0b5b-4a63-9b9b-0adb6304882e__p4_az35" returned: 0 in 0.339s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6519f5ae-0b5b-4a63-9b9b-0adb6304882e__p4_az35 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:47 devstack sudo[100669]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5357fc08-7612-4ae0-8317-3638d54eba6f tempest-CreateVolumesFromImageTest-1047476549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1e5fffd8-9a3a-42b7-87ba-1f43d6f31837" returned: 0 in 0.379s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5357fc08-7612-4ae0-8317-3638d54eba6f tempest-CreateVolumesFromImageTest-1047476549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1e5fffd8-9a3a-42b7-87ba-1f43d6f31837 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:47 devstack sudo[100674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6519f5ae-0b5b-4a63-9b9b-0adb6304882e__p4_az35 Jul 16 23:27:47 devstack sudo[100674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:47 devstack sudo[100679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1e5fffd8-9a3a-42b7-87ba-1f43d6f31837 Jul 16 23:27:47 devstack sudo[100679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:48 devstack sudo[100674]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6519f5ae-0b5b-4a63-9b9b-0adb6304882e__p4_az35" returned: 1 in 0.330s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6519f5ae-0b5b-4a63-9b9b-0adb6304882e__p4_az35' failed. Not Retrying. {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 23:27:48 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3e7a21-7658-4eb7-8f4c-26d00cd12cd2]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:27:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_j7ucl7grdevstack@QuobyteHD {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:48 devstack sudo[100679]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5357fc08-7612-4ae0-8317-3638d54eba6f tempest-CreateVolumesFromImageTest-1047476549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-1e5fffd8-9a3a-42b7-87ba-1f43d6f31837" returned: 0 in 0.269s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:48 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-5357fc08-7612-4ae0-8317-3638d54eba6f tempest-CreateVolumesFromImageTest-1047476549 None] Lock "cinder-quobyte-1e5fffd8-9a3a-42b7-87ba-1f43d6f31837" released by "delete_volume" :: held 0.705s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:27:48 devstack sudo[100684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_j7ucl7grdevstack@QuobyteHD Jul 16 23:27:48 devstack sudo[100684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:48 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-5357fc08-7612-4ae0-8317-3638d54eba6f tempest-CreateVolumesFromImageTest-1047476549 None] Created reservations ['7c1f3315-7e5a-4f16-8555-ec5627fb85e4', 'e062d55c-c7eb-45bb-b1af-b2efa0e47164', '8b591362-dc0b-4b1c-b8bc-210e558ab941', '41ca05c4-9caf-4e86-a19c-7d9d8fbadad7'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:27:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5357fc08-7612-4ae0-8317-3638d54eba6f tempest-CreateVolumesFromImageTest-1047476549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5357fc08-7612-4ae0-8317-3638d54eba6f tempest-CreateVolumesFromImageTest-1047476549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:48 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-5357fc08-7612-4ae0-8317-3638d54eba6f tempest-CreateVolumesFromImageTest-1047476549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:27:48 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-5357fc08-7612-4ae0-8317-3638d54eba6f tempest-CreateVolumesFromImageTest-1047476549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:27:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5357fc08-7612-4ae0-8317-3638d54eba6f tempest-CreateVolumesFromImageTest-1047476549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5357fc08-7612-4ae0-8317-3638d54eba6f tempest-CreateVolumesFromImageTest-1047476549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:48 devstack sudo[100686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:27:48 devstack sudo[100686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:48 devstack sudo[100684]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_j7ucl7grdevstack@QuobyteHD" returned: 0 in 0.406s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:48 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] 6519f5ae-0b5b-4a63-9b9b-0adb6304882e was qcow2, converting to qcow2 {{(pid=87607) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 16 23:27:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_j7ucl7grdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6d4782a-e362-4944-994a-2d53e658101a {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:48 devstack sudo[100691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_j7ucl7grdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6d4782a-e362-4944-994a-2d53e658101a Jul 16 23:27:48 devstack sudo[100691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:48 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-23afa722-aebb-420f-8c89-07e13047b59c tempest-CreateVolumesFromImageTest-1047476549 None] Acquiring lock "cinder-5ecf736b-8987-487a-9d5e-33f79d0f07df-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:27:48 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-23afa722-aebb-420f-8c89-07e13047b59c tempest-CreateVolumesFromImageTest-1047476549 None] Lock "cinder-5ecf736b-8987-487a-9d5e-33f79d0f07df-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:27:48 devstack sudo[100686]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5357fc08-7612-4ae0-8317-3638d54eba6f tempest-CreateVolumesFromImageTest-1047476549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.330s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:48 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-5357fc08-7612-4ae0-8317-3638d54eba6f tempest-CreateVolumesFromImageTest-1047476549 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:27:48 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-5357fc08-7612-4ae0-8317-3638d54eba6f tempest-CreateVolumesFromImageTest-1047476549 None] Deleted volume successfully. Jul 16 23:27:48 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-23afa722-aebb-420f-8c89-07e13047b59c tempest-CreateVolumesFromImageTest-1047476549 None] Acquiring lock "cinder-quobyte-5ecf736b-8987-487a-9d5e-33f79d0f07df" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:27:48 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-5357fc08-7612-4ae0-8317-3638d54eba6f tempest-CreateVolumesFromImageTest-1047476549 None] Lock "cinder-1e5fffd8-9a3a-42b7-87ba-1f43d6f31837-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:27:48 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-23afa722-aebb-420f-8c89-07e13047b59c tempest-CreateVolumesFromImageTest-1047476549 None] Lock "cinder-quobyte-5ecf736b-8987-487a-9d5e-33f79d0f07df" acquired by "delete_volume" :: waited 0.017s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:27:48 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2409914-18dc-4808-9a2c-2182bea3232f]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:27:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-23afa722-aebb-420f-8c89-07e13047b59c tempest-CreateVolumesFromImageTest-1047476549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5ecf736b-8987-487a-9d5e-33f79d0f07df {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:48 devstack sudo[100695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5ecf736b-8987-487a-9d5e-33f79d0f07df Jul 16 23:27:48 devstack sudo[100695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-23afa722-aebb-420f-8c89-07e13047b59c tempest-CreateVolumesFromImageTest-1047476549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5ecf736b-8987-487a-9d5e-33f79d0f07df" returned: 0 in 0.440s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-23afa722-aebb-420f-8c89-07e13047b59c tempest-CreateVolumesFromImageTest-1047476549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5ecf736b-8987-487a-9d5e-33f79d0f07df {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:49 devstack sudo[100695]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:49 devstack sudo[100706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5ecf736b-8987-487a-9d5e-33f79d0f07df Jul 16 23:27:49 devstack sudo[100706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:49 devstack sudo[100706]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-23afa722-aebb-420f-8c89-07e13047b59c tempest-CreateVolumesFromImageTest-1047476549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5ecf736b-8987-487a-9d5e-33f79d0f07df" returned: 0 in 0.384s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:49 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-23afa722-aebb-420f-8c89-07e13047b59c tempest-CreateVolumesFromImageTest-1047476549 None] Lock "cinder-quobyte-5ecf736b-8987-487a-9d5e-33f79d0f07df" released by "delete_volume" :: held 0.893s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:27:49 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-23afa722-aebb-420f-8c89-07e13047b59c tempest-CreateVolumesFromImageTest-1047476549 None] Created reservations ['e7f133f6-eb95-4e07-973e-cfa01e43cfa9', '89b45bc7-095b-48ab-be5a-622b3b7b5728', '0d967b7d-9381-4f5a-a282-fe378d423b55', '7a6ef474-528b-440e-b955-1291eafdbb1f'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:27:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-23afa722-aebb-420f-8c89-07e13047b59c tempest-CreateVolumesFromImageTest-1047476549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-23afa722-aebb-420f-8c89-07e13047b59c tempest-CreateVolumesFromImageTest-1047476549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:49 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-23afa722-aebb-420f-8c89-07e13047b59c tempest-CreateVolumesFromImageTest-1047476549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:27:49 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-23afa722-aebb-420f-8c89-07e13047b59c tempest-CreateVolumesFromImageTest-1047476549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:27:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-23afa722-aebb-420f-8c89-07e13047b59c tempest-CreateVolumesFromImageTest-1047476549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-23afa722-aebb-420f-8c89-07e13047b59c tempest-CreateVolumesFromImageTest-1047476549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:49 devstack sudo[100709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:27:49 devstack sudo[100709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:49 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fedd039c-9344-48b0-9380-8c67a1cacc37 tempest-CreateVolumesFromImageTest-1047476549 None] Acquiring lock "cinder-38b60364-03fa-4f4a-8e30-749ce66be1a1-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:27:49 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fedd039c-9344-48b0-9380-8c67a1cacc37 tempest-CreateVolumesFromImageTest-1047476549 None] Lock "cinder-38b60364-03fa-4f4a-8e30-749ce66be1a1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:27:49 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fedd039c-9344-48b0-9380-8c67a1cacc37 tempest-CreateVolumesFromImageTest-1047476549 None] Acquiring lock "cinder-quobyte-38b60364-03fa-4f4a-8e30-749ce66be1a1" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:27:49 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fedd039c-9344-48b0-9380-8c67a1cacc37 tempest-CreateVolumesFromImageTest-1047476549 None] Lock "cinder-quobyte-38b60364-03fa-4f4a-8e30-749ce66be1a1" acquired by "delete_volume" :: waited 0.036s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:27:50 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd71c64-4514-41ac-bcb1-5225b783c16c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:27:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fedd039c-9344-48b0-9380-8c67a1cacc37 tempest-CreateVolumesFromImageTest-1047476549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-38b60364-03fa-4f4a-8e30-749ce66be1a1 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:50 devstack sudo[100709]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-23afa722-aebb-420f-8c89-07e13047b59c tempest-CreateVolumesFromImageTest-1047476549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.377s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:50 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-23afa722-aebb-420f-8c89-07e13047b59c tempest-CreateVolumesFromImageTest-1047476549 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:27:50 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-23afa722-aebb-420f-8c89-07e13047b59c tempest-CreateVolumesFromImageTest-1047476549 None] Deleted volume successfully. Jul 16 23:27:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-23afa722-aebb-420f-8c89-07e13047b59c tempest-CreateVolumesFromImageTest-1047476549 None] Lock "cinder-5ecf736b-8987-487a-9d5e-33f79d0f07df-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:27:50 devstack sudo[100718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-38b60364-03fa-4f4a-8e30-749ce66be1a1 Jul 16 23:27:50 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:50 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fedd039c-9344-48b0-9380-8c67a1cacc37 tempest-CreateVolumesFromImageTest-1047476549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-38b60364-03fa-4f4a-8e30-749ce66be1a1" returned: 0 in 0.565s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fedd039c-9344-48b0-9380-8c67a1cacc37 tempest-CreateVolumesFromImageTest-1047476549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-38b60364-03fa-4f4a-8e30-749ce66be1a1 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:50 devstack sudo[100723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-38b60364-03fa-4f4a-8e30-749ce66be1a1 Jul 16 23:27:50 devstack sudo[100723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:50 devstack sudo[100691]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_j7ucl7grdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6d4782a-e362-4944-994a-2d53e658101a" returned: 0 in 2.337s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:50 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_j7ucl7grdevstack@QuobyteHD, size 112.00 MB, duration 2.34 sec, destination /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6d4782a-e362-4944-994a-2d53e658101a {{(pid=87607) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 23:27:50 devstack cinder-volume[87607]: INFO cinder.image.image_utils [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Converted 112.00 MB image at 47.89 MB/s Jul 16 23:27:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6d4782a-e362-4944-994a-2d53e658101a 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:50 devstack sudo[100727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6d4782a-e362-4944-994a-2d53e658101a 1G Jul 16 23:27:50 devstack sudo[100727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:50 devstack sudo[100723]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fedd039c-9344-48b0-9380-8c67a1cacc37 tempest-CreateVolumesFromImageTest-1047476549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-38b60364-03fa-4f4a-8e30-749ce66be1a1" returned: 0 in 0.285s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fedd039c-9344-48b0-9380-8c67a1cacc37 tempest-CreateVolumesFromImageTest-1047476549 None] Lock "cinder-quobyte-38b60364-03fa-4f4a-8e30-749ce66be1a1" released by "delete_volume" :: held 0.965s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-fedd039c-9344-48b0-9380-8c67a1cacc37 tempest-CreateVolumesFromImageTest-1047476549 None] Created reservations ['e41c6e66-2042-4f6d-baff-3b4bc53feefe', '3e9d0b17-256c-49c4-b46a-5b1f05e1cd0a', 'a03767a6-0510-4414-9e40-df1bc0cab7f0', '38faee0f-3341-4fa0-88a5-cfe4902c8eca'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-fedd039c-9344-48b0-9380-8c67a1cacc37 tempest-CreateVolumesFromImageTest-1047476549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-fedd039c-9344-48b0-9380-8c67a1cacc37 tempest-CreateVolumesFromImageTest-1047476549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-fedd039c-9344-48b0-9380-8c67a1cacc37 tempest-CreateVolumesFromImageTest-1047476549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-fedd039c-9344-48b0-9380-8c67a1cacc37 tempest-CreateVolumesFromImageTest-1047476549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-fedd039c-9344-48b0-9380-8c67a1cacc37 tempest-CreateVolumesFromImageTest-1047476549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fedd039c-9344-48b0-9380-8c67a1cacc37 tempest-CreateVolumesFromImageTest-1047476549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-dba8e278-1354-43e2-9fa4-9bc5cd694cf5 tempest-CreateVolumesFromImageTest-1047476549 None] Acquiring lock "cinder-4a16cd64-3843-4726-a773-115c2b7fcbb3-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:27:51 devstack sudo[100732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:27:51 devstack sudo[100732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-dba8e278-1354-43e2-9fa4-9bc5cd694cf5 tempest-CreateVolumesFromImageTest-1047476549 None] Lock "cinder-4a16cd64-3843-4726-a773-115c2b7fcbb3-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-dba8e278-1354-43e2-9fa4-9bc5cd694cf5 tempest-CreateVolumesFromImageTest-1047476549 None] Acquiring lock "cinder-quobyte-4a16cd64-3843-4726-a773-115c2b7fcbb3" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-dba8e278-1354-43e2-9fa4-9bc5cd694cf5 tempest-CreateVolumesFromImageTest-1047476549 None] Lock "cinder-quobyte-4a16cd64-3843-4726-a773-115c2b7fcbb3" acquired by "delete_volume" :: waited 0.044s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:27:51 devstack sudo[100727]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6d4782a-e362-4944-994a-2d53e658101a 1G" returned: 0 in 0.527s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG cinder.volume.volume_utils [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Downloaded image 6519f5ae-0b5b-4a63-9b9b-0adb6304882e ((None, [{'url': 'file:///opt/stack/data/glance/images/6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'metadata': {}}])) to volume b6d4782a-e362-4944-994a-2d53e658101a successfully. {{(pid=87607) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Temporary image 6519f5ae-0b5b-4a63-9b9b-0adb6304882e for user 9af56d5ec6824772bd26b17da510e366 is deleted. {{(pid=87607) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG cinder.volume.volume_utils [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Marking volume b6d4782a-e362-4944-994a-2d53e658101a as bootable. {{(pid=87607) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbbfecc-550b-4d07-8dfc-bae33d189b43]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-dba8e278-1354-43e2-9fa4-9bc5cd694cf5 tempest-CreateVolumesFromImageTest-1047476549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4a16cd64-3843-4726-a773-115c2b7fcbb3 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Copying metadata from image 6519f5ae-0b5b-4a63-9b9b-0adb6304882e to b6d4782a-e362-4944-994a-2d53e658101a. {{(pid=87607) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Creating volume glance metadata for volume b6d4782a-e362-4944-994a-2d53e658101a backed by image 6519f5ae-0b5b-4a63-9b9b-0adb6304882e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87607) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0796e5ae-e8a1-496d-912f-2ae8c245533b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6d4782a-e362-4944-994a-2d53e658101a', 'volume_size': 1, 'image_id': '6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3319c84d612344f1b9ca29a92bf5a474', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'created_at': datetime.datetime(2026, 7, 16, 21, 12, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 21, 12, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6519f5ae-0b5b-4a63-9b9b-0adb6304882e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:51 devstack sudo[100732]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4186c54-0455-4f2f-abd9-b0659332f32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fedd039c-9344-48b0-9380-8c67a1cacc37 tempest-CreateVolumesFromImageTest-1047476549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.415s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-fedd039c-9344-48b0-9380-8c67a1cacc37 tempest-CreateVolumesFromImageTest-1047476549 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:27:51 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Volume volume-b6d4782a-e362-4944-994a-2d53e658101a (b6d4782a-e362-4944-994a-2d53e658101a): created successfully Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4186c54-0455-4f2f-abd9-b0659332f32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Flow 'volume_create_manager' (41626441-9a53-4d76-9fa2-8c5e7e65686e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:27:51 devstack sudo[100735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4a16cd64-3843-4726-a773-115c2b7fcbb3 Jul 16 23:27:51 devstack sudo[100735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:51 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-fedd039c-9344-48b0-9380-8c67a1cacc37 tempest-CreateVolumesFromImageTest-1047476549 None] Deleted volume successfully. Jul 16 23:27:51 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-4cf8371d-4985-4e13-8103-312cbbec21bb tempest-VolumesExtendTest-525221970 None] Created volume successfully. Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fedd039c-9344-48b0-9380-8c67a1cacc37 tempest-CreateVolumesFromImageTest-1047476549 None] Lock "cinder-38b60364-03fa-4f4a-8e30-749ce66be1a1-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-363e94e8-3828-48ae-9e93-f47bc84c0128 tempest-AttachVolumeNegativeTest-552460454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-363e94e8-3828-48ae-9e93-f47bc84c0128 tempest-AttachVolumeNegativeTest-552460454 None] Flow 'volume_create_manager' (ba2f84bd-199f-443f-ae96-25023ac8911b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-363e94e8-3828-48ae-9e93-f47bc84c0128 tempest-AttachVolumeNegativeTest-552460454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3593eb92-69fc-4db8-92ee-8e6697ba07ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-363e94e8-3828-48ae-9e93-f47bc84c0128 tempest-AttachVolumeNegativeTest-552460454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3593eb92-69fc-4db8-92ee-8e6697ba07ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-290328310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=611bd503-5986-483f-b836-1c35f573004b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad2eceaebf5b4204b9222188f3e0e98d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:27:52Z,use_quota=True,user_id='609a2cd5502a47deab0e97d228687a01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-363e94e8-3828-48ae-9e93-f47bc84c0128 tempest-AttachVolumeNegativeTest-552460454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4f7a6d4-1c20-4dde-9a30-28388d674252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-363e94e8-3828-48ae-9e93-f47bc84c0128 tempest-AttachVolumeNegativeTest-552460454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4f7a6d4-1c20-4dde-9a30-28388d674252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-363e94e8-3828-48ae-9e93-f47bc84c0128 tempest-AttachVolumeNegativeTest-552460454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49772425-c116-47bf-836a-82ca4be30020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-363e94e8-3828-48ae-9e93-f47bc84c0128 tempest-AttachVolumeNegativeTest-552460454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49772425-c116-47bf-836a-82ca4be30020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '611bd503-5986-483f-b836-1c35f573004b', 'volume_name': 'volume-611bd503-5986-483f-b836-1c35f573004b', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-363e94e8-3828-48ae-9e93-f47bc84c0128 tempest-AttachVolumeNegativeTest-552460454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d3a4068-a950-4640-a11c-d246362ecfdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-363e94e8-3828-48ae-9e93-f47bc84c0128 tempest-AttachVolumeNegativeTest-552460454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d3a4068-a950-4640-a11c-d246362ecfdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-363e94e8-3828-48ae-9e93-f47bc84c0128 tempest-AttachVolumeNegativeTest-552460454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c08ff58-b6d1-4188-ad4b-2ee0db11fa6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:51 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-363e94e8-3828-48ae-9e93-f47bc84c0128 tempest-AttachVolumeNegativeTest-552460454 None] Volume 611bd503-5986-483f-b836-1c35f573004b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-611bd503-5986-483f-b836-1c35f573004b', 'volume_size': 1} Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-363e94e8-3828-48ae-9e93-f47bc84c0128 tempest-AttachVolumeNegativeTest-552460454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-363e94e8-3828-48ae-9e93-f47bc84c0128 tempest-AttachVolumeNegativeTest-552460454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-363e94e8-3828-48ae-9e93-f47bc84c0128 tempest-AttachVolumeNegativeTest-552460454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-290328310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=611bd503-5986-483f-b836-1c35f573004b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad2eceaebf5b4204b9222188f3e0e98d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:27:52Z,use_quota=True,user_id='609a2cd5502a47deab0e97d228687a01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-363e94e8-3828-48ae-9e93-f47bc84c0128 tempest-AttachVolumeNegativeTest-552460454 None] Creating volume 611bd503-5986-483f-b836-1c35f573004b {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-363e94e8-3828-48ae-9e93-f47bc84c0128 tempest-AttachVolumeNegativeTest-552460454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-363e94e8-3828-48ae-9e93-f47bc84c0128 tempest-AttachVolumeNegativeTest-552460454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-363e94e8-3828-48ae-9e93-f47bc84c0128 tempest-AttachVolumeNegativeTest-552460454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-363e94e8-3828-48ae-9e93-f47bc84c0128 tempest-AttachVolumeNegativeTest-552460454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-363e94e8-3828-48ae-9e93-f47bc84c0128 tempest-AttachVolumeNegativeTest-552460454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-363e94e8-3828-48ae-9e93-f47bc84c0128 tempest-AttachVolumeNegativeTest-552460454 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:27:51 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-363e94e8-3828-48ae-9e93-f47bc84c0128 tempest-AttachVolumeNegativeTest-552460454 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-363e94e8-3828-48ae-9e93-f47bc84c0128 tempest-AttachVolumeNegativeTest-552460454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-611bd503-5986-483f-b836-1c35f573004b 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:51 devstack sudo[100742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-611bd503-5986-483f-b836-1c35f573004b 1073741824 Jul 16 23:27:51 devstack sudo[100742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:51 devstack sudo[100735]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-dba8e278-1354-43e2-9fa4-9bc5cd694cf5 tempest-CreateVolumesFromImageTest-1047476549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4a16cd64-3843-4726-a773-115c2b7fcbb3" returned: 0 in 0.492s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-dba8e278-1354-43e2-9fa4-9bc5cd694cf5 tempest-CreateVolumesFromImageTest-1047476549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4a16cd64-3843-4726-a773-115c2b7fcbb3 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:51 devstack sudo[100746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4a16cd64-3843-4726-a773-115c2b7fcbb3 Jul 16 23:27:51 devstack sudo[100746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:52 devstack sudo[100746]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-dba8e278-1354-43e2-9fa4-9bc5cd694cf5 tempest-CreateVolumesFromImageTest-1047476549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4a16cd64-3843-4726-a773-115c2b7fcbb3" returned: 0 in 0.272s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:52 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-dba8e278-1354-43e2-9fa4-9bc5cd694cf5 tempest-CreateVolumesFromImageTest-1047476549 None] Lock "cinder-quobyte-4a16cd64-3843-4726-a773-115c2b7fcbb3" released by "delete_volume" :: held 0.863s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:27:52 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-dba8e278-1354-43e2-9fa4-9bc5cd694cf5 tempest-CreateVolumesFromImageTest-1047476549 None] Created reservations ['f8e15a33-a79f-4f8e-b764-b2a1adc82d16', '158ee88e-cb8c-4ddb-a0d5-4fb3d0c4ef27', '5a7caa70-6861-4e67-a2b3-e5665bf6ffb9', 'c9b44671-2871-473e-a96c-14d0c46f1b34'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:27:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-d0daf2c9-5469-48b8-9ffd-2e010fee39cc req-5a269473-a288-47f8-853b-332ccba86516 tempest-TestServerVolumeAttachmentScenario-804454518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-dba8e278-1354-43e2-9fa4-9bc5cd694cf5 tempest-CreateVolumesFromImageTest-1047476549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-dba8e278-1354-43e2-9fa4-9bc5cd694cf5 tempest-CreateVolumesFromImageTest-1047476549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:52 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-dba8e278-1354-43e2-9fa4-9bc5cd694cf5 tempest-CreateVolumesFromImageTest-1047476549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:27:52 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-dba8e278-1354-43e2-9fa4-9bc5cd694cf5 tempest-CreateVolumesFromImageTest-1047476549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:27:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-dba8e278-1354-43e2-9fa4-9bc5cd694cf5 tempest-CreateVolumesFromImageTest-1047476549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-dba8e278-1354-43e2-9fa4-9bc5cd694cf5 tempest-CreateVolumesFromImageTest-1047476549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:52 devstack sudo[100742]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-363e94e8-3828-48ae-9e93-f47bc84c0128 tempest-AttachVolumeNegativeTest-552460454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-611bd503-5986-483f-b836-1c35f573004b 1073741824" returned: 0 in 0.546s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:52 devstack sudo[100761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:27:52 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-363e94e8-3828-48ae-9e93-f47bc84c0128 tempest-AttachVolumeNegativeTest-552460454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-611bd503-5986-483f-b836-1c35f573004b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:52 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-28a58bc8-ce39-44e9-abe9-d096ebf2c9f6 tempest-CreateVolumesFromImageTest-1047476549 None] Acquiring lock "cinder-6651d60d-3b40-467c-91e3-fafa900af409-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:27:52 devstack sudo[100763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-611bd503-5986-483f-b836-1c35f573004b Jul 16 23:27:52 devstack sudo[100763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:52 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-28a58bc8-ce39-44e9-abe9-d096ebf2c9f6 tempest-CreateVolumesFromImageTest-1047476549 None] Lock "cinder-6651d60d-3b40-467c-91e3-fafa900af409-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:27:52 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-28a58bc8-ce39-44e9-abe9-d096ebf2c9f6 tempest-CreateVolumesFromImageTest-1047476549 None] Acquiring lock "cinder-quobyte-6651d60d-3b40-467c-91e3-fafa900af409" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:27:52 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-28a58bc8-ce39-44e9-abe9-d096ebf2c9f6 tempest-CreateVolumesFromImageTest-1047476549 None] Lock "cinder-quobyte-6651d60d-3b40-467c-91e3-fafa900af409" acquired by "delete_volume" :: waited 0.014s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:27:52 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[1778e17e-0a2c-4be7-9f33-841f23d3e1cb]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:27:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-28a58bc8-ce39-44e9-abe9-d096ebf2c9f6 tempest-CreateVolumesFromImageTest-1047476549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6651d60d-3b40-467c-91e3-fafa900af409 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:52 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-dba8e278-1354-43e2-9fa4-9bc5cd694cf5 tempest-CreateVolumesFromImageTest-1047476549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.283s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:52 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-dba8e278-1354-43e2-9fa4-9bc5cd694cf5 tempest-CreateVolumesFromImageTest-1047476549 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:27:52 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-dba8e278-1354-43e2-9fa4-9bc5cd694cf5 tempest-CreateVolumesFromImageTest-1047476549 None] Deleted volume successfully. Jul 16 23:27:52 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-dba8e278-1354-43e2-9fa4-9bc5cd694cf5 tempest-CreateVolumesFromImageTest-1047476549 None] Lock "cinder-4a16cd64-3843-4726-a773-115c2b7fcbb3-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:27:52 devstack sudo[100765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6651d60d-3b40-467c-91e3-fafa900af409 Jul 16 23:27:52 devstack sudo[100763]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:52 devstack sudo[100765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-363e94e8-3828-48ae-9e93-f47bc84c0128 tempest-AttachVolumeNegativeTest-552460454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-611bd503-5986-483f-b836-1c35f573004b" returned: 0 in 0.315s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:52 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-363e94e8-3828-48ae-9e93-f47bc84c0128 tempest-AttachVolumeNegativeTest-552460454 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:27:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-363e94e8-3828-48ae-9e93-f47bc84c0128 tempest-AttachVolumeNegativeTest-552460454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-d0daf2c9-5469-48b8-9ffd-2e010fee39cc req-5a269473-a288-47f8-853b-332ccba86516 tempest-TestServerVolumeAttachmentScenario-804454518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.386s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-d0daf2c9-5469-48b8-9ffd-2e010fee39cc req-5a269473-a288-47f8-853b-332ccba86516 tempest-TestServerVolumeAttachmentScenario-804454518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:52 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-363e94e8-3828-48ae-9e93-f47bc84c0128 tempest-AttachVolumeNegativeTest-552460454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c08ff58-b6d1-4188-ad4b-2ee0db11fa6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-611bd503-5986-483f-b836-1c35f573004b', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:52 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-363e94e8-3828-48ae-9e93-f47bc84c0128 tempest-AttachVolumeNegativeTest-552460454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d32abc9-b496-4c8c-a620-d7ea06747d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:52 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-363e94e8-3828-48ae-9e93-f47bc84c0128 tempest-AttachVolumeNegativeTest-552460454 None] Volume volume-611bd503-5986-483f-b836-1c35f573004b (611bd503-5986-483f-b836-1c35f573004b): created successfully Jul 16 23:27:52 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-363e94e8-3828-48ae-9e93-f47bc84c0128 tempest-AttachVolumeNegativeTest-552460454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d32abc9-b496-4c8c-a620-d7ea06747d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:52 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-363e94e8-3828-48ae-9e93-f47bc84c0128 tempest-AttachVolumeNegativeTest-552460454 None] Flow 'volume_create_manager' (ba2f84bd-199f-443f-ae96-25023ac8911b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:27:52 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-363e94e8-3828-48ae-9e93-f47bc84c0128 tempest-AttachVolumeNegativeTest-552460454 None] Created volume successfully. Jul 16 23:27:52 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-d0daf2c9-5469-48b8-9ffd-2e010fee39cc req-5a269473-a288-47f8-853b-332ccba86516 tempest-TestServerVolumeAttachmentScenario-804454518 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72', 'name': 'volume-d1b33387-8a97-4ddb-999a-f311261152c9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '67f3b47f-5960-4eca-938f-039d9c5726be', 'enforce_multipath': True} {{(pid=87607) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 23:27:52 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-d0daf2c9-5469-48b8-9ffd-2e010fee39cc req-5a269473-a288-47f8-853b-332ccba86516 tempest-TestServerVolumeAttachmentScenario-804454518 None] attachment_update completed successfully. Jul 16 23:27:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a472415a-08db-4ec7-80dc-c88954278711 tempest-VolumesExtendTest-525221970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a472415a-08db-4ec7-80dc-c88954278711 tempest-VolumesExtendTest-525221970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:52 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7eb7a6a-de2f-4793-a957-903c6c38a30f]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:27:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a472415a-08db-4ec7-80dc-c88954278711 tempest-VolumesExtendTest-525221970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6d4782a-e362-4944-994a-2d53e658101a {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:52 devstack sudo[100765]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-28a58bc8-ce39-44e9-abe9-d096ebf2c9f6 tempest-CreateVolumesFromImageTest-1047476549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6651d60d-3b40-467c-91e3-fafa900af409" returned: 0 in 0.462s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-28a58bc8-ce39-44e9-abe9-d096ebf2c9f6 tempest-CreateVolumesFromImageTest-1047476549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6651d60d-3b40-467c-91e3-fafa900af409 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:52 devstack sudo[100769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6d4782a-e362-4944-994a-2d53e658101a Jul 16 23:27:52 devstack sudo[100769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:52 devstack sudo[100775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6651d60d-3b40-467c-91e3-fafa900af409 Jul 16 23:27:52 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:53 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:53 devstack sudo[100769]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-28a58bc8-ce39-44e9-abe9-d096ebf2c9f6 tempest-CreateVolumesFromImageTest-1047476549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6651d60d-3b40-467c-91e3-fafa900af409" returned: 0 in 0.327s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a472415a-08db-4ec7-80dc-c88954278711 tempest-VolumesExtendTest-525221970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6d4782a-e362-4944-994a-2d53e658101a" returned: 0 in 0.454s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a472415a-08db-4ec7-80dc-c88954278711 tempest-VolumesExtendTest-525221970 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6d4782a-e362-4944-994a-2d53e658101a 2G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:53 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-28a58bc8-ce39-44e9-abe9-d096ebf2c9f6 tempest-CreateVolumesFromImageTest-1047476549 None] Lock "cinder-quobyte-6651d60d-3b40-467c-91e3-fafa900af409" released by "delete_volume" :: held 0.866s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:27:53 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-28a58bc8-ce39-44e9-abe9-d096ebf2c9f6 tempest-CreateVolumesFromImageTest-1047476549 None] Created reservations ['5e6874dc-b980-4641-b5a8-3a6b3fa492a9', '674fc6e9-a2f9-474d-a398-7533c180fd17', '0941c007-9160-461a-ba48-b6e813a8839f', 'b963f0eb-4f66-46a8-a302-470af29b08ce'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:27:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a472415a-08db-4ec7-80dc-c88954278711 tempest-VolumesExtendTest-525221970 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6d4782a-e362-4944-994a-2d53e658101a 2G" returned: 0 in 0.130s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a472415a-08db-4ec7-80dc-c88954278711 tempest-VolumesExtendTest-525221970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.613s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-28a58bc8-ce39-44e9-abe9-d096ebf2c9f6 tempest-CreateVolumesFromImageTest-1047476549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-28a58bc8-ce39-44e9-abe9-d096ebf2c9f6 tempest-CreateVolumesFromImageTest-1047476549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:53 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-28a58bc8-ce39-44e9-abe9-d096ebf2c9f6 tempest-CreateVolumesFromImageTest-1047476549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:27:53 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-28a58bc8-ce39-44e9-abe9-d096ebf2c9f6 tempest-CreateVolumesFromImageTest-1047476549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:27:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-28a58bc8-ce39-44e9-abe9-d096ebf2c9f6 tempest-CreateVolumesFromImageTest-1047476549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-28a58bc8-ce39-44e9-abe9-d096ebf2c9f6 tempest-CreateVolumesFromImageTest-1047476549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:53 devstack sudo[100786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:27:53 devstack sudo[100786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:53 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-a472415a-08db-4ec7-80dc-c88954278711 tempest-VolumesExtendTest-525221970 None] Extend volume completed successfully. Jul 16 23:27:53 devstack sudo[100786]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-28a58bc8-ce39-44e9-abe9-d096ebf2c9f6 tempest-CreateVolumesFromImageTest-1047476549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.271s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:53 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-28a58bc8-ce39-44e9-abe9-d096ebf2c9f6 tempest-CreateVolumesFromImageTest-1047476549 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:27:53 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-28a58bc8-ce39-44e9-abe9-d096ebf2c9f6 tempest-CreateVolumesFromImageTest-1047476549 None] Deleted volume successfully. Jul 16 23:27:53 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-28a58bc8-ce39-44e9-abe9-d096ebf2c9f6 tempest-CreateVolumesFromImageTest-1047476549 None] Lock "cinder-6651d60d-3b40-467c-91e3-fafa900af409-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:27:54 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-bf0936c3-b8ad-4d7d-b9e5-6042ac4f101d tempest-VolumesExtendTest-525221970 None] Acquiring lock "cinder-b6d4782a-e362-4944-994a-2d53e658101a-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:27:54 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-bf0936c3-b8ad-4d7d-b9e5-6042ac4f101d tempest-VolumesExtendTest-525221970 None] Lock "cinder-b6d4782a-e362-4944-994a-2d53e658101a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:27:54 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-bf0936c3-b8ad-4d7d-b9e5-6042ac4f101d tempest-VolumesExtendTest-525221970 None] Acquiring lock "cinder-quobyte-b6d4782a-e362-4944-994a-2d53e658101a" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:27:54 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-bf0936c3-b8ad-4d7d-b9e5-6042ac4f101d tempest-VolumesExtendTest-525221970 None] Lock "cinder-quobyte-b6d4782a-e362-4944-994a-2d53e658101a" acquired by "delete_volume" :: waited 0.020s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:27:54 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b7db15-4dc0-48f4-b624-f2be78910d36]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:27:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bf0936c3-b8ad-4d7d-b9e5-6042ac4f101d tempest-VolumesExtendTest-525221970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6d4782a-e362-4944-994a-2d53e658101a {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:54 devstack sudo[100795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6d4782a-e362-4944-994a-2d53e658101a Jul 16 23:27:54 devstack sudo[100795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-4ec346aa-edee-4174-947d-a98b47076866 req-84694f44-3596-40b9-8a38-f95abc7798e0 tempest-AttachVolumeNegativeTest-552460454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-4ec346aa-edee-4174-947d-a98b47076866 req-84694f44-3596-40b9-8a38-f95abc7798e0 tempest-AttachVolumeNegativeTest-552460454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-4ec346aa-edee-4174-947d-a98b47076866 req-84694f44-3596-40b9-8a38-f95abc7798e0 tempest-AttachVolumeNegativeTest-552460454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:54 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-4ec346aa-edee-4174-947d-a98b47076866 req-84694f44-3596-40b9-8a38-f95abc7798e0 tempest-AttachVolumeNegativeTest-552460454 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72', 'name': 'volume-611bd503-5986-483f-b836-1c35f573004b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '89b6e265-b358-40eb-ad52-ff9d630fc425', 'enforce_multipath': True} {{(pid=87607) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 23:27:54 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-4ec346aa-edee-4174-947d-a98b47076866 req-84694f44-3596-40b9-8a38-f95abc7798e0 tempest-AttachVolumeNegativeTest-552460454 None] attachment_update completed successfully. Jul 16 23:27:54 devstack sudo[100795]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bf0936c3-b8ad-4d7d-b9e5-6042ac4f101d tempest-VolumesExtendTest-525221970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6d4782a-e362-4944-994a-2d53e658101a" returned: 0 in 0.645s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bf0936c3-b8ad-4d7d-b9e5-6042ac4f101d tempest-VolumesExtendTest-525221970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6d4782a-e362-4944-994a-2d53e658101a {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:54 devstack sudo[100806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6d4782a-e362-4944-994a-2d53e658101a Jul 16 23:27:54 devstack sudo[100806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:55 devstack sudo[100806]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bf0936c3-b8ad-4d7d-b9e5-6042ac4f101d tempest-VolumesExtendTest-525221970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6d4782a-e362-4944-994a-2d53e658101a" returned: 0 in 0.348s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:55 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-bf0936c3-b8ad-4d7d-b9e5-6042ac4f101d tempest-VolumesExtendTest-525221970 None] Lock "cinder-quobyte-b6d4782a-e362-4944-994a-2d53e658101a" released by "delete_volume" :: held 1.065s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:27:55 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-bf0936c3-b8ad-4d7d-b9e5-6042ac4f101d tempest-VolumesExtendTest-525221970 None] Created reservations ['d63c2c9d-90c2-4a1a-bd41-0c579dfc02e6', '7f6d4c69-132a-416a-9df4-6edf79281174', '4f9def3c-0fa0-4cdc-8ee6-b380c44d7239', '9db0b346-99eb-4078-aa82-dfae67b199d4'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:27:55 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-43f9b4ec-8c0d-4950-8166-481a31e6220e req-1fe1cfa6-4d36-4958-9573-1bf6796042d6 tempest-TestServerVolumeAttachmentScenario-804454518 None] Terminate volume connection completed successfully. Jul 16 23:27:55 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-43f9b4ec-8c0d-4950-8166-481a31e6220e req-1fe1cfa6-4d36-4958-9573-1bf6796042d6 tempest-TestServerVolumeAttachmentScenario-804454518 None] Deleting attachment 67f3b47f-5960-4eca-938f-039d9c5726be. {{(pid=87607) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 23:27:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bf0936c3-b8ad-4d7d-b9e5-6042ac4f101d tempest-VolumesExtendTest-525221970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bf0936c3-b8ad-4d7d-b9e5-6042ac4f101d tempest-VolumesExtendTest-525221970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:55 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-bf0936c3-b8ad-4d7d-b9e5-6042ac4f101d tempest-VolumesExtendTest-525221970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:27:55 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-bf0936c3-b8ad-4d7d-b9e5-6042ac4f101d tempest-VolumesExtendTest-525221970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:27:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bf0936c3-b8ad-4d7d-b9e5-6042ac4f101d tempest-VolumesExtendTest-525221970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bf0936c3-b8ad-4d7d-b9e5-6042ac4f101d tempest-VolumesExtendTest-525221970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:55 devstack sudo[100816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:27:55 devstack sudo[100816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:55 devstack sudo[100816]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bf0936c3-b8ad-4d7d-b9e5-6042ac4f101d tempest-VolumesExtendTest-525221970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.383s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:55 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-bf0936c3-b8ad-4d7d-b9e5-6042ac4f101d tempest-VolumesExtendTest-525221970 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:27:55 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-bf0936c3-b8ad-4d7d-b9e5-6042ac4f101d tempest-VolumesExtendTest-525221970 None] Deleted volume successfully. Jul 16 23:27:55 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-bf0936c3-b8ad-4d7d-b9e5-6042ac4f101d tempest-VolumesExtendTest-525221970 None] Lock "cinder-b6d4782a-e362-4944-994a-2d53e658101a-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:27:57 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-7e073af6-e20e-40cf-8852-ef3f5820d5cc req-ea260c34-c8b2-4897-a45b-bad5805eced7 tempest-TestServerVolumeAttachmentScenario-804454518 None] Terminate volume connection completed successfully. Jul 16 23:27:57 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-7e073af6-e20e-40cf-8852-ef3f5820d5cc req-ea260c34-c8b2-4897-a45b-bad5805eced7 tempest-TestServerVolumeAttachmentScenario-804454518 None] Deleting attachment 4227dafb-5a1e-4203-8df5-821084d2f467. {{(pid=87607) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 23:27:57 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-03ef7381-88b6-49f8-b8f2-2460e75ae3e8 tempest-VolumesExtendTest-525221970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:27:57 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-03ef7381-88b6-49f8-b8f2-2460e75ae3e8 tempest-VolumesExtendTest-525221970 None] Flow 'volume_create_manager' (9759b2a3-e16a-42fb-9756-3c36321c9810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:27:57 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-03ef7381-88b6-49f8-b8f2-2460e75ae3e8 tempest-VolumesExtendTest-525221970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a466e6e8-36e5-483b-905b-09279209d48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:57 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-03ef7381-88b6-49f8-b8f2-2460e75ae3e8 tempest-VolumesExtendTest-525221970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a466e6e8-36e5-483b-905b-09279209d48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-345675317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=852ed5d4-e013-48c1-81a2-6e8e4e5be272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='229d3cae5d874e8e8361b29fbad375de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:27:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:27:57Z,use_quota=True,user_id='9af56d5ec6824772bd26b17da510e366',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:57 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-03ef7381-88b6-49f8-b8f2-2460e75ae3e8 tempest-VolumesExtendTest-525221970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ba7e45b-1669-4f46-8a02-3db41ac702ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:57 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-03ef7381-88b6-49f8-b8f2-2460e75ae3e8 tempest-VolumesExtendTest-525221970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ba7e45b-1669-4f46-8a02-3db41ac702ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:57 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-03ef7381-88b6-49f8-b8f2-2460e75ae3e8 tempest-VolumesExtendTest-525221970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75684de7-1c6a-4033-b520-096fd67fc9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:57 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-03ef7381-88b6-49f8-b8f2-2460e75ae3e8 tempest-VolumesExtendTest-525221970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75684de7-1c6a-4033-b520-096fd67fc9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '852ed5d4-e013-48c1-81a2-6e8e4e5be272', 'volume_name': 'volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:57 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-03ef7381-88b6-49f8-b8f2-2460e75ae3e8 tempest-VolumesExtendTest-525221970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e966830-974a-410c-b906-da90a9ff9726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:57 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-03ef7381-88b6-49f8-b8f2-2460e75ae3e8 tempest-VolumesExtendTest-525221970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e966830-974a-410c-b906-da90a9ff9726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:57 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-03ef7381-88b6-49f8-b8f2-2460e75ae3e8 tempest-VolumesExtendTest-525221970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e81feda-74d7-4806-87c7-80e71c3df3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:57 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-03ef7381-88b6-49f8-b8f2-2460e75ae3e8 tempest-VolumesExtendTest-525221970 None] Volume 852ed5d4-e013-48c1-81a2-6e8e4e5be272: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272', 'volume_size': 1} Jul 16 23:27:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-03ef7381-88b6-49f8-b8f2-2460e75ae3e8 tempest-VolumesExtendTest-525221970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-03ef7381-88b6-49f8-b8f2-2460e75ae3e8 tempest-VolumesExtendTest-525221970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:57 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-03ef7381-88b6-49f8-b8f2-2460e75ae3e8 tempest-VolumesExtendTest-525221970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-345675317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=852ed5d4-e013-48c1-81a2-6e8e4e5be272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='229d3cae5d874e8e8361b29fbad375de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:27:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:27:57Z,use_quota=True,user_id='9af56d5ec6824772bd26b17da510e366',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:27:57 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-03ef7381-88b6-49f8-b8f2-2460e75ae3e8 tempest-VolumesExtendTest-525221970 None] Creating volume 852ed5d4-e013-48c1-81a2-6e8e4e5be272 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:27:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-03ef7381-88b6-49f8-b8f2-2460e75ae3e8 tempest-VolumesExtendTest-525221970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-03ef7381-88b6-49f8-b8f2-2460e75ae3e8 tempest-VolumesExtendTest-525221970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:57 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-03ef7381-88b6-49f8-b8f2-2460e75ae3e8 tempest-VolumesExtendTest-525221970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:27:57 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-03ef7381-88b6-49f8-b8f2-2460e75ae3e8 tempest-VolumesExtendTest-525221970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:27:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-03ef7381-88b6-49f8-b8f2-2460e75ae3e8 tempest-VolumesExtendTest-525221970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:57 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-03ef7381-88b6-49f8-b8f2-2460e75ae3e8 tempest-VolumesExtendTest-525221970 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:27:57 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-03ef7381-88b6-49f8-b8f2-2460e75ae3e8 tempest-VolumesExtendTest-525221970 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:27:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-03ef7381-88b6-49f8-b8f2-2460e75ae3e8 tempest-VolumesExtendTest-525221970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:57 devstack sudo[100835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272 1073741824 Jul 16 23:27:57 devstack sudo[100835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:57 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-be46f722-f4d2-4b75-81ab-524154c4884b req-416efc53-8078-48b6-8100-ecd91e89c610 tempest-AttachVolumeNegativeTest-552460454 None] Terminate volume connection completed successfully. Jul 16 23:27:57 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-be46f722-f4d2-4b75-81ab-524154c4884b req-416efc53-8078-48b6-8100-ecd91e89c610 tempest-AttachVolumeNegativeTest-552460454 None] Deleting attachment 89b6e265-b358-40eb-ad52-ff9d630fc425. {{(pid=87607) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 23:27:57 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ca96d27-867d-42e8-a2be-79803dcbcffb tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:27:57 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6ca96d27-867d-42e8-a2be-79803dcbcffb tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Flow 'volume_create_manager' (714684e5-5e81-48ef-8cb1-09585d47abc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:27:57 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6ca96d27-867d-42e8-a2be-79803dcbcffb tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91dd1389-85c5-4d92-a517-14930bd3e8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:57 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6ca96d27-867d-42e8-a2be-79803dcbcffb tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91dd1389-85c5-4d92-a517-14930bd3e8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1112521452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8225957-ebae-48d0-bcba-42f45fb27295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8cf85c5b72b4a03bce87872cdf80f94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:27:58Z,use_quota=True,user_id='af15b89155e7472c9fb973f5742f79db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:57 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6ca96d27-867d-42e8-a2be-79803dcbcffb tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e92525bd-ad79-439a-a6bc-807c5e0a3480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:57 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6ca96d27-867d-42e8-a2be-79803dcbcffb tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e92525bd-ad79-439a-a6bc-807c5e0a3480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:57 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6ca96d27-867d-42e8-a2be-79803dcbcffb tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfc5eb9d-461f-4657-ad22-58bdfb3647e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:57 devstack sudo[100835]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:57 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6ca96d27-867d-42e8-a2be-79803dcbcffb tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfc5eb9d-461f-4657-ad22-58bdfb3647e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8225957-ebae-48d0-bcba-42f45fb27295', 'volume_name': 'volume-b8225957-ebae-48d0-bcba-42f45fb27295', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:57 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6ca96d27-867d-42e8-a2be-79803dcbcffb tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (565cc24a-a822-4a9e-b38a-a9587374b894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:57 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6ca96d27-867d-42e8-a2be-79803dcbcffb tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (565cc24a-a822-4a9e-b38a-a9587374b894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:57 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6ca96d27-867d-42e8-a2be-79803dcbcffb tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c711411-2a4d-4a44-803c-022237f2143a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:57 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-6ca96d27-867d-42e8-a2be-79803dcbcffb tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Volume b8225957-ebae-48d0-bcba-42f45fb27295: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8225957-ebae-48d0-bcba-42f45fb27295', 'volume_size': 1} Jul 16 23:27:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6ca96d27-867d-42e8-a2be-79803dcbcffb tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-03ef7381-88b6-49f8-b8f2-2460e75ae3e8 tempest-VolumesExtendTest-525221970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272 1073741824" returned: 0 in 0.646s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-03ef7381-88b6-49f8-b8f2-2460e75ae3e8 tempest-VolumesExtendTest-525221970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:57 devstack sudo[100869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272 Jul 16 23:27:57 devstack sudo[100869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:58 devstack sudo[100869]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-03ef7381-88b6-49f8-b8f2-2460e75ae3e8 tempest-VolumesExtendTest-525221970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272" returned: 0 in 0.296s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:58 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-03ef7381-88b6-49f8-b8f2-2460e75ae3e8 tempest-VolumesExtendTest-525221970 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:27:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-03ef7381-88b6-49f8-b8f2-2460e75ae3e8 tempest-VolumesExtendTest-525221970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6ca96d27-867d-42e8-a2be-79803dcbcffb tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.342s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:58 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-6ca96d27-867d-42e8-a2be-79803dcbcffb tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1112521452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8225957-ebae-48d0-bcba-42f45fb27295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8cf85c5b72b4a03bce87872cdf80f94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:27:58Z,use_quota=True,user_id='af15b89155e7472c9fb973f5742f79db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:27:58 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-6ca96d27-867d-42e8-a2be-79803dcbcffb tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Creating volume b8225957-ebae-48d0-bcba-42f45fb27295 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:27:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6ca96d27-867d-42e8-a2be-79803dcbcffb tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6ca96d27-867d-42e8-a2be-79803dcbcffb tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:58 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-6ca96d27-867d-42e8-a2be-79803dcbcffb tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:27:58 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-6ca96d27-867d-42e8-a2be-79803dcbcffb tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:27:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6ca96d27-867d-42e8-a2be-79803dcbcffb tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:58 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-6ca96d27-867d-42e8-a2be-79803dcbcffb tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:27:58 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-6ca96d27-867d-42e8-a2be-79803dcbcffb tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:27:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6ca96d27-867d-42e8-a2be-79803dcbcffb tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b8225957-ebae-48d0-bcba-42f45fb27295 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-03ef7381-88b6-49f8-b8f2-2460e75ae3e8 tempest-VolumesExtendTest-525221970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e81feda-74d7-4806-87c7-80e71c3df3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-03ef7381-88b6-49f8-b8f2-2460e75ae3e8 tempest-VolumesExtendTest-525221970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9ad2aa4-7fc1-46ac-b195-322f6d1a98ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:58 devstack sudo[100872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b8225957-ebae-48d0-bcba-42f45fb27295 1073741824 Jul 16 23:27:58 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:58 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-03ef7381-88b6-49f8-b8f2-2460e75ae3e8 tempest-VolumesExtendTest-525221970 None] Volume volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272 (852ed5d4-e013-48c1-81a2-6e8e4e5be272): created successfully Jul 16 23:27:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-03ef7381-88b6-49f8-b8f2-2460e75ae3e8 tempest-VolumesExtendTest-525221970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9ad2aa4-7fc1-46ac-b195-322f6d1a98ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-03ef7381-88b6-49f8-b8f2-2460e75ae3e8 tempest-VolumesExtendTest-525221970 None] Flow 'volume_create_manager' (9759b2a3-e16a-42fb-9756-3c36321c9810) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:27:58 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-03ef7381-88b6-49f8-b8f2-2460e75ae3e8 tempest-VolumesExtendTest-525221970 None] Created volume successfully. Jul 16 23:27:59 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6ca96d27-867d-42e8-a2be-79803dcbcffb tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b8225957-ebae-48d0-bcba-42f45fb27295 1073741824" returned: 0 in 0.790s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6ca96d27-867d-42e8-a2be-79803dcbcffb tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b8225957-ebae-48d0-bcba-42f45fb27295 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:59 devstack sudo[100903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b8225957-ebae-48d0-bcba-42f45fb27295 Jul 16 23:27:59 devstack sudo[100903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:27:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-76fa55f4-2f35-48f6-846e-4376b54fbc53 tempest-VolumesExtendTest-525221970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:27:59 devstack sudo[100903]: pam_unix(sudo:session): session closed for user root Jul 16 23:27:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6ca96d27-867d-42e8-a2be-79803dcbcffb tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b8225957-ebae-48d0-bcba-42f45fb27295" returned: 0 in 0.598s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:27:59 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-6ca96d27-867d-42e8-a2be-79803dcbcffb tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:27:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6ca96d27-867d-42e8-a2be-79803dcbcffb tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:27:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-76fa55f4-2f35-48f6-846e-4376b54fbc53 tempest-VolumesExtendTest-525221970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.048s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:27:59 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-76fa55f4-2f35-48f6-846e-4376b54fbc53 tempest-VolumesExtendTest-525221970 None] Creating offline snapshot f96e3f63-12f9-4daa-af2f-9a79fa086bc5 of volume 852ed5d4-e013-48c1-81a2-6e8e4e5be272 {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:27:59 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6ca96d27-867d-42e8-a2be-79803dcbcffb tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c711411-2a4d-4a44-803c-022237f2143a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8225957-ebae-48d0-bcba-42f45fb27295', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:59 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6ca96d27-867d-42e8-a2be-79803dcbcffb tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10f84921-c325-4075-bcdd-baea17ae3b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:27:59 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-6ca96d27-867d-42e8-a2be-79803dcbcffb tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Volume volume-b8225957-ebae-48d0-bcba-42f45fb27295 (b8225957-ebae-48d0-bcba-42f45fb27295): created successfully Jul 16 23:27:59 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6ca96d27-867d-42e8-a2be-79803dcbcffb tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10f84921-c325-4075-bcdd-baea17ae3b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:27:59 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6ca96d27-867d-42e8-a2be-79803dcbcffb tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Flow 'volume_create_manager' (714684e5-5e81-48ef-8cb1-09585d47abc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:27:59 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70bc0fc-8a3b-493b-ada4-40d51311be66]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:27:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-76fa55f4-2f35-48f6-846e-4376b54fbc53 tempest-VolumesExtendTest-525221970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:27:59 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-6ca96d27-867d-42e8-a2be-79803dcbcffb tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Created volume successfully. Jul 16 23:27:59 devstack sudo[100919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272 Jul 16 23:27:59 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:00 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-76fa55f4-2f35-48f6-846e-4376b54fbc53 tempest-VolumesExtendTest-525221970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272" returned: 0 in 0.558s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-76fa55f4-2f35-48f6-846e-4376b54fbc53 tempest-VolumesExtendTest-525221970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272.f96e3f63-12f9-4daa-af2f-9a79fa086bc5 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:00 devstack sudo[100926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272.f96e3f63-12f9-4daa-af2f-9a79fa086bc5 1G Jul 16 23:28:00 devstack sudo[100926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:00 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-80a18d48-a4b0-43a1-bee5-29144b979a60 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:28:00 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-80a18d48-a4b0-43a1-bee5-29144b979a60 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Flow 'volume_create_manager' (a8243792-6a65-49c2-91a8-25b9f8dd1ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:28:00 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-80a18d48-a4b0-43a1-bee5-29144b979a60 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b62ce2b8-a63e-44d4-a56e-db82fa280b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:00 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-80a18d48-a4b0-43a1-bee5-29144b979a60 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b62ce2b8-a63e-44d4-a56e-db82fa280b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1210389794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87126b15-dd82-4644-b934-3abc18ce2681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8cf85c5b72b4a03bce87872cdf80f94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:28:01Z,use_quota=True,user_id='af15b89155e7472c9fb973f5742f79db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:00 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-80a18d48-a4b0-43a1-bee5-29144b979a60 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (915b05b0-121e-4a3a-a56b-ab20fe33a514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:00 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-80a18d48-a4b0-43a1-bee5-29144b979a60 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (915b05b0-121e-4a3a-a56b-ab20fe33a514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:00 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-80a18d48-a4b0-43a1-bee5-29144b979a60 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03ffd5b9-b7fc-4554-8b0f-c85317c393e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:00 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-80a18d48-a4b0-43a1-bee5-29144b979a60 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03ffd5b9-b7fc-4554-8b0f-c85317c393e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87126b15-dd82-4644-b934-3abc18ce2681', 'volume_name': 'volume-87126b15-dd82-4644-b934-3abc18ce2681', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:00 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-80a18d48-a4b0-43a1-bee5-29144b979a60 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (babef827-788f-4417-b975-c0571b16cbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:00 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-80a18d48-a4b0-43a1-bee5-29144b979a60 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (babef827-788f-4417-b975-c0571b16cbc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:00 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-80a18d48-a4b0-43a1-bee5-29144b979a60 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3349795f-747c-4290-ba19-065b9760be57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:00 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-80a18d48-a4b0-43a1-bee5-29144b979a60 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Volume 87126b15-dd82-4644-b934-3abc18ce2681: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87126b15-dd82-4644-b934-3abc18ce2681', 'volume_size': 1} Jul 16 23:28:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-80a18d48-a4b0-43a1-bee5-29144b979a60 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:01 devstack sudo[100926]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-76fa55f4-2f35-48f6-846e-4376b54fbc53 tempest-VolumesExtendTest-525221970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272.f96e3f63-12f9-4daa-af2f-9a79fa086bc5 1G" returned: 0 in 0.811s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-76fa55f4-2f35-48f6-846e-4376b54fbc53 tempest-VolumesExtendTest-525221970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272.f96e3f63-12f9-4daa-af2f-9a79fa086bc5 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:01 devstack sudo[100935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272.f96e3f63-12f9-4daa-af2f-9a79fa086bc5 Jul 16 23:28:01 devstack sudo[100935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:01 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-938dfabf-3560-4ad8-a1f0-88a200cf32f0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:28:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-938dfabf-3560-4ad8-a1f0-88a200cf32f0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Flow 'volume_create_manager' (80e8c9a3-47c7-46ab-81d3-15793934d6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:28:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-938dfabf-3560-4ad8-a1f0-88a200cf32f0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45d87d73-d448-4336-81c4-54ff10777133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-938dfabf-3560-4ad8-a1f0-88a200cf32f0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45d87d73-d448-4336-81c4-54ff10777133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-750312318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c406db7-5f3b-469b-9a4c-7e162504230c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8cf85c5b72b4a03bce87872cdf80f94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:28:01Z,use_quota=True,user_id='af15b89155e7472c9fb973f5742f79db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-938dfabf-3560-4ad8-a1f0-88a200cf32f0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2de4d302-f2fd-4932-8a12-490bcfc18f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-938dfabf-3560-4ad8-a1f0-88a200cf32f0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2de4d302-f2fd-4932-8a12-490bcfc18f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-938dfabf-3560-4ad8-a1f0-88a200cf32f0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcdc7ffd-dbb8-426e-a968-a3c0e9133485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-938dfabf-3560-4ad8-a1f0-88a200cf32f0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcdc7ffd-dbb8-426e-a968-a3c0e9133485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c406db7-5f3b-469b-9a4c-7e162504230c', 'volume_name': 'volume-7c406db7-5f3b-469b-9a4c-7e162504230c', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-938dfabf-3560-4ad8-a1f0-88a200cf32f0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d00dc5d-5dae-41a8-92fa-e46c5f1d82b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-938dfabf-3560-4ad8-a1f0-88a200cf32f0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d00dc5d-5dae-41a8-92fa-e46c5f1d82b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-938dfabf-3560-4ad8-a1f0-88a200cf32f0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41568a45-9b9d-4365-81b9-ece4aa0ab5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:01 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-938dfabf-3560-4ad8-a1f0-88a200cf32f0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Volume 7c406db7-5f3b-469b-9a4c-7e162504230c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c406db7-5f3b-469b-9a4c-7e162504230c', 'volume_size': 1} Jul 16 23:28:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-938dfabf-3560-4ad8-a1f0-88a200cf32f0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:01 devstack sudo[100935]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-76fa55f4-2f35-48f6-846e-4376b54fbc53 tempest-VolumesExtendTest-525221970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272.f96e3f63-12f9-4daa-af2f-9a79fa086bc5" returned: 0 in 0.606s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:01 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-76fa55f4-2f35-48f6-846e-4376b54fbc53 tempest-VolumesExtendTest-525221970 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272.f96e3f63-12f9-4daa-af2f-9a79fa086bc5 is being set with open permissions: ugo+rw Jul 16 23:28:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-76fa55f4-2f35-48f6-846e-4376b54fbc53 tempest-VolumesExtendTest-525221970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272.f96e3f63-12f9-4daa-af2f-9a79fa086bc5 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:01 devstack sudo[100943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272.f96e3f63-12f9-4daa-af2f-9a79fa086bc5 Jul 16 23:28:01 devstack sudo[100943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:02 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-51a2082f-fb98-4259-91f2-8e83e97bf86e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:28:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-51a2082f-fb98-4259-91f2-8e83e97bf86e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Flow 'volume_create_manager' (8ab28139-d1f2-444c-9eb9-a6e6fa347b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:28:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-51a2082f-fb98-4259-91f2-8e83e97bf86e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12ad9297-86d3-42d8-aa49-4127ae9bb6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:02 devstack sudo[100943]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-76fa55f4-2f35-48f6-846e-4376b54fbc53 tempest-VolumesExtendTest-525221970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272.f96e3f63-12f9-4daa-af2f-9a79fa086bc5" returned: 0 in 0.387s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-51a2082f-fb98-4259-91f2-8e83e97bf86e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12ad9297-86d3-42d8-aa49-4127ae9bb6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-493331092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=371ae0c9-6064-4a98-9666-14d58a92e6e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8cf85c5b72b4a03bce87872cdf80f94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:28:02Z,use_quota=True,user_id='af15b89155e7472c9fb973f5742f79db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-51a2082f-fb98-4259-91f2-8e83e97bf86e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc376252-a4e2-4d9b-ad91-7e43f0f07d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-51a2082f-fb98-4259-91f2-8e83e97bf86e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc376252-a4e2-4d9b-ad91-7e43f0f07d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-51a2082f-fb98-4259-91f2-8e83e97bf86e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8c3fa50-4e67-405b-a6ce-0f3fc7f2781e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-51a2082f-fb98-4259-91f2-8e83e97bf86e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8c3fa50-4e67-405b-a6ce-0f3fc7f2781e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '371ae0c9-6064-4a98-9666-14d58a92e6e6', 'volume_name': 'volume-371ae0c9-6064-4a98-9666-14d58a92e6e6', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-51a2082f-fb98-4259-91f2-8e83e97bf86e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bb32e9f-1409-4f3f-83c0-50c6254c20cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-51a2082f-fb98-4259-91f2-8e83e97bf86e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bb32e9f-1409-4f3f-83c0-50c6254c20cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-51a2082f-fb98-4259-91f2-8e83e97bf86e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47a345a2-15ef-4a0a-88c9-09e251a45500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:02 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-51a2082f-fb98-4259-91f2-8e83e97bf86e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Volume 371ae0c9-6064-4a98-9666-14d58a92e6e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-371ae0c9-6064-4a98-9666-14d58a92e6e6', 'volume_size': 1} Jul 16 23:28:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-51a2082f-fb98-4259-91f2-8e83e97bf86e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-76fa55f4-2f35-48f6-846e-4376b54fbc53 tempest-VolumesExtendTest-525221970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:02 devstack sudo[100946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272.info Jul 16 23:28:02 devstack sudo[100946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:02 devstack sudo[100946]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-76fa55f4-2f35-48f6-846e-4376b54fbc53 tempest-VolumesExtendTest-525221970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272.info" returned: 0 in 0.324s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:02 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-76fa55f4-2f35-48f6-846e-4376b54fbc53 tempest-VolumesExtendTest-525221970 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272.info is being set with open permissions: ugo+rw Jul 16 23:28:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-76fa55f4-2f35-48f6-846e-4376b54fbc53 tempest-VolumesExtendTest-525221970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:02 devstack sudo[100949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272.info Jul 16 23:28:02 devstack sudo[100949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:02 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1cd3063-eca7-4e0a-a0f2-9a0e539c53fe tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:28:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c1cd3063-eca7-4e0a-a0f2-9a0e539c53fe tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Flow 'volume_create_manager' (e7613a52-663d-45d4-abc2-840402fe7dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:28:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c1cd3063-eca7-4e0a-a0f2-9a0e539c53fe tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf03e7c8-3d15-4df7-aba1-9e430b972d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c1cd3063-eca7-4e0a-a0f2-9a0e539c53fe tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf03e7c8-3d15-4df7-aba1-9e430b972d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1652676935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a839a895-3eae-4b3d-844a-69f88498e86e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8cf85c5b72b4a03bce87872cdf80f94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:28:03Z,use_quota=True,user_id='af15b89155e7472c9fb973f5742f79db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c1cd3063-eca7-4e0a-a0f2-9a0e539c53fe tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c94417c1-5ea0-40cd-bf2b-e306872320a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c1cd3063-eca7-4e0a-a0f2-9a0e539c53fe tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c94417c1-5ea0-40cd-bf2b-e306872320a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c1cd3063-eca7-4e0a-a0f2-9a0e539c53fe tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ac0df5a-5db7-438c-9aa0-ee1ae6de7235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c1cd3063-eca7-4e0a-a0f2-9a0e539c53fe tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ac0df5a-5db7-438c-9aa0-ee1ae6de7235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a839a895-3eae-4b3d-844a-69f88498e86e', 'volume_name': 'volume-a839a895-3eae-4b3d-844a-69f88498e86e', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c1cd3063-eca7-4e0a-a0f2-9a0e539c53fe tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae6cb86a-ef4f-46be-814b-d0ca482d823e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c1cd3063-eca7-4e0a-a0f2-9a0e539c53fe tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae6cb86a-ef4f-46be-814b-d0ca482d823e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c1cd3063-eca7-4e0a-a0f2-9a0e539c53fe tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f83b8341-b68c-4b58-bb1b-de2b5a22c7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:02 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-c1cd3063-eca7-4e0a-a0f2-9a0e539c53fe tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Volume a839a895-3eae-4b3d-844a-69f88498e86e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a839a895-3eae-4b3d-844a-69f88498e86e', 'volume_size': 1} Jul 16 23:28:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c1cd3063-eca7-4e0a-a0f2-9a0e539c53fe tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:03 devstack sudo[100949]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-76fa55f4-2f35-48f6-846e-4376b54fbc53 tempest-VolumesExtendTest-525221970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272.info" returned: 0 in 0.471s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-76fa55f4-2f35-48f6-846e-4376b54fbc53 tempest-VolumesExtendTest-525221970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.355s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-80a18d48-a4b0-43a1-bee5-29144b979a60 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.239s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:03 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-80a18d48-a4b0-43a1-bee5-29144b979a60 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1210389794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87126b15-dd82-4644-b934-3abc18ce2681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8cf85c5b72b4a03bce87872cdf80f94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:28:01Z,use_quota=True,user_id='af15b89155e7472c9fb973f5742f79db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:28:03 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-80a18d48-a4b0-43a1-bee5-29144b979a60 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Creating volume 87126b15-dd82-4644-b934-3abc18ce2681 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:28:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-80a18d48-a4b0-43a1-bee5-29144b979a60 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-80a18d48-a4b0-43a1-bee5-29144b979a60 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:03 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-80a18d48-a4b0-43a1-bee5-29144b979a60 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:28:03 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-80a18d48-a4b0-43a1-bee5-29144b979a60 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:28:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-80a18d48-a4b0-43a1-bee5-29144b979a60 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:03 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-80a18d48-a4b0-43a1-bee5-29144b979a60 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:28:03 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-80a18d48-a4b0-43a1-bee5-29144b979a60 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:28:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-80a18d48-a4b0-43a1-bee5-29144b979a60 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87126b15-dd82-4644-b934-3abc18ce2681 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:03 devstack sudo[100952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87126b15-dd82-4644-b934-3abc18ce2681 1073741824 Jul 16 23:28:03 devstack sudo[100952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:03 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-76fa55f4-2f35-48f6-846e-4376b54fbc53 tempest-VolumesExtendTest-525221970 None] Create snapshot completed successfully Jul 16 23:28:03 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-19d21733-cbb1-41d7-8931-aaea04d22082 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:28:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-19d21733-cbb1-41d7-8931-aaea04d22082 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Flow 'volume_create_manager' (aa59e584-c63c-4908-ac9d-f60157565c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:28:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-19d21733-cbb1-41d7-8931-aaea04d22082 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e622125f-7ed2-4829-beeb-5157d1e2f00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-19d21733-cbb1-41d7-8931-aaea04d22082 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e622125f-7ed2-4829-beeb-5157d1e2f00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1992042590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b4c47b8-0dc4-4bab-acf6-a7ef2be7ab6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8cf85c5b72b4a03bce87872cdf80f94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:28:03Z,use_quota=True,user_id='af15b89155e7472c9fb973f5742f79db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-19d21733-cbb1-41d7-8931-aaea04d22082 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e942cca-c54b-4c3c-9c42-1b86c9dd93a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-19d21733-cbb1-41d7-8931-aaea04d22082 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e942cca-c54b-4c3c-9c42-1b86c9dd93a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-19d21733-cbb1-41d7-8931-aaea04d22082 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a88c46b-0fb1-43b4-83c1-079ea0aea2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-19d21733-cbb1-41d7-8931-aaea04d22082 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a88c46b-0fb1-43b4-83c1-079ea0aea2fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b4c47b8-0dc4-4bab-acf6-a7ef2be7ab6e', 'volume_name': 'volume-8b4c47b8-0dc4-4bab-acf6-a7ef2be7ab6e', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-19d21733-cbb1-41d7-8931-aaea04d22082 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4244072e-1fb4-4eb0-92ec-a4bf8ff3131e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-19d21733-cbb1-41d7-8931-aaea04d22082 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4244072e-1fb4-4eb0-92ec-a4bf8ff3131e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-19d21733-cbb1-41d7-8931-aaea04d22082 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a8df531-d4f1-4fd8-912a-cc0d888a1cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:03 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-19d21733-cbb1-41d7-8931-aaea04d22082 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Volume 8b4c47b8-0dc4-4bab-acf6-a7ef2be7ab6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b4c47b8-0dc4-4bab-acf6-a7ef2be7ab6e', 'volume_size': 1} Jul 16 23:28:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-19d21733-cbb1-41d7-8931-aaea04d22082 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:03 devstack sudo[100952]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-80a18d48-a4b0-43a1-bee5-29144b979a60 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87126b15-dd82-4644-b934-3abc18ce2681 1073741824" returned: 0 in 0.629s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-80a18d48-a4b0-43a1-bee5-29144b979a60 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87126b15-dd82-4644-b934-3abc18ce2681 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:03 devstack sudo[100958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87126b15-dd82-4644-b934-3abc18ce2681 Jul 16 23:28:03 devstack sudo[100958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:03 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-2322a17b-57e7-4e4b-b052-181b000b684b tempest-TestServerVolumeAttachmentScenario-804454518 None] Acquiring lock "cinder-d1b33387-8a97-4ddb-999a-f311261152c9-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:28:03 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-2322a17b-57e7-4e4b-b052-181b000b684b tempest-TestServerVolumeAttachmentScenario-804454518 None] Lock "cinder-d1b33387-8a97-4ddb-999a-f311261152c9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:28:03 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0b89c339-cf16-4f0a-bac1-b6d67af948f1 tempest-AttachVolumeNegativeTest-552460454 None] Acquiring lock "cinder-611bd503-5986-483f-b836-1c35f573004b-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:28:03 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-2322a17b-57e7-4e4b-b052-181b000b684b tempest-TestServerVolumeAttachmentScenario-804454518 None] Acquiring lock "cinder-quobyte-d1b33387-8a97-4ddb-999a-f311261152c9" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0b89c339-cf16-4f0a-bac1-b6d67af948f1 tempest-AttachVolumeNegativeTest-552460454 None] Lock "cinder-611bd503-5986-483f-b836-1c35f573004b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-2322a17b-57e7-4e4b-b052-181b000b684b tempest-TestServerVolumeAttachmentScenario-804454518 None] Lock "cinder-quobyte-d1b33387-8a97-4ddb-999a-f311261152c9" acquired by "delete_volume" :: waited 0.035s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45b4e77-d347-4e63-888b-29d14b4f1ab6]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2322a17b-57e7-4e4b-b052-181b000b684b tempest-TestServerVolumeAttachmentScenario-804454518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d1b33387-8a97-4ddb-999a-f311261152c9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:04 devstack sudo[100958]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-80a18d48-a4b0-43a1-bee5-29144b979a60 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87126b15-dd82-4644-b934-3abc18ce2681" returned: 0 in 0.338s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-80a18d48-a4b0-43a1-bee5-29144b979a60 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-80a18d48-a4b0-43a1-bee5-29144b979a60 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-938dfabf-3560-4ad8-a1f0-88a200cf32f0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.363s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-938dfabf-3560-4ad8-a1f0-88a200cf32f0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-750312318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c406db7-5f3b-469b-9a4c-7e162504230c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8cf85c5b72b4a03bce87872cdf80f94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:28:01Z,use_quota=True,user_id='af15b89155e7472c9fb973f5742f79db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-938dfabf-3560-4ad8-a1f0-88a200cf32f0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Creating volume 7c406db7-5f3b-469b-9a4c-7e162504230c {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-938dfabf-3560-4ad8-a1f0-88a200cf32f0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-938dfabf-3560-4ad8-a1f0-88a200cf32f0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-938dfabf-3560-4ad8-a1f0-88a200cf32f0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-938dfabf-3560-4ad8-a1f0-88a200cf32f0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-938dfabf-3560-4ad8-a1f0-88a200cf32f0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-938dfabf-3560-4ad8-a1f0-88a200cf32f0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:28:04 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-938dfabf-3560-4ad8-a1f0-88a200cf32f0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-938dfabf-3560-4ad8-a1f0-88a200cf32f0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7c406db7-5f3b-469b-9a4c-7e162504230c 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e0332894-6025-47a9-a79c-7b3fd3b9debc tempest-VolumesExtendTest-525221970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:04 devstack sudo[100962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7c406db7-5f3b-469b-9a4c-7e162504230c 1073741824 Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-80a18d48-a4b0-43a1-bee5-29144b979a60 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3349795f-747c-4290-ba19-065b9760be57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87126b15-dd82-4644-b934-3abc18ce2681', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:04 devstack sudo[100962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-80a18d48-a4b0-43a1-bee5-29144b979a60 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83bab501-ccbe-481c-8e47-361cd0cdfd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0b89c339-cf16-4f0a-bac1-b6d67af948f1 tempest-AttachVolumeNegativeTest-552460454 None] Acquiring lock "cinder-quobyte-611bd503-5986-483f-b836-1c35f573004b" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:28:04 devstack sudo[100961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d1b33387-8a97-4ddb-999a-f311261152c9 Jul 16 23:28:04 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-80a18d48-a4b0-43a1-bee5-29144b979a60 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Volume volume-87126b15-dd82-4644-b934-3abc18ce2681 (87126b15-dd82-4644-b934-3abc18ce2681): created successfully Jul 16 23:28:04 devstack sudo[100961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-80a18d48-a4b0-43a1-bee5-29144b979a60 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83bab501-ccbe-481c-8e47-361cd0cdfd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-80a18d48-a4b0-43a1-bee5-29144b979a60 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Flow 'volume_create_manager' (a8243792-6a65-49c2-91a8-25b9f8dd1ef4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0b89c339-cf16-4f0a-bac1-b6d67af948f1 tempest-AttachVolumeNegativeTest-552460454 None] Lock "cinder-quobyte-611bd503-5986-483f-b836-1c35f573004b" acquired by "delete_volume" :: waited 0.035s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:28:04 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-80a18d48-a4b0-43a1-bee5-29144b979a60 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Created volume successfully. Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc12d81f-75ec-4bf4-9d75-faa0c5f50147]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0b89c339-cf16-4f0a-bac1-b6d67af948f1 tempest-AttachVolumeNegativeTest-552460454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-611bd503-5986-483f-b836-1c35f573004b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:04 devstack sudo[100965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-611bd503-5986-483f-b836-1c35f573004b Jul 16 23:28:04 devstack sudo[100965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:04 devstack sudo[100961]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2322a17b-57e7-4e4b-b052-181b000b684b tempest-TestServerVolumeAttachmentScenario-804454518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d1b33387-8a97-4ddb-999a-f311261152c9" returned: 0 in 0.410s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2322a17b-57e7-4e4b-b052-181b000b684b tempest-TestServerVolumeAttachmentScenario-804454518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d1b33387-8a97-4ddb-999a-f311261152c9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:04 devstack sudo[100974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d1b33387-8a97-4ddb-999a-f311261152c9 Jul 16 23:28:04 devstack sudo[100974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:04 devstack sudo[100962]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-938dfabf-3560-4ad8-a1f0-88a200cf32f0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7c406db7-5f3b-469b-9a4c-7e162504230c 1073741824" returned: 0 in 0.488s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-938dfabf-3560-4ad8-a1f0-88a200cf32f0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7c406db7-5f3b-469b-9a4c-7e162504230c {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:04 devstack sudo[100979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7c406db7-5f3b-469b-9a4c-7e162504230c Jul 16 23:28:04 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:04 devstack sudo[100965]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0b89c339-cf16-4f0a-bac1-b6d67af948f1 tempest-AttachVolumeNegativeTest-552460454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-611bd503-5986-483f-b836-1c35f573004b" returned: 0 in 0.471s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0b89c339-cf16-4f0a-bac1-b6d67af948f1 tempest-AttachVolumeNegativeTest-552460454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-611bd503-5986-483f-b836-1c35f573004b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:04 devstack sudo[100974]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2322a17b-57e7-4e4b-b052-181b000b684b tempest-TestServerVolumeAttachmentScenario-804454518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d1b33387-8a97-4ddb-999a-f311261152c9" returned: 0 in 0.276s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:04 devstack sudo[100983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-611bd503-5986-483f-b836-1c35f573004b Jul 16 23:28:04 devstack sudo[100983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-2322a17b-57e7-4e4b-b052-181b000b684b tempest-TestServerVolumeAttachmentScenario-804454518 None] Lock "cinder-quobyte-d1b33387-8a97-4ddb-999a-f311261152c9" released by "delete_volume" :: held 0.753s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-2322a17b-57e7-4e4b-b052-181b000b684b tempest-TestServerVolumeAttachmentScenario-804454518 None] Created reservations ['8a076a38-d524-45fb-a659-f1575560dfac', '7dab5e8c-00cd-4217-a965-2cd9febf9e29', 'fbc90049-8281-4aa7-91c4-ffb6e2ff8c51', '3807c59e-952e-47c6-9156-0ac66109217a'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-2322a17b-57e7-4e4b-b052-181b000b684b tempest-TestServerVolumeAttachmentScenario-804454518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-2322a17b-57e7-4e4b-b052-181b000b684b tempest-TestServerVolumeAttachmentScenario-804454518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-2322a17b-57e7-4e4b-b052-181b000b684b tempest-TestServerVolumeAttachmentScenario-804454518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-2322a17b-57e7-4e4b-b052-181b000b684b tempest-TestServerVolumeAttachmentScenario-804454518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-2322a17b-57e7-4e4b-b052-181b000b684b tempest-TestServerVolumeAttachmentScenario-804454518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2322a17b-57e7-4e4b-b052-181b000b684b tempest-TestServerVolumeAttachmentScenario-804454518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:04 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-938dfabf-3560-4ad8-a1f0-88a200cf32f0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7c406db7-5f3b-469b-9a4c-7e162504230c" returned: 0 in 0.266s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-938dfabf-3560-4ad8-a1f0-88a200cf32f0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-938dfabf-3560-4ad8-a1f0-88a200cf32f0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:04 devstack sudo[100986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:28:04 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-51a2082f-fb98-4259-91f2-8e83e97bf86e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.743s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-51a2082f-fb98-4259-91f2-8e83e97bf86e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-493331092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=371ae0c9-6064-4a98-9666-14d58a92e6e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8cf85c5b72b4a03bce87872cdf80f94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:28:02Z,use_quota=True,user_id='af15b89155e7472c9fb973f5742f79db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-51a2082f-fb98-4259-91f2-8e83e97bf86e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Creating volume 371ae0c9-6064-4a98-9666-14d58a92e6e6 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-51a2082f-fb98-4259-91f2-8e83e97bf86e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-51a2082f-fb98-4259-91f2-8e83e97bf86e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-51a2082f-fb98-4259-91f2-8e83e97bf86e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-51a2082f-fb98-4259-91f2-8e83e97bf86e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-51a2082f-fb98-4259-91f2-8e83e97bf86e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-51a2082f-fb98-4259-91f2-8e83e97bf86e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:28:04 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-51a2082f-fb98-4259-91f2-8e83e97bf86e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-51a2082f-fb98-4259-91f2-8e83e97bf86e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-371ae0c9-6064-4a98-9666-14d58a92e6e6 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:04 devstack sudo[100989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-371ae0c9-6064-4a98-9666-14d58a92e6e6 1073741824 Jul 16 23:28:04 devstack sudo[100989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-938dfabf-3560-4ad8-a1f0-88a200cf32f0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41568a45-9b9d-4365-81b9-ece4aa0ab5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c406db7-5f3b-469b-9a4c-7e162504230c', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-938dfabf-3560-4ad8-a1f0-88a200cf32f0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8df1f375-da20-4a6e-a89c-2144a48a500a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:04 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-938dfabf-3560-4ad8-a1f0-88a200cf32f0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Volume volume-7c406db7-5f3b-469b-9a4c-7e162504230c (7c406db7-5f3b-469b-9a4c-7e162504230c): created successfully Jul 16 23:28:04 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-938dfabf-3560-4ad8-a1f0-88a200cf32f0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8df1f375-da20-4a6e-a89c-2144a48a500a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-938dfabf-3560-4ad8-a1f0-88a200cf32f0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Flow 'volume_create_manager' (80e8c9a3-47c7-46ab-81d3-15793934d6ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:28:05 devstack sudo[100983]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0b89c339-cf16-4f0a-bac1-b6d67af948f1 tempest-AttachVolumeNegativeTest-552460454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-611bd503-5986-483f-b836-1c35f573004b" returned: 0 in 0.282s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:05 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-938dfabf-3560-4ad8-a1f0-88a200cf32f0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Created volume successfully. Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0b89c339-cf16-4f0a-bac1-b6d67af948f1 tempest-AttachVolumeNegativeTest-552460454 None] Lock "cinder-quobyte-611bd503-5986-483f-b836-1c35f573004b" released by "delete_volume" :: held 0.816s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-0b89c339-cf16-4f0a-bac1-b6d67af948f1 tempest-AttachVolumeNegativeTest-552460454 None] Created reservations ['04ef4e97-bf1c-43ff-8541-14906b2a16a6', 'cb043d12-8fac-4456-b742-855e6d4ad815', '2a5ffb69-c14d-4c6a-b686-46d0aa73d8fe', 'c48401be-f523-4fc1-97d5-ef6cba0054de'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-008c87cc-e68b-4871-9803-8c6c6ff34ea9 tempest-TestServerVolumeAttachmentScenario-804454518 None] Acquiring lock "cinder-39c6db99-44f2-4ff9-a41f-f71a70725211-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-008c87cc-e68b-4871-9803-8c6c6ff34ea9 tempest-TestServerVolumeAttachmentScenario-804454518 None] Lock "cinder-39c6db99-44f2-4ff9-a41f-f71a70725211-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:28:05 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2322a17b-57e7-4e4b-b052-181b000b684b tempest-TestServerVolumeAttachmentScenario-804454518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.346s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-2322a17b-57e7-4e4b-b052-181b000b684b tempest-TestServerVolumeAttachmentScenario-804454518 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:28:05 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-2322a17b-57e7-4e4b-b052-181b000b684b tempest-TestServerVolumeAttachmentScenario-804454518 None] Deleted volume successfully. Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0b89c339-cf16-4f0a-bac1-b6d67af948f1 tempest-AttachVolumeNegativeTest-552460454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0b89c339-cf16-4f0a-bac1-b6d67af948f1 tempest-AttachVolumeNegativeTest-552460454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0b89c339-cf16-4f0a-bac1-b6d67af948f1 tempest-AttachVolumeNegativeTest-552460454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0b89c339-cf16-4f0a-bac1-b6d67af948f1 tempest-AttachVolumeNegativeTest-552460454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0b89c339-cf16-4f0a-bac1-b6d67af948f1 tempest-AttachVolumeNegativeTest-552460454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0b89c339-cf16-4f0a-bac1-b6d67af948f1 tempest-AttachVolumeNegativeTest-552460454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-008c87cc-e68b-4871-9803-8c6c6ff34ea9 tempest-TestServerVolumeAttachmentScenario-804454518 None] Acquiring lock "cinder-quobyte-39c6db99-44f2-4ff9-a41f-f71a70725211" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:28:05 devstack sudo[100995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:28:05 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-2322a17b-57e7-4e4b-b052-181b000b684b tempest-TestServerVolumeAttachmentScenario-804454518 None] Lock "cinder-d1b33387-8a97-4ddb-999a-f311261152c9-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-008c87cc-e68b-4871-9803-8c6c6ff34ea9 tempest-TestServerVolumeAttachmentScenario-804454518 None] Lock "cinder-quobyte-39c6db99-44f2-4ff9-a41f-f71a70725211" acquired by "delete_volume" :: waited 0.025s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[875c8e00-43d9-4a75-b194-e2f936709c07]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-008c87cc-e68b-4871-9803-8c6c6ff34ea9 tempest-TestServerVolumeAttachmentScenario-804454518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-39c6db99-44f2-4ff9-a41f-f71a70725211 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6584e2d8-60d5-4725-aedd-aa2e2083442a tempest-AttachVolumeNegativeTest-552460454 None] Acquiring lock "cinder-47dceee9-6c81-49c4-9c1c-0609c5c82f23-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6584e2d8-60d5-4725-aedd-aa2e2083442a tempest-AttachVolumeNegativeTest-552460454 None] Lock "cinder-47dceee9-6c81-49c4-9c1c-0609c5c82f23-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:28:05 devstack sudo[100998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-39c6db99-44f2-4ff9-a41f-f71a70725211 Jul 16 23:28:05 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6584e2d8-60d5-4725-aedd-aa2e2083442a tempest-AttachVolumeNegativeTest-552460454 None] Acquiring lock "cinder-quobyte-47dceee9-6c81-49c4-9c1c-0609c5c82f23" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6584e2d8-60d5-4725-aedd-aa2e2083442a tempest-AttachVolumeNegativeTest-552460454 None] Lock "cinder-quobyte-47dceee9-6c81-49c4-9c1c-0609c5c82f23" acquired by "delete_volume" :: waited 0.034s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:28:05 devstack sudo[100989]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-51a2082f-fb98-4259-91f2-8e83e97bf86e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-371ae0c9-6064-4a98-9666-14d58a92e6e6 1073741824" returned: 0 in 0.647s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e762f1c-bef7-43f3-b3d9-69c65b572ffa]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6584e2d8-60d5-4725-aedd-aa2e2083442a tempest-AttachVolumeNegativeTest-552460454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-47dceee9-6c81-49c4-9c1c-0609c5c82f23 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-51a2082f-fb98-4259-91f2-8e83e97bf86e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-371ae0c9-6064-4a98-9666-14d58a92e6e6 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:05 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0b89c339-cf16-4f0a-bac1-b6d67af948f1 tempest-AttachVolumeNegativeTest-552460454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.374s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-0b89c339-cf16-4f0a-bac1-b6d67af948f1 tempest-AttachVolumeNegativeTest-552460454 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:28:05 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-0b89c339-cf16-4f0a-bac1-b6d67af948f1 tempest-AttachVolumeNegativeTest-552460454 None] Deleted volume successfully. Jul 16 23:28:05 devstack sudo[101002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-371ae0c9-6064-4a98-9666-14d58a92e6e6 Jul 16 23:28:05 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0b89c339-cf16-4f0a-bac1-b6d67af948f1 tempest-AttachVolumeNegativeTest-552460454 None] Lock "cinder-611bd503-5986-483f-b836-1c35f573004b-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:28:05 devstack sudo[101001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-47dceee9-6c81-49c4-9c1c-0609c5c82f23 Jul 16 23:28:05 devstack sudo[101001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:05 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-008c87cc-e68b-4871-9803-8c6c6ff34ea9 tempest-TestServerVolumeAttachmentScenario-804454518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-39c6db99-44f2-4ff9-a41f-f71a70725211" returned: 0 in 0.468s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-008c87cc-e68b-4871-9803-8c6c6ff34ea9 tempest-TestServerVolumeAttachmentScenario-804454518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-39c6db99-44f2-4ff9-a41f-f71a70725211 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:05 devstack sudo[101008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-39c6db99-44f2-4ff9-a41f-f71a70725211 Jul 16 23:28:05 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:05 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-51a2082f-fb98-4259-91f2-8e83e97bf86e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-371ae0c9-6064-4a98-9666-14d58a92e6e6" returned: 0 in 0.283s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-51a2082f-fb98-4259-91f2-8e83e97bf86e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-51a2082f-fb98-4259-91f2-8e83e97bf86e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c1cd3063-eca7-4e0a-a0f2-9a0e539c53fe tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.088s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-c1cd3063-eca7-4e0a-a0f2-9a0e539c53fe tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1652676935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a839a895-3eae-4b3d-844a-69f88498e86e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8cf85c5b72b4a03bce87872cdf80f94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:28:03Z,use_quota=True,user_id='af15b89155e7472c9fb973f5742f79db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-c1cd3063-eca7-4e0a-a0f2-9a0e539c53fe tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Creating volume a839a895-3eae-4b3d-844a-69f88498e86e {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c1cd3063-eca7-4e0a-a0f2-9a0e539c53fe tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c1cd3063-eca7-4e0a-a0f2-9a0e539c53fe tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-c1cd3063-eca7-4e0a-a0f2-9a0e539c53fe tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-c1cd3063-eca7-4e0a-a0f2-9a0e539c53fe tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c1cd3063-eca7-4e0a-a0f2-9a0e539c53fe tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-c1cd3063-eca7-4e0a-a0f2-9a0e539c53fe tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:28:05 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-c1cd3063-eca7-4e0a-a0f2-9a0e539c53fe tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c1cd3063-eca7-4e0a-a0f2-9a0e539c53fe tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a839a895-3eae-4b3d-844a-69f88498e86e 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-51a2082f-fb98-4259-91f2-8e83e97bf86e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47a345a2-15ef-4a0a-88c9-09e251a45500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-371ae0c9-6064-4a98-9666-14d58a92e6e6', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:05 devstack sudo[101011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a839a895-3eae-4b3d-844a-69f88498e86e 1073741824 Jul 16 23:28:05 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-51a2082f-fb98-4259-91f2-8e83e97bf86e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fa1207d-ed5a-40e2-93d2-4a678186d1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:05 devstack sudo[101011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:06 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-51a2082f-fb98-4259-91f2-8e83e97bf86e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Volume volume-371ae0c9-6064-4a98-9666-14d58a92e6e6 (371ae0c9-6064-4a98-9666-14d58a92e6e6): created successfully Jul 16 23:28:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-51a2082f-fb98-4259-91f2-8e83e97bf86e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fa1207d-ed5a-40e2-93d2-4a678186d1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-51a2082f-fb98-4259-91f2-8e83e97bf86e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Flow 'volume_create_manager' (8ab28139-d1f2-444c-9eb9-a6e6fa347b0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:28:06 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-51a2082f-fb98-4259-91f2-8e83e97bf86e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Created volume successfully. Jul 16 23:28:06 devstack sudo[101001]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6584e2d8-60d5-4725-aedd-aa2e2083442a tempest-AttachVolumeNegativeTest-552460454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-47dceee9-6c81-49c4-9c1c-0609c5c82f23" returned: 0 in 0.457s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6584e2d8-60d5-4725-aedd-aa2e2083442a tempest-AttachVolumeNegativeTest-552460454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-47dceee9-6c81-49c4-9c1c-0609c5c82f23 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:06 devstack sudo[101016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-47dceee9-6c81-49c4-9c1c-0609c5c82f23 Jul 16 23:28:06 devstack sudo[101016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:06 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-008c87cc-e68b-4871-9803-8c6c6ff34ea9 tempest-TestServerVolumeAttachmentScenario-804454518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-39c6db99-44f2-4ff9-a41f-f71a70725211" returned: 0 in 0.289s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:06 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-008c87cc-e68b-4871-9803-8c6c6ff34ea9 tempest-TestServerVolumeAttachmentScenario-804454518 None] Lock "cinder-quobyte-39c6db99-44f2-4ff9-a41f-f71a70725211" released by "delete_volume" :: held 0.805s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:28:06 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-008c87cc-e68b-4871-9803-8c6c6ff34ea9 tempest-TestServerVolumeAttachmentScenario-804454518 None] Created reservations ['7e84bdf3-c642-447a-8a59-99e066c5fbcf', 'eec33462-e66f-4285-995f-4d07fc025597', '954b436f-7fad-4c5a-b44e-1c62882f8a46', '1d5548c6-0d35-4c02-8e92-bdf38d23f594'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:28:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-008c87cc-e68b-4871-9803-8c6c6ff34ea9 tempest-TestServerVolumeAttachmentScenario-804454518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-008c87cc-e68b-4871-9803-8c6c6ff34ea9 tempest-TestServerVolumeAttachmentScenario-804454518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-008c87cc-e68b-4871-9803-8c6c6ff34ea9 tempest-TestServerVolumeAttachmentScenario-804454518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:28:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-008c87cc-e68b-4871-9803-8c6c6ff34ea9 tempest-TestServerVolumeAttachmentScenario-804454518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:28:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-008c87cc-e68b-4871-9803-8c6c6ff34ea9 tempest-TestServerVolumeAttachmentScenario-804454518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-008c87cc-e68b-4871-9803-8c6c6ff34ea9 tempest-TestServerVolumeAttachmentScenario-804454518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:06 devstack sudo[101022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:28:06 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:06 devstack sudo[101016]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6584e2d8-60d5-4725-aedd-aa2e2083442a tempest-AttachVolumeNegativeTest-552460454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-47dceee9-6c81-49c4-9c1c-0609c5c82f23" returned: 0 in 0.320s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:06 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6584e2d8-60d5-4725-aedd-aa2e2083442a tempest-AttachVolumeNegativeTest-552460454 None] Lock "cinder-quobyte-47dceee9-6c81-49c4-9c1c-0609c5c82f23" released by "delete_volume" :: held 0.832s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:28:06 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-6584e2d8-60d5-4725-aedd-aa2e2083442a tempest-AttachVolumeNegativeTest-552460454 None] Created reservations ['7a6848dd-4a29-4560-967d-2522ac3dc6ef', '5951bdf2-4d96-413a-b8e5-b512c43d738b', 'bb6de7b2-107a-4cac-b01d-6ad421607210', '5dd65c0a-82a6-4104-b39f-b19bc93a5391'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:28:06 devstack sudo[101011]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c1cd3063-eca7-4e0a-a0f2-9a0e539c53fe tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a839a895-3eae-4b3d-844a-69f88498e86e 1073741824" returned: 0 in 0.541s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c1cd3063-eca7-4e0a-a0f2-9a0e539c53fe tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a839a895-3eae-4b3d-844a-69f88498e86e {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:06 devstack sudo[101026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a839a895-3eae-4b3d-844a-69f88498e86e Jul 16 23:28:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6584e2d8-60d5-4725-aedd-aa2e2083442a tempest-AttachVolumeNegativeTest-552460454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:06 devstack sudo[101026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6584e2d8-60d5-4725-aedd-aa2e2083442a tempest-AttachVolumeNegativeTest-552460454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-6584e2d8-60d5-4725-aedd-aa2e2083442a tempest-AttachVolumeNegativeTest-552460454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:28:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-6584e2d8-60d5-4725-aedd-aa2e2083442a tempest-AttachVolumeNegativeTest-552460454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:28:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6584e2d8-60d5-4725-aedd-aa2e2083442a tempest-AttachVolumeNegativeTest-552460454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6584e2d8-60d5-4725-aedd-aa2e2083442a tempest-AttachVolumeNegativeTest-552460454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:06 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-008c87cc-e68b-4871-9803-8c6c6ff34ea9 tempest-TestServerVolumeAttachmentScenario-804454518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.392s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:06 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-008c87cc-e68b-4871-9803-8c6c6ff34ea9 tempest-TestServerVolumeAttachmentScenario-804454518 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:28:06 devstack sudo[101029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:28:06 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-008c87cc-e68b-4871-9803-8c6c6ff34ea9 tempest-TestServerVolumeAttachmentScenario-804454518 None] Deleted volume successfully. Jul 16 23:28:06 devstack sudo[101029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:06 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-008c87cc-e68b-4871-9803-8c6c6ff34ea9 tempest-TestServerVolumeAttachmentScenario-804454518 None] Lock "cinder-39c6db99-44f2-4ff9-a41f-f71a70725211-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:28:06 devstack sudo[101026]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c1cd3063-eca7-4e0a-a0f2-9a0e539c53fe tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a839a895-3eae-4b3d-844a-69f88498e86e" returned: 0 in 0.386s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-c1cd3063-eca7-4e0a-a0f2-9a0e539c53fe tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:28:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c1cd3063-eca7-4e0a-a0f2-9a0e539c53fe tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-19d21733-cbb1-41d7-8931-aaea04d22082 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.390s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-19d21733-cbb1-41d7-8931-aaea04d22082 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1992042590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b4c47b8-0dc4-4bab-acf6-a7ef2be7ab6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8cf85c5b72b4a03bce87872cdf80f94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:28:03Z,use_quota=True,user_id='af15b89155e7472c9fb973f5742f79db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:28:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-19d21733-cbb1-41d7-8931-aaea04d22082 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Creating volume 8b4c47b8-0dc4-4bab-acf6-a7ef2be7ab6e {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:28:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-19d21733-cbb1-41d7-8931-aaea04d22082 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-19d21733-cbb1-41d7-8931-aaea04d22082 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-19d21733-cbb1-41d7-8931-aaea04d22082 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:28:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-19d21733-cbb1-41d7-8931-aaea04d22082 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:28:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-19d21733-cbb1-41d7-8931-aaea04d22082 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-19d21733-cbb1-41d7-8931-aaea04d22082 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:28:06 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-19d21733-cbb1-41d7-8931-aaea04d22082 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:28:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-19d21733-cbb1-41d7-8931-aaea04d22082 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8b4c47b8-0dc4-4bab-acf6-a7ef2be7ab6e 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:06 devstack sudo[101029]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:07 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-427ae7cc-f55c-4e24-aee7-c3c9cd93f790 tempest-AttachVolumeNegativeTest-552460454 None] Acquiring lock "cinder-68a4212d-4fba-457b-8ca3-eb2ba7261b7f-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:28:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6584e2d8-60d5-4725-aedd-aa2e2083442a tempest-AttachVolumeNegativeTest-552460454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.369s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:07 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-6584e2d8-60d5-4725-aedd-aa2e2083442a tempest-AttachVolumeNegativeTest-552460454 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:28:07 devstack sudo[101033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8b4c47b8-0dc4-4bab-acf6-a7ef2be7ab6e 1073741824 Jul 16 23:28:07 devstack sudo[101033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c1cd3063-eca7-4e0a-a0f2-9a0e539c53fe tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f83b8341-b68c-4b58-bb1b-de2b5a22c7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a839a895-3eae-4b3d-844a-69f88498e86e', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c1cd3063-eca7-4e0a-a0f2-9a0e539c53fe tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbebd661-e6b9-43b9-93ac-81672c0935e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:07 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-427ae7cc-f55c-4e24-aee7-c3c9cd93f790 tempest-AttachVolumeNegativeTest-552460454 None] Lock "cinder-68a4212d-4fba-457b-8ca3-eb2ba7261b7f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:28:07 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-6584e2d8-60d5-4725-aedd-aa2e2083442a tempest-AttachVolumeNegativeTest-552460454 None] Deleted volume successfully. Jul 16 23:28:07 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-c1cd3063-eca7-4e0a-a0f2-9a0e539c53fe tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Volume volume-a839a895-3eae-4b3d-844a-69f88498e86e (a839a895-3eae-4b3d-844a-69f88498e86e): created successfully Jul 16 23:28:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c1cd3063-eca7-4e0a-a0f2-9a0e539c53fe tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbebd661-e6b9-43b9-93ac-81672c0935e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c1cd3063-eca7-4e0a-a0f2-9a0e539c53fe tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Flow 'volume_create_manager' (e7613a52-663d-45d4-abc2-840402fe7dd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:28:07 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6584e2d8-60d5-4725-aedd-aa2e2083442a tempest-AttachVolumeNegativeTest-552460454 None] Lock "cinder-47dceee9-6c81-49c4-9c1c-0609c5c82f23-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:28:07 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-c1cd3063-eca7-4e0a-a0f2-9a0e539c53fe tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Created volume successfully. Jul 16 23:28:07 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-427ae7cc-f55c-4e24-aee7-c3c9cd93f790 tempest-AttachVolumeNegativeTest-552460454 None] Acquiring lock "cinder-quobyte-68a4212d-4fba-457b-8ca3-eb2ba7261b7f" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:28:07 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-427ae7cc-f55c-4e24-aee7-c3c9cd93f790 tempest-AttachVolumeNegativeTest-552460454 None] Lock "cinder-quobyte-68a4212d-4fba-457b-8ca3-eb2ba7261b7f" acquired by "delete_volume" :: waited 0.020s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:28:07 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9dafde2-72a5-4aba-8245-83caf0311461]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:28:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-427ae7cc-f55c-4e24-aee7-c3c9cd93f790 tempest-AttachVolumeNegativeTest-552460454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-68a4212d-4fba-457b-8ca3-eb2ba7261b7f {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:07 devstack sudo[101035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-68a4212d-4fba-457b-8ca3-eb2ba7261b7f Jul 16 23:28:07 devstack sudo[101035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:07 devstack sudo[101033]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-19d21733-cbb1-41d7-8931-aaea04d22082 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8b4c47b8-0dc4-4bab-acf6-a7ef2be7ab6e 1073741824" returned: 0 in 0.554s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-19d21733-cbb1-41d7-8931-aaea04d22082 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8b4c47b8-0dc4-4bab-acf6-a7ef2be7ab6e {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:07 devstack sudo[101044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8b4c47b8-0dc4-4bab-acf6-a7ef2be7ab6e Jul 16 23:28:07 devstack sudo[101044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:07 devstack sudo[101035]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-427ae7cc-f55c-4e24-aee7-c3c9cd93f790 tempest-AttachVolumeNegativeTest-552460454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-68a4212d-4fba-457b-8ca3-eb2ba7261b7f" returned: 0 in 0.446s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-427ae7cc-f55c-4e24-aee7-c3c9cd93f790 tempest-AttachVolumeNegativeTest-552460454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-68a4212d-4fba-457b-8ca3-eb2ba7261b7f {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:07 devstack sudo[101046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-68a4212d-4fba-457b-8ca3-eb2ba7261b7f Jul 16 23:28:07 devstack sudo[101046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:07 devstack sudo[101044]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-19d21733-cbb1-41d7-8931-aaea04d22082 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8b4c47b8-0dc4-4bab-acf6-a7ef2be7ab6e" returned: 0 in 0.266s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:07 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-19d21733-cbb1-41d7-8931-aaea04d22082 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:28:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-19d21733-cbb1-41d7-8931-aaea04d22082 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e0332894-6025-47a9-a79c-7b3fd3b9debc tempest-VolumesExtendTest-525221970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 3.687s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-19d21733-cbb1-41d7-8931-aaea04d22082 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a8df531-d4f1-4fd8-912a-cc0d888a1cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b4c47b8-0dc4-4bab-acf6-a7ef2be7ab6e', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-19d21733-cbb1-41d7-8931-aaea04d22082 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5e1d268-0bc0-42b8-a721-52844bf1d6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:07 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75d00e1-c2a7-48eb-9a5e-aa72e064730d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:28:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e0332894-6025-47a9-a79c-7b3fd3b9debc tempest-VolumesExtendTest-525221970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:07 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-19d21733-cbb1-41d7-8931-aaea04d22082 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Volume volume-8b4c47b8-0dc4-4bab-acf6-a7ef2be7ab6e (8b4c47b8-0dc4-4bab-acf6-a7ef2be7ab6e): created successfully Jul 16 23:28:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-19d21733-cbb1-41d7-8931-aaea04d22082 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5e1d268-0bc0-42b8-a721-52844bf1d6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-19d21733-cbb1-41d7-8931-aaea04d22082 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Flow 'volume_create_manager' (aa59e584-c63c-4908-ac9d-f60157565c97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:28:07 devstack sudo[101046]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-427ae7cc-f55c-4e24-aee7-c3c9cd93f790 tempest-AttachVolumeNegativeTest-552460454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-68a4212d-4fba-457b-8ca3-eb2ba7261b7f" returned: 0 in 0.306s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:07 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-427ae7cc-f55c-4e24-aee7-c3c9cd93f790 tempest-AttachVolumeNegativeTest-552460454 None] Lock "cinder-quobyte-68a4212d-4fba-457b-8ca3-eb2ba7261b7f" released by "delete_volume" :: held 0.817s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:28:07 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-19d21733-cbb1-41d7-8931-aaea04d22082 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Created volume successfully. Jul 16 23:28:08 devstack sudo[101050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272 Jul 16 23:28:08 devstack sudo[101050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:08 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-427ae7cc-f55c-4e24-aee7-c3c9cd93f790 tempest-AttachVolumeNegativeTest-552460454 None] Created reservations ['05ec76d1-76a2-4b48-83c3-78a7e633e504', '4120d2f9-d2c1-420c-b4a7-86d8cc768072', '0ed1c8de-dcdb-4195-95ac-06363a95ca6f', 'b40a7df3-8a76-446c-ba08-6365f18aecbd'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:28:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-427ae7cc-f55c-4e24-aee7-c3c9cd93f790 tempest-AttachVolumeNegativeTest-552460454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-427ae7cc-f55c-4e24-aee7-c3c9cd93f790 tempest-AttachVolumeNegativeTest-552460454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:08 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-427ae7cc-f55c-4e24-aee7-c3c9cd93f790 tempest-AttachVolumeNegativeTest-552460454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:28:08 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-427ae7cc-f55c-4e24-aee7-c3c9cd93f790 tempest-AttachVolumeNegativeTest-552460454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:28:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-427ae7cc-f55c-4e24-aee7-c3c9cd93f790 tempest-AttachVolumeNegativeTest-552460454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-427ae7cc-f55c-4e24-aee7-c3c9cd93f790 tempest-AttachVolumeNegativeTest-552460454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:08 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1f2737df-6562-48a3-9310-b9ae19685670 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Acquiring lock "cinder-8b4c47b8-0dc4-4bab-acf6-a7ef2be7ab6e-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:28:08 devstack sudo[101053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:28:08 devstack sudo[101053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:08 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1f2737df-6562-48a3-9310-b9ae19685670 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "cinder-8b4c47b8-0dc4-4bab-acf6-a7ef2be7ab6e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:28:08 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1f2737df-6562-48a3-9310-b9ae19685670 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Acquiring lock "cinder-quobyte-8b4c47b8-0dc4-4bab-acf6-a7ef2be7ab6e" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:28:08 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1f2737df-6562-48a3-9310-b9ae19685670 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "cinder-quobyte-8b4c47b8-0dc4-4bab-acf6-a7ef2be7ab6e" acquired by "delete_volume" :: waited 0.021s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:28:08 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e9e78b-1349-47c2-a4dd-df576ee360e4]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:28:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1f2737df-6562-48a3-9310-b9ae19685670 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8b4c47b8-0dc4-4bab-acf6-a7ef2be7ab6e {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:08 devstack sudo[101050]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e0332894-6025-47a9-a79c-7b3fd3b9debc tempest-VolumesExtendTest-525221970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272" returned: 0 in 0.580s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e0332894-6025-47a9-a79c-7b3fd3b9debc tempest-VolumesExtendTest-525221970 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272.f96e3f63-12f9-4daa-af2f-9a79fa086bc5 2G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:08 devstack sudo[101058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8b4c47b8-0dc4-4bab-acf6-a7ef2be7ab6e Jul 16 23:28:08 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:08 devstack sudo[101053]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-427ae7cc-f55c-4e24-aee7-c3c9cd93f790 tempest-AttachVolumeNegativeTest-552460454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.410s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:08 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-427ae7cc-f55c-4e24-aee7-c3c9cd93f790 tempest-AttachVolumeNegativeTest-552460454 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:28:08 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-427ae7cc-f55c-4e24-aee7-c3c9cd93f790 tempest-AttachVolumeNegativeTest-552460454 None] Deleted volume successfully. Jul 16 23:28:08 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-427ae7cc-f55c-4e24-aee7-c3c9cd93f790 tempest-AttachVolumeNegativeTest-552460454 None] Lock "cinder-68a4212d-4fba-457b-8ca3-eb2ba7261b7f-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:28:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e0332894-6025-47a9-a79c-7b3fd3b9debc tempest-VolumesExtendTest-525221970 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272.f96e3f63-12f9-4daa-af2f-9a79fa086bc5 2G" returned: 0 in 0.204s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e0332894-6025-47a9-a79c-7b3fd3b9debc tempest-VolumesExtendTest-525221970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.848s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:08 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-e0332894-6025-47a9-a79c-7b3fd3b9debc tempest-VolumesExtendTest-525221970 None] Extend volume completed successfully. Jul 16 23:28:08 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1f2737df-6562-48a3-9310-b9ae19685670 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8b4c47b8-0dc4-4bab-acf6-a7ef2be7ab6e" returned: 0 in 0.499s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1f2737df-6562-48a3-9310-b9ae19685670 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8b4c47b8-0dc4-4bab-acf6-a7ef2be7ab6e {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:08 devstack sudo[101068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8b4c47b8-0dc4-4bab-acf6-a7ef2be7ab6e Jul 16 23:28:08 devstack sudo[101068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:09 devstack sudo[101068]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1f2737df-6562-48a3-9310-b9ae19685670 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8b4c47b8-0dc4-4bab-acf6-a7ef2be7ab6e" returned: 0 in 0.266s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:09 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1f2737df-6562-48a3-9310-b9ae19685670 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "cinder-quobyte-8b4c47b8-0dc4-4bab-acf6-a7ef2be7ab6e" released by "delete_volume" :: held 0.819s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:28:09 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-1f2737df-6562-48a3-9310-b9ae19685670 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Created reservations ['ae8c927c-df7e-429a-b050-ce89e4dda52f', 'de31944d-c024-43fd-9b24-cb30b8bb25e3', 'ef4d767a-70b1-408e-8cc8-582dc12a58b4', 'aefc86e2-bff0-468a-93ab-3cabad6edbae'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:28:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1f2737df-6562-48a3-9310-b9ae19685670 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1f2737df-6562-48a3-9310-b9ae19685670 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:09 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1f2737df-6562-48a3-9310-b9ae19685670 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:28:09 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1f2737df-6562-48a3-9310-b9ae19685670 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:28:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1f2737df-6562-48a3-9310-b9ae19685670 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1f2737df-6562-48a3-9310-b9ae19685670 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:09 devstack sudo[101071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:28:09 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:09 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0cd3855a-0065-4bac-a797-455421a53757 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Acquiring lock "cinder-a839a895-3eae-4b3d-844a-69f88498e86e-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:28:09 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0cd3855a-0065-4bac-a797-455421a53757 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "cinder-a839a895-3eae-4b3d-844a-69f88498e86e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:28:09 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0cd3855a-0065-4bac-a797-455421a53757 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Acquiring lock "cinder-quobyte-a839a895-3eae-4b3d-844a-69f88498e86e" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:28:09 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0cd3855a-0065-4bac-a797-455421a53757 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "cinder-quobyte-a839a895-3eae-4b3d-844a-69f88498e86e" acquired by "delete_volume" :: waited 0.029s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:28:09 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63c1386-b9e8-4da9-9b18-ae1320e7ddaf]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:28:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0cd3855a-0065-4bac-a797-455421a53757 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a839a895-3eae-4b3d-844a-69f88498e86e {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:09 devstack sudo[101073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a839a895-3eae-4b3d-844a-69f88498e86e Jul 16 23:28:09 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-384bc0ac-fbf2-49ba-ab70-9f2aeafbaa33 tempest-VolumesExtendTest-525221970 None] Acquiring lock "cinder-f96e3f63-12f9-4daa-af2f-9a79fa086bc5-delete_snapshot" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:28:09 devstack sudo[101073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:09 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-384bc0ac-fbf2-49ba-ab70-9f2aeafbaa33 tempest-VolumesExtendTest-525221970 None] Lock "cinder-f96e3f63-12f9-4daa-af2f-9a79fa086bc5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:28:09 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-384bc0ac-fbf2-49ba-ab70-9f2aeafbaa33 tempest-VolumesExtendTest-525221970 None] Acquiring lock "cinder-quobyte-852ed5d4-e013-48c1-81a2-6e8e4e5be272" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:28:09 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-384bc0ac-fbf2-49ba-ab70-9f2aeafbaa33 tempest-VolumesExtendTest-525221970 None] Lock "cinder-quobyte-852ed5d4-e013-48c1-81a2-6e8e4e5be272" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:28:09 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-384bc0ac-fbf2-49ba-ab70-9f2aeafbaa33 tempest-VolumesExtendTest-525221970 None] Acquiring lock "cinder-quobyte-f96e3f63-12f9-4daa-af2f-9a79fa086bc5" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:28:09 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1f2737df-6562-48a3-9310-b9ae19685670 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.554s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:09 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-1f2737df-6562-48a3-9310-b9ae19685670 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:28:09 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-384bc0ac-fbf2-49ba-ab70-9f2aeafbaa33 tempest-VolumesExtendTest-525221970 None] Lock "cinder-quobyte-f96e3f63-12f9-4daa-af2f-9a79fa086bc5" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:28:09 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-384bc0ac-fbf2-49ba-ab70-9f2aeafbaa33 tempest-VolumesExtendTest-525221970 None] Deleting offline snapshot f96e3f63-12f9-4daa-af2f-9a79fa086bc5 of volume 852ed5d4-e013-48c1-81a2-6e8e4e5be272 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:28:09 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-384bc0ac-fbf2-49ba-ab70-9f2aeafbaa33 tempest-VolumesExtendTest-525221970 None] snapshot_file for this snap is: volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272.f96e3f63-12f9-4daa-af2f-9a79fa086bc5 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:28:09 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-1f2737df-6562-48a3-9310-b9ae19685670 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Deleted volume successfully. Jul 16 23:28:09 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[9066ed83-1105-43ac-b1e2-6c0ee1d678e2]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:28:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-384bc0ac-fbf2-49ba-ab70-9f2aeafbaa33 tempest-VolumesExtendTest-525221970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272.f96e3f63-12f9-4daa-af2f-9a79fa086bc5 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:10 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1f2737df-6562-48a3-9310-b9ae19685670 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "cinder-8b4c47b8-0dc4-4bab-acf6-a7ef2be7ab6e-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:28:10 devstack sudo[101076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272.f96e3f63-12f9-4daa-af2f-9a79fa086bc5 Jul 16 23:28:10 devstack sudo[101076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:10 devstack sudo[101073]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0cd3855a-0065-4bac-a797-455421a53757 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a839a895-3eae-4b3d-844a-69f88498e86e" returned: 0 in 0.569s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0cd3855a-0065-4bac-a797-455421a53757 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a839a895-3eae-4b3d-844a-69f88498e86e {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:10 devstack sudo[101082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a839a895-3eae-4b3d-844a-69f88498e86e Jul 16 23:28:10 devstack sudo[101082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:10 devstack sudo[101076]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-384bc0ac-fbf2-49ba-ab70-9f2aeafbaa33 tempest-VolumesExtendTest-525221970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272.f96e3f63-12f9-4daa-af2f-9a79fa086bc5" returned: 0 in 0.478s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:10 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-384bc0ac-fbf2-49ba-ab70-9f2aeafbaa33 tempest-VolumesExtendTest-525221970 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:28:10 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[2029e6a8-2dea-4d86-a30b-33646b23a332]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:28:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-384bc0ac-fbf2-49ba-ab70-9f2aeafbaa33 tempest-VolumesExtendTest-525221970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:10 devstack sudo[101082]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0cd3855a-0065-4bac-a797-455421a53757 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a839a895-3eae-4b3d-844a-69f88498e86e" returned: 0 in 0.343s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:10 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0cd3855a-0065-4bac-a797-455421a53757 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "cinder-quobyte-a839a895-3eae-4b3d-844a-69f88498e86e" released by "delete_volume" :: held 0.989s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:28:10 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-0cd3855a-0065-4bac-a797-455421a53757 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Created reservations ['9690802a-d5d1-4099-84cd-988a1d44a915', 'c5ebf543-4fc0-45a1-934f-e27e106d530f', 'cafcc1a3-3a32-4cc0-b111-2116825629c1', '17d1c387-50b2-4f38-835c-0ec97c077eea'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:28:10 devstack sudo[101089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272 Jul 16 23:28:10 devstack sudo[101089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0cd3855a-0065-4bac-a797-455421a53757 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0cd3855a-0065-4bac-a797-455421a53757 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:10 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0cd3855a-0065-4bac-a797-455421a53757 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:28:10 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0cd3855a-0065-4bac-a797-455421a53757 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:28:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0cd3855a-0065-4bac-a797-455421a53757 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0cd3855a-0065-4bac-a797-455421a53757 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:10 devstack sudo[101092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:28:10 devstack sudo[101092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:11 devstack sudo[101089]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-384bc0ac-fbf2-49ba-ab70-9f2aeafbaa33 tempest-VolumesExtendTest-525221970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272" returned: 0 in 0.569s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-384bc0ac-fbf2-49ba-ab70-9f2aeafbaa33 tempest-VolumesExtendTest-525221970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272.f96e3f63-12f9-4daa-af2f-9a79fa086bc5 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:11 devstack sudo[101100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272.f96e3f63-12f9-4daa-af2f-9a79fa086bc5 Jul 16 23:28:11 devstack sudo[101100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:11 devstack sudo[101092]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0cd3855a-0065-4bac-a797-455421a53757 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.381s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:11 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-0cd3855a-0065-4bac-a797-455421a53757 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:28:11 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-0cd3855a-0065-4bac-a797-455421a53757 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Deleted volume successfully. Jul 16 23:28:11 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0cd3855a-0065-4bac-a797-455421a53757 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "cinder-a839a895-3eae-4b3d-844a-69f88498e86e-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:28:11 devstack sudo[101100]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-384bc0ac-fbf2-49ba-ab70-9f2aeafbaa33 tempest-VolumesExtendTest-525221970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272.f96e3f63-12f9-4daa-af2f-9a79fa086bc5" returned: 0 in 0.444s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-384bc0ac-fbf2-49ba-ab70-9f2aeafbaa33 tempest-VolumesExtendTest-525221970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272.f96e3f63-12f9-4daa-af2f-9a79fa086bc5 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:11 devstack sudo[101106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272.f96e3f63-12f9-4daa-af2f-9a79fa086bc5 Jul 16 23:28:11 devstack sudo[101106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:11 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e0a9d459-885b-4ccd-8a9d-302c3208ed0e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Acquiring lock "cinder-371ae0c9-6064-4a98-9666-14d58a92e6e6-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:28:11 devstack sudo[101106]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-384bc0ac-fbf2-49ba-ab70-9f2aeafbaa33 tempest-VolumesExtendTest-525221970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272.f96e3f63-12f9-4daa-af2f-9a79fa086bc5" returned: 0 in 0.339s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:11 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e0a9d459-885b-4ccd-8a9d-302c3208ed0e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "cinder-371ae0c9-6064-4a98-9666-14d58a92e6e6-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:28:11 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-384bc0ac-fbf2-49ba-ab70-9f2aeafbaa33 tempest-VolumesExtendTest-525221970 None] Lock "cinder-quobyte-f96e3f63-12f9-4daa-af2f-9a79fa086bc5" released by "_delete_snapshot" :: held 1.996s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:28:11 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-384bc0ac-fbf2-49ba-ab70-9f2aeafbaa33 tempest-VolumesExtendTest-525221970 None] Lock "cinder-quobyte-852ed5d4-e013-48c1-81a2-6e8e4e5be272" released by "delete_snapshot" :: held 2.041s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:28:11 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e0a9d459-885b-4ccd-8a9d-302c3208ed0e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Acquiring lock "cinder-quobyte-371ae0c9-6064-4a98-9666-14d58a92e6e6" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:28:11 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e0a9d459-885b-4ccd-8a9d-302c3208ed0e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "cinder-quobyte-371ae0c9-6064-4a98-9666-14d58a92e6e6" acquired by "delete_volume" :: waited 0.026s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:28:11 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[549ad048-d9bd-49b8-8f73-b11799e586b8]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:28:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e0a9d459-885b-4ccd-8a9d-302c3208ed0e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-371ae0c9-6064-4a98-9666-14d58a92e6e6 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:12 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-384bc0ac-fbf2-49ba-ab70-9f2aeafbaa33 tempest-VolumesExtendTest-525221970 None] Created reservations ['58671451-2961-4632-b59b-c8b4e85a1c0e', '2eda8f76-4650-410c-84c7-6cafed0ba844', '2fafcce0-bad4-4d8b-a513-5a1fc0fca8f4', 'b1402f51-cf67-4578-bbdb-e9957784d397'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:28:12 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-384bc0ac-fbf2-49ba-ab70-9f2aeafbaa33 tempest-VolumesExtendTest-525221970 None] Delete snapshot completed successfully. Jul 16 23:28:12 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-384bc0ac-fbf2-49ba-ab70-9f2aeafbaa33 tempest-VolumesExtendTest-525221970 None] Lock "cinder-f96e3f63-12f9-4daa-af2f-9a79fa086bc5-delete_snapshot" released by "delete_snapshot" :: held 2.324s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:28:12 devstack sudo[101109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-371ae0c9-6064-4a98-9666-14d58a92e6e6 Jul 16 23:28:12 devstack sudo[101109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:12 devstack sudo[101109]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e0a9d459-885b-4ccd-8a9d-302c3208ed0e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-371ae0c9-6064-4a98-9666-14d58a92e6e6" returned: 0 in 0.560s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e0a9d459-885b-4ccd-8a9d-302c3208ed0e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-371ae0c9-6064-4a98-9666-14d58a92e6e6 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:12 devstack sudo[101114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-371ae0c9-6064-4a98-9666-14d58a92e6e6 Jul 16 23:28:12 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:12 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e0a9d459-885b-4ccd-8a9d-302c3208ed0e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-371ae0c9-6064-4a98-9666-14d58a92e6e6" returned: 0 in 0.304s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:12 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e0a9d459-885b-4ccd-8a9d-302c3208ed0e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "cinder-quobyte-371ae0c9-6064-4a98-9666-14d58a92e6e6" released by "delete_volume" :: held 0.927s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:28:12 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-e0a9d459-885b-4ccd-8a9d-302c3208ed0e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Created reservations ['c515c20a-ec3a-4b10-acc0-1288d303034f', '752ef227-1dff-45f2-ac5a-9b010e7a74cc', '96562052-c1dc-4cce-9652-72fb425bbfe9', 'fab1b628-0608-43d0-9344-0f116dc33e30'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:28:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e0a9d459-885b-4ccd-8a9d-302c3208ed0e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e0a9d459-885b-4ccd-8a9d-302c3208ed0e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:13 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e0a9d459-885b-4ccd-8a9d-302c3208ed0e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:28:13 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e0a9d459-885b-4ccd-8a9d-302c3208ed0e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:28:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e0a9d459-885b-4ccd-8a9d-302c3208ed0e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e0a9d459-885b-4ccd-8a9d-302c3208ed0e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:13 devstack sudo[101118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:28:13 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:13 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-65cdab8b-6d76-4c06-8619-b54b300f4d02 tempest-VolumesExtendTest-525221970 None] Acquiring lock "cinder-852ed5d4-e013-48c1-81a2-6e8e4e5be272-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:28:13 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-65cdab8b-6d76-4c06-8619-b54b300f4d02 tempest-VolumesExtendTest-525221970 None] Lock "cinder-852ed5d4-e013-48c1-81a2-6e8e4e5be272-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:28:13 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-65cdab8b-6d76-4c06-8619-b54b300f4d02 tempest-VolumesExtendTest-525221970 None] Acquiring lock "cinder-quobyte-852ed5d4-e013-48c1-81a2-6e8e4e5be272" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:28:13 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-65cdab8b-6d76-4c06-8619-b54b300f4d02 tempest-VolumesExtendTest-525221970 None] Lock "cinder-quobyte-852ed5d4-e013-48c1-81a2-6e8e4e5be272" acquired by "delete_volume" :: waited 0.057s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:28:13 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[328408df-016c-4334-9b3e-6bdaeb82b4ed]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:28:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-65cdab8b-6d76-4c06-8619-b54b300f4d02 tempest-VolumesExtendTest-525221970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:13 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e0a9d459-885b-4ccd-8a9d-302c3208ed0e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.369s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:13 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-e0a9d459-885b-4ccd-8a9d-302c3208ed0e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:28:13 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-e0a9d459-885b-4ccd-8a9d-302c3208ed0e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Deleted volume successfully. Jul 16 23:28:13 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e0a9d459-885b-4ccd-8a9d-302c3208ed0e tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "cinder-371ae0c9-6064-4a98-9666-14d58a92e6e6-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:28:13 devstack sudo[101122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272 Jul 16 23:28:13 devstack sudo[101122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:13 devstack sudo[101122]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-65cdab8b-6d76-4c06-8619-b54b300f4d02 tempest-VolumesExtendTest-525221970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272" returned: 0 in 0.444s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-65cdab8b-6d76-4c06-8619-b54b300f4d02 tempest-VolumesExtendTest-525221970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:13 devstack sudo[101127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272 Jul 16 23:28:13 devstack sudo[101127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:14 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-bfd9bbfc-e53f-4df3-bcab-ce5c115fe9c0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Acquiring lock "cinder-7c406db7-5f3b-469b-9a4c-7e162504230c-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:28:14 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-bfd9bbfc-e53f-4df3-bcab-ce5c115fe9c0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "cinder-7c406db7-5f3b-469b-9a4c-7e162504230c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:28:14 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-bfd9bbfc-e53f-4df3-bcab-ce5c115fe9c0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Acquiring lock "cinder-quobyte-7c406db7-5f3b-469b-9a4c-7e162504230c" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:28:14 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-bfd9bbfc-e53f-4df3-bcab-ce5c115fe9c0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "cinder-quobyte-7c406db7-5f3b-469b-9a4c-7e162504230c" acquired by "delete_volume" :: waited 0.026s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:28:14 devstack sudo[101127]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-65cdab8b-6d76-4c06-8619-b54b300f4d02 tempest-VolumesExtendTest-525221970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-852ed5d4-e013-48c1-81a2-6e8e4e5be272" returned: 0 in 0.378s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:14 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd8a3fd-ada0-4366-9a19-ea809b0c8646]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:28:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bfd9bbfc-e53f-4df3-bcab-ce5c115fe9c0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7c406db7-5f3b-469b-9a4c-7e162504230c {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:14 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-65cdab8b-6d76-4c06-8619-b54b300f4d02 tempest-VolumesExtendTest-525221970 None] Lock "cinder-quobyte-852ed5d4-e013-48c1-81a2-6e8e4e5be272" released by "delete_volume" :: held 0.955s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:28:14 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-65cdab8b-6d76-4c06-8619-b54b300f4d02 tempest-VolumesExtendTest-525221970 None] Created reservations ['f40d7ad9-136f-4e3b-b960-66d1e16f7b85', 'c2fc0682-4d06-49eb-b2ca-1f2bc6b69fba', 'ef31dd5a-bd7b-497a-9d65-5d092da8ab9f', 'e77b6055-24af-4ba3-b5ce-cb33799fe68f'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:28:14 devstack sudo[101131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7c406db7-5f3b-469b-9a4c-7e162504230c Jul 16 23:28:14 devstack sudo[101131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-65cdab8b-6d76-4c06-8619-b54b300f4d02 tempest-VolumesExtendTest-525221970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-65cdab8b-6d76-4c06-8619-b54b300f4d02 tempest-VolumesExtendTest-525221970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:14 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-65cdab8b-6d76-4c06-8619-b54b300f4d02 tempest-VolumesExtendTest-525221970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:28:14 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-65cdab8b-6d76-4c06-8619-b54b300f4d02 tempest-VolumesExtendTest-525221970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:28:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-65cdab8b-6d76-4c06-8619-b54b300f4d02 tempest-VolumesExtendTest-525221970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-65cdab8b-6d76-4c06-8619-b54b300f4d02 tempest-VolumesExtendTest-525221970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:14 devstack sudo[101133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:28:14 devstack sudo[101133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:14 devstack sudo[101133]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-65cdab8b-6d76-4c06-8619-b54b300f4d02 tempest-VolumesExtendTest-525221970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.350s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:14 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-65cdab8b-6d76-4c06-8619-b54b300f4d02 tempest-VolumesExtendTest-525221970 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:28:14 devstack sudo[101131]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bfd9bbfc-e53f-4df3-bcab-ce5c115fe9c0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7c406db7-5f3b-469b-9a4c-7e162504230c" returned: 0 in 0.558s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bfd9bbfc-e53f-4df3-bcab-ce5c115fe9c0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7c406db7-5f3b-469b-9a4c-7e162504230c {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:14 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-65cdab8b-6d76-4c06-8619-b54b300f4d02 tempest-VolumesExtendTest-525221970 None] Deleted volume successfully. Jul 16 23:28:14 devstack sudo[101139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7c406db7-5f3b-469b-9a4c-7e162504230c Jul 16 23:28:14 devstack sudo[101139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:14 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-65cdab8b-6d76-4c06-8619-b54b300f4d02 tempest-VolumesExtendTest-525221970 None] Lock "cinder-852ed5d4-e013-48c1-81a2-6e8e4e5be272-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:28:15 devstack sudo[101139]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bfd9bbfc-e53f-4df3-bcab-ce5c115fe9c0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7c406db7-5f3b-469b-9a4c-7e162504230c" returned: 0 in 0.361s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:15 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-bfd9bbfc-e53f-4df3-bcab-ce5c115fe9c0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "cinder-quobyte-7c406db7-5f3b-469b-9a4c-7e162504230c" released by "delete_volume" :: held 1.014s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:28:15 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-bfd9bbfc-e53f-4df3-bcab-ce5c115fe9c0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Created reservations ['4579026a-3a99-4ec8-88ca-1dccce6d60a9', 'f6a50892-2177-479c-b68e-2aa8da963caa', '1d2ecffa-385e-4d41-a530-e021a9c500db', '3b51b534-d368-4f22-aea2-e5cbde3d9a99'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:28:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bfd9bbfc-e53f-4df3-bcab-ce5c115fe9c0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bfd9bbfc-e53f-4df3-bcab-ce5c115fe9c0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:15 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-bfd9bbfc-e53f-4df3-bcab-ce5c115fe9c0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:28:15 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-bfd9bbfc-e53f-4df3-bcab-ce5c115fe9c0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:28:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bfd9bbfc-e53f-4df3-bcab-ce5c115fe9c0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bfd9bbfc-e53f-4df3-bcab-ce5c115fe9c0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:15 devstack sudo[101142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:28:15 devstack sudo[101142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:15 devstack sudo[101142]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bfd9bbfc-e53f-4df3-bcab-ce5c115fe9c0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.293s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:15 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-bfd9bbfc-e53f-4df3-bcab-ce5c115fe9c0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:28:15 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-bfd9bbfc-e53f-4df3-bcab-ce5c115fe9c0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Deleted volume successfully. Jul 16 23:28:15 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-bfd9bbfc-e53f-4df3-bcab-ce5c115fe9c0 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "cinder-7c406db7-5f3b-469b-9a4c-7e162504230c-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:28:16 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-24ac6cd2-68ef-47ab-9d2e-92b991421c61 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Acquiring lock "cinder-87126b15-dd82-4644-b934-3abc18ce2681-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:28:16 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-24ac6cd2-68ef-47ab-9d2e-92b991421c61 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "cinder-87126b15-dd82-4644-b934-3abc18ce2681-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:28:16 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-24ac6cd2-68ef-47ab-9d2e-92b991421c61 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Acquiring lock "cinder-quobyte-87126b15-dd82-4644-b934-3abc18ce2681" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:28:16 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-24ac6cd2-68ef-47ab-9d2e-92b991421c61 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "cinder-quobyte-87126b15-dd82-4644-b934-3abc18ce2681" acquired by "delete_volume" :: waited 0.028s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:28:16 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[985d46c0-86de-4fc4-a744-45eb8eb5ddb7]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:28:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-24ac6cd2-68ef-47ab-9d2e-92b991421c61 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87126b15-dd82-4644-b934-3abc18ce2681 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:16 devstack sudo[101146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87126b15-dd82-4644-b934-3abc18ce2681 Jul 16 23:28:16 devstack sudo[101146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:17 devstack sudo[101146]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:17 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-24ac6cd2-68ef-47ab-9d2e-92b991421c61 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87126b15-dd82-4644-b934-3abc18ce2681" returned: 0 in 0.533s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:17 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-24ac6cd2-68ef-47ab-9d2e-92b991421c61 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87126b15-dd82-4644-b934-3abc18ce2681 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:17 devstack sudo[101151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87126b15-dd82-4644-b934-3abc18ce2681 Jul 16 23:28:17 devstack sudo[101151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:17 devstack sudo[101151]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:17 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-24ac6cd2-68ef-47ab-9d2e-92b991421c61 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87126b15-dd82-4644-b934-3abc18ce2681" returned: 0 in 0.369s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:17 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-24ac6cd2-68ef-47ab-9d2e-92b991421c61 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "cinder-quobyte-87126b15-dd82-4644-b934-3abc18ce2681" released by "delete_volume" :: held 0.957s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:28:17 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-24ac6cd2-68ef-47ab-9d2e-92b991421c61 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Created reservations ['a2650e4f-1861-4249-88c0-dad3e991525a', '572f4d08-f0c2-4753-9f66-a29af5f32bd6', '776abcec-3791-4b81-8d25-d6953ea9e935', '23210d6f-2606-4fb4-be23-647ea0e5ff9e'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:28:17 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-24ac6cd2-68ef-47ab-9d2e-92b991421c61 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:17 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-24ac6cd2-68ef-47ab-9d2e-92b991421c61 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:17 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-24ac6cd2-68ef-47ab-9d2e-92b991421c61 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:28:17 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-24ac6cd2-68ef-47ab-9d2e-92b991421c61 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:28:17 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-24ac6cd2-68ef-47ab-9d2e-92b991421c61 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:17 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-24ac6cd2-68ef-47ab-9d2e-92b991421c61 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:17 devstack sudo[101154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:28:17 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:18 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-24ac6cd2-68ef-47ab-9d2e-92b991421c61 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.316s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:18 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-24ac6cd2-68ef-47ab-9d2e-92b991421c61 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:28:18 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-24ac6cd2-68ef-47ab-9d2e-92b991421c61 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Deleted volume successfully. Jul 16 23:28:18 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-24ac6cd2-68ef-47ab-9d2e-92b991421c61 tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "cinder-87126b15-dd82-4644-b934-3abc18ce2681-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:28:18 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [req-139d695c-de48-494f-b8f6-2f25638c44e2 req-c5cbe031-61a1-4718-9243-98e7ab434344 tempest-VolumesGetTestJSON-152661806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:28:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-139d695c-de48-494f-b8f6-2f25638c44e2 req-c5cbe031-61a1-4718-9243-98e7ab434344 tempest-VolumesGetTestJSON-152661806 None] Flow 'volume_create_manager' (dcb6dd32-489e-4b29-93ca-8b45ed01753c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:28:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-139d695c-de48-494f-b8f6-2f25638c44e2 req-c5cbe031-61a1-4718-9243-98e7ab434344 tempest-VolumesGetTestJSON-152661806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc63cb32-79db-405d-a2be-d43929fbf18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-139d695c-de48-494f-b8f6-2f25638c44e2 req-c5cbe031-61a1-4718-9243-98e7ab434344 tempest-VolumesGetTestJSON-152661806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc63cb32-79db-405d-a2be-d43929fbf18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1632000398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e51e2e4-9746-4e3b-8511-63d8e44a71cc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d049fb7e59b9480fabd09ec7e6de7edb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:28:19Z,use_quota=True,user_id='635a9c351e6d4db3855b677921941625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-139d695c-de48-494f-b8f6-2f25638c44e2 req-c5cbe031-61a1-4718-9243-98e7ab434344 tempest-VolumesGetTestJSON-152661806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de7ddd09-8e67-4054-b6d2-5c4df203fa67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-139d695c-de48-494f-b8f6-2f25638c44e2 req-c5cbe031-61a1-4718-9243-98e7ab434344 tempest-VolumesGetTestJSON-152661806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de7ddd09-8e67-4054-b6d2-5c4df203fa67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-139d695c-de48-494f-b8f6-2f25638c44e2 req-c5cbe031-61a1-4718-9243-98e7ab434344 tempest-VolumesGetTestJSON-152661806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e56456ed-9ba3-4e51-a11c-47dcc6047569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-139d695c-de48-494f-b8f6-2f25638c44e2 req-c5cbe031-61a1-4718-9243-98e7ab434344 tempest-VolumesGetTestJSON-152661806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e56456ed-9ba3-4e51-a11c-47dcc6047569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e51e2e4-9746-4e3b-8511-63d8e44a71cc', 'volume_name': 'volume-8e51e2e4-9746-4e3b-8511-63d8e44a71cc', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-139d695c-de48-494f-b8f6-2f25638c44e2 req-c5cbe031-61a1-4718-9243-98e7ab434344 tempest-VolumesGetTestJSON-152661806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c399d5b9-59d2-4d75-937d-06e8bcd9c895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-139d695c-de48-494f-b8f6-2f25638c44e2 req-c5cbe031-61a1-4718-9243-98e7ab434344 tempest-VolumesGetTestJSON-152661806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c399d5b9-59d2-4d75-937d-06e8bcd9c895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-139d695c-de48-494f-b8f6-2f25638c44e2 req-c5cbe031-61a1-4718-9243-98e7ab434344 tempest-VolumesGetTestJSON-152661806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14557646-fc33-4efb-ac99-f50432f6eef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:18 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [req-139d695c-de48-494f-b8f6-2f25638c44e2 req-c5cbe031-61a1-4718-9243-98e7ab434344 tempest-VolumesGetTestJSON-152661806 None] Volume 8e51e2e4-9746-4e3b-8511-63d8e44a71cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e51e2e4-9746-4e3b-8511-63d8e44a71cc', 'volume_size': 1} Jul 16 23:28:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-139d695c-de48-494f-b8f6-2f25638c44e2 req-c5cbe031-61a1-4718-9243-98e7ab434344 tempest-VolumesGetTestJSON-152661806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-139d695c-de48-494f-b8f6-2f25638c44e2 req-c5cbe031-61a1-4718-9243-98e7ab434344 tempest-VolumesGetTestJSON-152661806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:18 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [req-139d695c-de48-494f-b8f6-2f25638c44e2 req-c5cbe031-61a1-4718-9243-98e7ab434344 tempest-VolumesGetTestJSON-152661806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1632000398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e51e2e4-9746-4e3b-8511-63d8e44a71cc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d049fb7e59b9480fabd09ec7e6de7edb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:28:19Z,use_quota=True,user_id='635a9c351e6d4db3855b677921941625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:28:18 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [req-139d695c-de48-494f-b8f6-2f25638c44e2 req-c5cbe031-61a1-4718-9243-98e7ab434344 tempest-VolumesGetTestJSON-152661806 None] Creating volume 8e51e2e4-9746-4e3b-8511-63d8e44a71cc {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:28:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-139d695c-de48-494f-b8f6-2f25638c44e2 req-c5cbe031-61a1-4718-9243-98e7ab434344 tempest-VolumesGetTestJSON-152661806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-139d695c-de48-494f-b8f6-2f25638c44e2 req-c5cbe031-61a1-4718-9243-98e7ab434344 tempest-VolumesGetTestJSON-152661806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:18 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [req-139d695c-de48-494f-b8f6-2f25638c44e2 req-c5cbe031-61a1-4718-9243-98e7ab434344 tempest-VolumesGetTestJSON-152661806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:28:18 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [req-139d695c-de48-494f-b8f6-2f25638c44e2 req-c5cbe031-61a1-4718-9243-98e7ab434344 tempest-VolumesGetTestJSON-152661806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:28:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-139d695c-de48-494f-b8f6-2f25638c44e2 req-c5cbe031-61a1-4718-9243-98e7ab434344 tempest-VolumesGetTestJSON-152661806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:18 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [req-139d695c-de48-494f-b8f6-2f25638c44e2 req-c5cbe031-61a1-4718-9243-98e7ab434344 tempest-VolumesGetTestJSON-152661806 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:28:18 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [req-139d695c-de48-494f-b8f6-2f25638c44e2 req-c5cbe031-61a1-4718-9243-98e7ab434344 tempest-VolumesGetTestJSON-152661806 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:28:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-139d695c-de48-494f-b8f6-2f25638c44e2 req-c5cbe031-61a1-4718-9243-98e7ab434344 tempest-VolumesGetTestJSON-152661806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8e51e2e4-9746-4e3b-8511-63d8e44a71cc 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:18 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c64b4ed3-bc29-4ed3-b69e-3f011f7b24aa tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Acquiring lock "cinder-b8225957-ebae-48d0-bcba-42f45fb27295-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:28:18 devstack sudo[101157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8e51e2e4-9746-4e3b-8511-63d8e44a71cc 1073741824 Jul 16 23:28:18 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:18 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c64b4ed3-bc29-4ed3-b69e-3f011f7b24aa tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "cinder-b8225957-ebae-48d0-bcba-42f45fb27295-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:28:18 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c64b4ed3-bc29-4ed3-b69e-3f011f7b24aa tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Acquiring lock "cinder-quobyte-b8225957-ebae-48d0-bcba-42f45fb27295" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:28:18 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c64b4ed3-bc29-4ed3-b69e-3f011f7b24aa tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "cinder-quobyte-b8225957-ebae-48d0-bcba-42f45fb27295" acquired by "delete_volume" :: waited 0.025s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:28:19 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca773c13-752b-41de-982c-6871e7e994e3]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:28:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c64b4ed3-bc29-4ed3-b69e-3f011f7b24aa tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b8225957-ebae-48d0-bcba-42f45fb27295 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:19 devstack sudo[101160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b8225957-ebae-48d0-bcba-42f45fb27295 Jul 16 23:28:19 devstack sudo[101160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:19 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-45e7584b-432e-49e2-bd1d-bc78daa5faed tempest-VolumesGetTest-720293127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:28:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-45e7584b-432e-49e2-bd1d-bc78daa5faed tempest-VolumesGetTest-720293127 None] Flow 'volume_create_manager' (7fe88571-0c72-4b6f-8ee2-9ca48138b540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:28:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-45e7584b-432e-49e2-bd1d-bc78daa5faed tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7024b831-a6a4-44a5-86cb-ed2179ee1999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-45e7584b-432e-49e2-bd1d-bc78daa5faed tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7024b831-a6a4-44a5-86cb-ed2179ee1999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-600395090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5a4b52b-5946-4abb-a894-017e38927e70,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d553ba4b271a44df88d94d52e4104064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:28:19Z,use_quota=True,user_id='08f5f2b4e8884331a5914c76b0275b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-45e7584b-432e-49e2-bd1d-bc78daa5faed tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2088231c-8130-4653-ad85-5a48ba2beebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-45e7584b-432e-49e2-bd1d-bc78daa5faed tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2088231c-8130-4653-ad85-5a48ba2beebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-45e7584b-432e-49e2-bd1d-bc78daa5faed tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8867816-fe5c-414a-b448-25bab5da1706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-45e7584b-432e-49e2-bd1d-bc78daa5faed tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8867816-fe5c-414a-b448-25bab5da1706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5a4b52b-5946-4abb-a894-017e38927e70', 'volume_name': 'volume-f5a4b52b-5946-4abb-a894-017e38927e70', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-45e7584b-432e-49e2-bd1d-bc78daa5faed tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (075dc2c9-1d80-4775-b266-5e02b3908d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-45e7584b-432e-49e2-bd1d-bc78daa5faed tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (075dc2c9-1d80-4775-b266-5e02b3908d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-45e7584b-432e-49e2-bd1d-bc78daa5faed tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (069314b2-b554-4bad-b889-96761a6ba43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:19 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-45e7584b-432e-49e2-bd1d-bc78daa5faed tempest-VolumesGetTest-720293127 None] Volume f5a4b52b-5946-4abb-a894-017e38927e70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5a4b52b-5946-4abb-a894-017e38927e70', 'volume_size': 1} Jul 16 23:28:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-45e7584b-432e-49e2-bd1d-bc78daa5faed tempest-VolumesGetTest-720293127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:19 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-139d695c-de48-494f-b8f6-2f25638c44e2 req-c5cbe031-61a1-4718-9243-98e7ab434344 tempest-VolumesGetTestJSON-152661806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8e51e2e4-9746-4e3b-8511-63d8e44a71cc 1073741824" returned: 0 in 0.614s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:19 devstack sudo[101160]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c64b4ed3-bc29-4ed3-b69e-3f011f7b24aa tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b8225957-ebae-48d0-bcba-42f45fb27295" returned: 0 in 0.489s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c64b4ed3-bc29-4ed3-b69e-3f011f7b24aa tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b8225957-ebae-48d0-bcba-42f45fb27295 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-139d695c-de48-494f-b8f6-2f25638c44e2 req-c5cbe031-61a1-4718-9243-98e7ab434344 tempest-VolumesGetTestJSON-152661806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8e51e2e4-9746-4e3b-8511-63d8e44a71cc {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:19 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b8225957-ebae-48d0-bcba-42f45fb27295 Jul 16 23:28:19 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:19 devstack sudo[101172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8e51e2e4-9746-4e3b-8511-63d8e44a71cc Jul 16 23:28:19 devstack sudo[101172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:19 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c64b4ed3-bc29-4ed3-b69e-3f011f7b24aa tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b8225957-ebae-48d0-bcba-42f45fb27295" returned: 0 in 0.292s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:19 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c64b4ed3-bc29-4ed3-b69e-3f011f7b24aa tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "cinder-quobyte-b8225957-ebae-48d0-bcba-42f45fb27295" released by "delete_volume" :: held 0.838s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:28:19 devstack sudo[101172]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-139d695c-de48-494f-b8f6-2f25638c44e2 req-c5cbe031-61a1-4718-9243-98e7ab434344 tempest-VolumesGetTestJSON-152661806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8e51e2e4-9746-4e3b-8511-63d8e44a71cc" returned: 0 in 0.306s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:19 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [req-139d695c-de48-494f-b8f6-2f25638c44e2 req-c5cbe031-61a1-4718-9243-98e7ab434344 tempest-VolumesGetTestJSON-152661806 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:28:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-139d695c-de48-494f-b8f6-2f25638c44e2 req-c5cbe031-61a1-4718-9243-98e7ab434344 tempest-VolumesGetTestJSON-152661806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-45e7584b-432e-49e2-bd1d-bc78daa5faed tempest-VolumesGetTest-720293127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.362s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:19 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-45e7584b-432e-49e2-bd1d-bc78daa5faed tempest-VolumesGetTest-720293127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-600395090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5a4b52b-5946-4abb-a894-017e38927e70,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d553ba4b271a44df88d94d52e4104064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:28:19Z,use_quota=True,user_id='08f5f2b4e8884331a5914c76b0275b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:28:19 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-45e7584b-432e-49e2-bd1d-bc78daa5faed tempest-VolumesGetTest-720293127 None] Creating volume f5a4b52b-5946-4abb-a894-017e38927e70 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:28:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-45e7584b-432e-49e2-bd1d-bc78daa5faed tempest-VolumesGetTest-720293127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-45e7584b-432e-49e2-bd1d-bc78daa5faed tempest-VolumesGetTest-720293127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:19 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-45e7584b-432e-49e2-bd1d-bc78daa5faed tempest-VolumesGetTest-720293127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:28:19 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-45e7584b-432e-49e2-bd1d-bc78daa5faed tempest-VolumesGetTest-720293127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:28:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-45e7584b-432e-49e2-bd1d-bc78daa5faed tempest-VolumesGetTest-720293127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:19 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-45e7584b-432e-49e2-bd1d-bc78daa5faed tempest-VolumesGetTest-720293127 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:28:19 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-45e7584b-432e-49e2-bd1d-bc78daa5faed tempest-VolumesGetTest-720293127 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:28:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-45e7584b-432e-49e2-bd1d-bc78daa5faed tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f5a4b52b-5946-4abb-a894-017e38927e70 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-139d695c-de48-494f-b8f6-2f25638c44e2 req-c5cbe031-61a1-4718-9243-98e7ab434344 tempest-VolumesGetTestJSON-152661806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14557646-fc33-4efb-ac99-f50432f6eef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e51e2e4-9746-4e3b-8511-63d8e44a71cc', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:19 devstack sudo[101177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f5a4b52b-5946-4abb-a894-017e38927e70 1073741824 Jul 16 23:28:19 devstack sudo[101177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-139d695c-de48-494f-b8f6-2f25638c44e2 req-c5cbe031-61a1-4718-9243-98e7ab434344 tempest-VolumesGetTestJSON-152661806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c42316e-a358-45c7-a383-dea77c9b2139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:19 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [req-139d695c-de48-494f-b8f6-2f25638c44e2 req-c5cbe031-61a1-4718-9243-98e7ab434344 tempest-VolumesGetTestJSON-152661806 None] Volume volume-8e51e2e4-9746-4e3b-8511-63d8e44a71cc (8e51e2e4-9746-4e3b-8511-63d8e44a71cc): created successfully Jul 16 23:28:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-139d695c-de48-494f-b8f6-2f25638c44e2 req-c5cbe031-61a1-4718-9243-98e7ab434344 tempest-VolumesGetTestJSON-152661806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c42316e-a358-45c7-a383-dea77c9b2139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-139d695c-de48-494f-b8f6-2f25638c44e2 req-c5cbe031-61a1-4718-9243-98e7ab434344 tempest-VolumesGetTestJSON-152661806 None] Flow 'volume_create_manager' (dcb6dd32-489e-4b29-93ca-8b45ed01753c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:28:19 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-139d695c-de48-494f-b8f6-2f25638c44e2 req-c5cbe031-61a1-4718-9243-98e7ab434344 tempest-VolumesGetTestJSON-152661806 None] Created volume successfully. Jul 16 23:28:19 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-c64b4ed3-bc29-4ed3-b69e-3f011f7b24aa tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Created reservations ['b7c0744c-b5e6-49ad-bd0f-d34dd14cb508', 'c480e830-3ab8-4226-b303-b462b726b73d', 'e3a039ab-1b71-47e5-830d-2c48aa3772e0', 'bda31778-2da3-4ce3-898b-aa518bb2b231'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:28:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c64b4ed3-bc29-4ed3-b69e-3f011f7b24aa tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c64b4ed3-bc29-4ed3-b69e-3f011f7b24aa tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:20 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-c64b4ed3-bc29-4ed3-b69e-3f011f7b24aa tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:28:20 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-c64b4ed3-bc29-4ed3-b69e-3f011f7b24aa tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:28:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c64b4ed3-bc29-4ed3-b69e-3f011f7b24aa tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c64b4ed3-bc29-4ed3-b69e-3f011f7b24aa tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:20 devstack sudo[101179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:28:20 devstack sudo[101179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:20 devstack sudo[101177]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-45e7584b-432e-49e2-bd1d-bc78daa5faed tempest-VolumesGetTest-720293127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f5a4b52b-5946-4abb-a894-017e38927e70 1073741824" returned: 0 in 0.510s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:20 devstack sudo[101179]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c64b4ed3-bc29-4ed3-b69e-3f011f7b24aa tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.306s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:20 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-c64b4ed3-bc29-4ed3-b69e-3f011f7b24aa tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:28:20 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-c64b4ed3-bc29-4ed3-b69e-3f011f7b24aa tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Deleted volume successfully. Jul 16 23:28:20 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c64b4ed3-bc29-4ed3-b69e-3f011f7b24aa tempest-CreateVolumesFromSourceVolumeTest-2036893909 None] Lock "cinder-b8225957-ebae-48d0-bcba-42f45fb27295-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:28:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-45e7584b-432e-49e2-bd1d-bc78daa5faed tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f5a4b52b-5946-4abb-a894-017e38927e70 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:20 devstack sudo[101186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f5a4b52b-5946-4abb-a894-017e38927e70 Jul 16 23:28:20 devstack sudo[101186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:20 devstack sudo[101186]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-45e7584b-432e-49e2-bd1d-bc78daa5faed tempest-VolumesGetTest-720293127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f5a4b52b-5946-4abb-a894-017e38927e70" returned: 0 in 0.260s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:20 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-45e7584b-432e-49e2-bd1d-bc78daa5faed tempest-VolumesGetTest-720293127 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:28:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-45e7584b-432e-49e2-bd1d-bc78daa5faed tempest-VolumesGetTest-720293127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:20 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-45e7584b-432e-49e2-bd1d-bc78daa5faed tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (069314b2-b554-4bad-b889-96761a6ba43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5a4b52b-5946-4abb-a894-017e38927e70', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:20 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-45e7584b-432e-49e2-bd1d-bc78daa5faed tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e97ade1c-a384-469e-8fa9-7a9ea02e63c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:20 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-45e7584b-432e-49e2-bd1d-bc78daa5faed tempest-VolumesGetTest-720293127 None] Volume volume-f5a4b52b-5946-4abb-a894-017e38927e70 (f5a4b52b-5946-4abb-a894-017e38927e70): created successfully Jul 16 23:28:20 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-45e7584b-432e-49e2-bd1d-bc78daa5faed tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e97ade1c-a384-469e-8fa9-7a9ea02e63c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:20 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-45e7584b-432e-49e2-bd1d-bc78daa5faed tempest-VolumesGetTest-720293127 None] Flow 'volume_create_manager' (7fe88571-0c72-4b6f-8ee2-9ca48138b540) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:28:20 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-45e7584b-432e-49e2-bd1d-bc78daa5faed tempest-VolumesGetTest-720293127 None] Created volume successfully. Jul 16 23:28:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [req-1ebddb8a-eb9a-4826-9269-bfb9e5c2ae9e req-52c4857c-a0be-403a-8075-525be7e5fb9c tempest-VolumesGetTestJSON-152661806 None] Acquiring lock "cinder-8e51e2e4-9746-4e3b-8511-63d8e44a71cc-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:28:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [req-1ebddb8a-eb9a-4826-9269-bfb9e5c2ae9e req-52c4857c-a0be-403a-8075-525be7e5fb9c tempest-VolumesGetTestJSON-152661806 None] Lock "cinder-8e51e2e4-9746-4e3b-8511-63d8e44a71cc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:28:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [req-1ebddb8a-eb9a-4826-9269-bfb9e5c2ae9e req-52c4857c-a0be-403a-8075-525be7e5fb9c tempest-VolumesGetTestJSON-152661806 None] Acquiring lock "cinder-quobyte-8e51e2e4-9746-4e3b-8511-63d8e44a71cc" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:28:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [req-1ebddb8a-eb9a-4826-9269-bfb9e5c2ae9e req-52c4857c-a0be-403a-8075-525be7e5fb9c tempest-VolumesGetTestJSON-152661806 None] Lock "cinder-quobyte-8e51e2e4-9746-4e3b-8511-63d8e44a71cc" acquired by "delete_volume" :: waited 0.024s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:28:21 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf7d1a1-801f-4429-8b4d-2eb53e6729d7]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:28:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-1ebddb8a-eb9a-4826-9269-bfb9e5c2ae9e req-52c4857c-a0be-403a-8075-525be7e5fb9c tempest-VolumesGetTestJSON-152661806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8e51e2e4-9746-4e3b-8511-63d8e44a71cc {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:21 devstack sudo[101189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8e51e2e4-9746-4e3b-8511-63d8e44a71cc Jul 16 23:28:21 devstack sudo[101189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:21 devstack sudo[101189]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-1ebddb8a-eb9a-4826-9269-bfb9e5c2ae9e req-52c4857c-a0be-403a-8075-525be7e5fb9c tempest-VolumesGetTestJSON-152661806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8e51e2e4-9746-4e3b-8511-63d8e44a71cc" returned: 0 in 0.536s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-1ebddb8a-eb9a-4826-9269-bfb9e5c2ae9e req-52c4857c-a0be-403a-8075-525be7e5fb9c tempest-VolumesGetTestJSON-152661806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8e51e2e4-9746-4e3b-8511-63d8e44a71cc {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:22 devstack sudo[101195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8e51e2e4-9746-4e3b-8511-63d8e44a71cc Jul 16 23:28:22 devstack sudo[101195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:22 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:SELECT=213,cinder:UPDATE=243,cinder:INSERT=72,cinder:DELETE=22 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:28:22 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:UPDATE=272,cinder:DELETE=20,cinder:SELECT=190,cinder:INSERT=66 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:28:22 devstack sudo[101195]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:22 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-13768d86-8b99-49a2-aefd-8623df88e494 tempest-VolumesGetTest-720293127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:28:22 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-13768d86-8b99-49a2-aefd-8623df88e494 tempest-VolumesGetTest-720293127 None] Flow 'volume_create_manager' (5e8cab0e-b64b-4d12-8eeb-52ccb80f62e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:28:22 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-13768d86-8b99-49a2-aefd-8623df88e494 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ebca0f9-1089-46aa-99e6-8c78ffcbca33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-1ebddb8a-eb9a-4826-9269-bfb9e5c2ae9e req-52c4857c-a0be-403a-8075-525be7e5fb9c tempest-VolumesGetTestJSON-152661806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8e51e2e4-9746-4e3b-8511-63d8e44a71cc" returned: 0 in 0.469s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:22 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-13768d86-8b99-49a2-aefd-8623df88e494 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ebca0f9-1089-46aa-99e6-8c78ffcbca33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:28:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-860766402',display_name='tempest-VolumesGetTest-Volume-1937433911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6404ab4a-4d3a-443d-bc18-6b4ba457f442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d553ba4b271a44df88d94d52e4104064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:28:22Z,use_quota=True,user_id='08f5f2b4e8884331a5914c76b0275b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:22 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-13768d86-8b99-49a2-aefd-8623df88e494 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a310a7a-ac3a-4396-937f-e43a2038c91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:22 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-13768d86-8b99-49a2-aefd-8623df88e494 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a310a7a-ac3a-4396-937f-e43a2038c91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:22 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-13768d86-8b99-49a2-aefd-8623df88e494 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb303921-b371-456a-a2e1-9a663974d59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:22 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-13768d86-8b99-49a2-aefd-8623df88e494 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb303921-b371-456a-a2e1-9a663974d59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6404ab4a-4d3a-443d-bc18-6b4ba457f442', 'volume_name': 'volume-6404ab4a-4d3a-443d-bc18-6b4ba457f442', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:22 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-13768d86-8b99-49a2-aefd-8623df88e494 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74271679-6d61-449c-ae5b-2e9448adff91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:22 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-13768d86-8b99-49a2-aefd-8623df88e494 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74271679-6d61-449c-ae5b-2e9448adff91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:22 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-13768d86-8b99-49a2-aefd-8623df88e494 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65932035-556c-48c5-bd0a-45a38bc63ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:22 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-13768d86-8b99-49a2-aefd-8623df88e494 tempest-VolumesGetTest-720293127 None] Volume 6404ab4a-4d3a-443d-bc18-6b4ba457f442: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6404ab4a-4d3a-443d-bc18-6b4ba457f442', 'volume_size': 1} Jul 16 23:28:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-13768d86-8b99-49a2-aefd-8623df88e494 tempest-VolumesGetTest-720293127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-13768d86-8b99-49a2-aefd-8623df88e494 tempest-VolumesGetTest-720293127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:22 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-13768d86-8b99-49a2-aefd-8623df88e494 tempest-VolumesGetTest-720293127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:28:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-860766402',display_name='tempest-VolumesGetTest-Volume-1937433911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6404ab4a-4d3a-443d-bc18-6b4ba457f442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d553ba4b271a44df88d94d52e4104064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:28:22Z,use_quota=True,user_id='08f5f2b4e8884331a5914c76b0275b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:28:22 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-13768d86-8b99-49a2-aefd-8623df88e494 tempest-VolumesGetTest-720293127 None] Creating volume 6404ab4a-4d3a-443d-bc18-6b4ba457f442 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:28:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-13768d86-8b99-49a2-aefd-8623df88e494 tempest-VolumesGetTest-720293127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-13768d86-8b99-49a2-aefd-8623df88e494 tempest-VolumesGetTest-720293127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:22 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-13768d86-8b99-49a2-aefd-8623df88e494 tempest-VolumesGetTest-720293127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:28:22 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-13768d86-8b99-49a2-aefd-8623df88e494 tempest-VolumesGetTest-720293127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:28:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-13768d86-8b99-49a2-aefd-8623df88e494 tempest-VolumesGetTest-720293127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:22 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-13768d86-8b99-49a2-aefd-8623df88e494 tempest-VolumesGetTest-720293127 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:28:22 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-13768d86-8b99-49a2-aefd-8623df88e494 tempest-VolumesGetTest-720293127 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:28:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-13768d86-8b99-49a2-aefd-8623df88e494 tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6404ab4a-4d3a-443d-bc18-6b4ba457f442 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:22 devstack cinder-volume[87607]: DEBUG cinder.coordination [req-1ebddb8a-eb9a-4826-9269-bfb9e5c2ae9e req-52c4857c-a0be-403a-8075-525be7e5fb9c tempest-VolumesGetTestJSON-152661806 None] Lock "cinder-quobyte-8e51e2e4-9746-4e3b-8511-63d8e44a71cc" released by "delete_volume" :: held 1.178s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:28:22 devstack sudo[101198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6404ab4a-4d3a-443d-bc18-6b4ba457f442 1073741824 Jul 16 23:28:22 devstack sudo[101198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:22 devstack cinder-volume[87607]: DEBUG cinder.quota [req-1ebddb8a-eb9a-4826-9269-bfb9e5c2ae9e req-52c4857c-a0be-403a-8075-525be7e5fb9c tempest-VolumesGetTestJSON-152661806 None] Created reservations ['7525e5f3-381d-4024-9e30-61b3c0f0def8', 'e72b943a-3aa2-4221-bba4-6c1998ff4e18', 'ebd25b39-30ff-43a4-911f-6a214c193177', '225a3860-c83c-4a9c-93c6-d81fe7e7e9c7'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:28:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-1ebddb8a-eb9a-4826-9269-bfb9e5c2ae9e req-52c4857c-a0be-403a-8075-525be7e5fb9c tempest-VolumesGetTestJSON-152661806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-1ebddb8a-eb9a-4826-9269-bfb9e5c2ae9e req-52c4857c-a0be-403a-8075-525be7e5fb9c tempest-VolumesGetTestJSON-152661806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:22 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [req-1ebddb8a-eb9a-4826-9269-bfb9e5c2ae9e req-52c4857c-a0be-403a-8075-525be7e5fb9c tempest-VolumesGetTestJSON-152661806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:28:22 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [req-1ebddb8a-eb9a-4826-9269-bfb9e5c2ae9e req-52c4857c-a0be-403a-8075-525be7e5fb9c tempest-VolumesGetTestJSON-152661806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:28:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-1ebddb8a-eb9a-4826-9269-bfb9e5c2ae9e req-52c4857c-a0be-403a-8075-525be7e5fb9c tempest-VolumesGetTestJSON-152661806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-1ebddb8a-eb9a-4826-9269-bfb9e5c2ae9e req-52c4857c-a0be-403a-8075-525be7e5fb9c tempest-VolumesGetTestJSON-152661806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:22 devstack sudo[101200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:28:22 devstack sudo[101200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:23 devstack sudo[101200]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-1ebddb8a-eb9a-4826-9269-bfb9e5c2ae9e req-52c4857c-a0be-403a-8075-525be7e5fb9c tempest-VolumesGetTestJSON-152661806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.293s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:23 devstack cinder-volume[87607]: DEBUG cinder.manager [req-1ebddb8a-eb9a-4826-9269-bfb9e5c2ae9e req-52c4857c-a0be-403a-8075-525be7e5fb9c tempest-VolumesGetTestJSON-152661806 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:28:23 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-1ebddb8a-eb9a-4826-9269-bfb9e5c2ae9e req-52c4857c-a0be-403a-8075-525be7e5fb9c tempest-VolumesGetTestJSON-152661806 None] Deleted volume successfully. Jul 16 23:28:23 devstack cinder-volume[87607]: DEBUG cinder.coordination [req-1ebddb8a-eb9a-4826-9269-bfb9e5c2ae9e req-52c4857c-a0be-403a-8075-525be7e5fb9c tempest-VolumesGetTestJSON-152661806 None] Lock "cinder-8e51e2e4-9746-4e3b-8511-63d8e44a71cc-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:28:23 devstack sudo[101198]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-13768d86-8b99-49a2-aefd-8623df88e494 tempest-VolumesGetTest-720293127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6404ab4a-4d3a-443d-bc18-6b4ba457f442 1073741824" returned: 0 in 0.579s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-13768d86-8b99-49a2-aefd-8623df88e494 tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6404ab4a-4d3a-443d-bc18-6b4ba457f442 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:23 devstack sudo[101207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6404ab4a-4d3a-443d-bc18-6b4ba457f442 Jul 16 23:28:23 devstack sudo[101207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:23 devstack sudo[101207]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-13768d86-8b99-49a2-aefd-8623df88e494 tempest-VolumesGetTest-720293127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6404ab4a-4d3a-443d-bc18-6b4ba457f442" returned: 0 in 0.289s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:23 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-13768d86-8b99-49a2-aefd-8623df88e494 tempest-VolumesGetTest-720293127 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:28:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-13768d86-8b99-49a2-aefd-8623df88e494 tempest-VolumesGetTest-720293127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-13768d86-8b99-49a2-aefd-8623df88e494 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65932035-556c-48c5-bd0a-45a38bc63ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6404ab4a-4d3a-443d-bc18-6b4ba457f442', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-13768d86-8b99-49a2-aefd-8623df88e494 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c954b2b6-ecff-4c32-9474-1ca891574d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:23 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-13768d86-8b99-49a2-aefd-8623df88e494 tempest-VolumesGetTest-720293127 None] Volume volume-6404ab4a-4d3a-443d-bc18-6b4ba457f442 (6404ab4a-4d3a-443d-bc18-6b4ba457f442): created successfully Jul 16 23:28:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-13768d86-8b99-49a2-aefd-8623df88e494 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c954b2b6-ecff-4c32-9474-1ca891574d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-13768d86-8b99-49a2-aefd-8623df88e494 tempest-VolumesGetTest-720293127 None] Flow 'volume_create_manager' (5e8cab0e-b64b-4d12-8eeb-52ccb80f62e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:28:23 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-13768d86-8b99-49a2-aefd-8623df88e494 tempest-VolumesGetTest-720293127 None] Created volume successfully. Jul 16 23:28:24 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d1e8c1fa-4617-40ad-8677-bd037ead4afa tempest-VolumesGetTest-720293127 None] Acquiring lock "cinder-6404ab4a-4d3a-443d-bc18-6b4ba457f442-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:28:24 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d1e8c1fa-4617-40ad-8677-bd037ead4afa tempest-VolumesGetTest-720293127 None] Lock "cinder-6404ab4a-4d3a-443d-bc18-6b4ba457f442-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:28:24 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d1e8c1fa-4617-40ad-8677-bd037ead4afa tempest-VolumesGetTest-720293127 None] Acquiring lock "cinder-quobyte-6404ab4a-4d3a-443d-bc18-6b4ba457f442" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:28:24 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d1e8c1fa-4617-40ad-8677-bd037ead4afa tempest-VolumesGetTest-720293127 None] Lock "cinder-quobyte-6404ab4a-4d3a-443d-bc18-6b4ba457f442" acquired by "delete_volume" :: waited 0.030s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:28:24 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db74127-4145-448d-81f7-695754afc983]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:28:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d1e8c1fa-4617-40ad-8677-bd037ead4afa tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6404ab4a-4d3a-443d-bc18-6b4ba457f442 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:25 devstack sudo[101210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6404ab4a-4d3a-443d-bc18-6b4ba457f442 Jul 16 23:28:25 devstack sudo[101210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:25 devstack sudo[101210]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d1e8c1fa-4617-40ad-8677-bd037ead4afa tempest-VolumesGetTest-720293127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6404ab4a-4d3a-443d-bc18-6b4ba457f442" returned: 0 in 0.455s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d1e8c1fa-4617-40ad-8677-bd037ead4afa tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6404ab4a-4d3a-443d-bc18-6b4ba457f442 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:25 devstack sudo[101215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6404ab4a-4d3a-443d-bc18-6b4ba457f442 Jul 16 23:28:25 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:25 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d1e8c1fa-4617-40ad-8677-bd037ead4afa tempest-VolumesGetTest-720293127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6404ab4a-4d3a-443d-bc18-6b4ba457f442" returned: 0 in 0.321s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:25 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d1e8c1fa-4617-40ad-8677-bd037ead4afa tempest-VolumesGetTest-720293127 None] Lock "cinder-quobyte-6404ab4a-4d3a-443d-bc18-6b4ba457f442" released by "delete_volume" :: held 0.843s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:28:25 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-d1e8c1fa-4617-40ad-8677-bd037ead4afa tempest-VolumesGetTest-720293127 None] Created reservations ['36311f63-6950-44d0-b765-bb40dd2c70af', 'ddbaf152-98ec-4ee5-b5d5-fe3dc3b0eef7', 'd6176d4f-3e1c-433e-a6d7-f221cbe521bd', '858e23b6-81a2-4930-8f46-d2d80c507fa3'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:28:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-d1e8c1fa-4617-40ad-8677-bd037ead4afa tempest-VolumesGetTest-720293127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-d1e8c1fa-4617-40ad-8677-bd037ead4afa tempest-VolumesGetTest-720293127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:25 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-d1e8c1fa-4617-40ad-8677-bd037ead4afa tempest-VolumesGetTest-720293127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:28:25 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-d1e8c1fa-4617-40ad-8677-bd037ead4afa tempest-VolumesGetTest-720293127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:28:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-d1e8c1fa-4617-40ad-8677-bd037ead4afa tempest-VolumesGetTest-720293127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d1e8c1fa-4617-40ad-8677-bd037ead4afa tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:26 devstack sudo[101218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:28:26 devstack sudo[101218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:26 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d72bab10-857c-426a-9f5a-67079728cd86 tempest-VolumesGetTest-720293127 None] Acquiring lock "cinder-f5a4b52b-5946-4abb-a894-017e38927e70-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:28:26 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d72bab10-857c-426a-9f5a-67079728cd86 tempest-VolumesGetTest-720293127 None] Lock "cinder-f5a4b52b-5946-4abb-a894-017e38927e70-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:28:26 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d72bab10-857c-426a-9f5a-67079728cd86 tempest-VolumesGetTest-720293127 None] Acquiring lock "cinder-quobyte-f5a4b52b-5946-4abb-a894-017e38927e70" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:28:26 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d72bab10-857c-426a-9f5a-67079728cd86 tempest-VolumesGetTest-720293127 None] Lock "cinder-quobyte-f5a4b52b-5946-4abb-a894-017e38927e70" acquired by "delete_volume" :: waited 0.019s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:28:26 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b18087-38b2-4893-91ed-79c1480bdbd3]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:28:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d72bab10-857c-426a-9f5a-67079728cd86 tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f5a4b52b-5946-4abb-a894-017e38927e70 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:26 devstack sudo[101218]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d1e8c1fa-4617-40ad-8677-bd037ead4afa tempest-VolumesGetTest-720293127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.284s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:26 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-d1e8c1fa-4617-40ad-8677-bd037ead4afa tempest-VolumesGetTest-720293127 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:28:26 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-d1e8c1fa-4617-40ad-8677-bd037ead4afa tempest-VolumesGetTest-720293127 None] Deleted volume successfully. Jul 16 23:28:26 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d1e8c1fa-4617-40ad-8677-bd037ead4afa tempest-VolumesGetTest-720293127 None] Lock "cinder-6404ab4a-4d3a-443d-bc18-6b4ba457f442-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:28:26 devstack sudo[101221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f5a4b52b-5946-4abb-a894-017e38927e70 Jul 16 23:28:26 devstack sudo[101221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:26 devstack sudo[101221]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d72bab10-857c-426a-9f5a-67079728cd86 tempest-VolumesGetTest-720293127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f5a4b52b-5946-4abb-a894-017e38927e70" returned: 0 in 0.566s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d72bab10-857c-426a-9f5a-67079728cd86 tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f5a4b52b-5946-4abb-a894-017e38927e70 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:26 devstack sudo[101226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f5a4b52b-5946-4abb-a894-017e38927e70 Jul 16 23:28:26 devstack sudo[101226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:27 devstack sudo[101226]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d72bab10-857c-426a-9f5a-67079728cd86 tempest-VolumesGetTest-720293127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f5a4b52b-5946-4abb-a894-017e38927e70" returned: 0 in 0.310s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:27 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d72bab10-857c-426a-9f5a-67079728cd86 tempest-VolumesGetTest-720293127 None] Lock "cinder-quobyte-f5a4b52b-5946-4abb-a894-017e38927e70" released by "delete_volume" :: held 0.941s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:28:27 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-d72bab10-857c-426a-9f5a-67079728cd86 tempest-VolumesGetTest-720293127 None] Created reservations ['83db76bf-d388-498b-8d73-676599a81118', 'f7c5aac7-d7fc-4428-b206-8c287ed63467', 'edd3903b-9f99-48df-8518-0c51371685a3', 'f5ea3832-ea09-4de8-9334-4053aef7f99e'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:28:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-d72bab10-857c-426a-9f5a-67079728cd86 tempest-VolumesGetTest-720293127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-d72bab10-857c-426a-9f5a-67079728cd86 tempest-VolumesGetTest-720293127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:27 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-d72bab10-857c-426a-9f5a-67079728cd86 tempest-VolumesGetTest-720293127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:28:27 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-d72bab10-857c-426a-9f5a-67079728cd86 tempest-VolumesGetTest-720293127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:28:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-d72bab10-857c-426a-9f5a-67079728cd86 tempest-VolumesGetTest-720293127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d72bab10-857c-426a-9f5a-67079728cd86 tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:27 devstack sudo[101229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:28:27 devstack sudo[101229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:27 devstack sudo[101229]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d72bab10-857c-426a-9f5a-67079728cd86 tempest-VolumesGetTest-720293127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.315s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:27 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-d72bab10-857c-426a-9f5a-67079728cd86 tempest-VolumesGetTest-720293127 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:28:27 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-d72bab10-857c-426a-9f5a-67079728cd86 tempest-VolumesGetTest-720293127 None] Deleted volume successfully. Jul 16 23:28:27 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d72bab10-857c-426a-9f5a-67079728cd86 tempest-VolumesGetTest-720293127 None] Lock "cinder-f5a4b52b-5946-4abb-a894-017e38927e70-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:28:28 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:28:28 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Flow 'volume_create_manager' (be638bf8-605b-4cb7-8283-9a85a49624a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:28:28 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (852888d8-939c-4578-8a7b-915fe3d30ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:28 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (852888d8-939c-4578-8a7b-915fe3d30ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd794a89-2e97-4e68-9508-441f4aca2898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e38488cb5d694b80abfc7bf1fcf4cfbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:28:28Z,use_quota=True,user_id='bfb248dd77a9440cae57ceb70096b5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:28 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (962e880f-35cf-4cf1-b30c-05b59f30d356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:28 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (962e880f-35cf-4cf1-b30c-05b59f30d356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:28 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f74a52fd-7f2a-4fa8-b6a7-0c2533605da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:28 devstack cinder-volume[87607]: DEBUG cinder.image.glance [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Creating Keystone auth plugin from conf {{(pid=87607) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 16 23:28:28 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f74a52fd-7f2a-4fa8-b6a7-0c2533605da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cd794a89-2e97-4e68-9508-441f4aca2898', 'volume_name': 'volume-cd794a89-2e97-4e68-9508-441f4aca2898', 'volume_size': 1, 'image_id': 'bedd87e7-7cde-4d24-9396-f303eeb1c97b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bedd87e7-7cde-4d24-9396-f303eeb1c97b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f9d7d24767c26f73b1f74df9f5a3f30f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e38488cb5d694b80abfc7bf1fcf4cfbd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2f9ae33d72697fe125d4fb4d92e791cbdadb025f8a4e0bf72d361c61ac2c852246523fdc776075353827821e0e2af6f22a95358d5703d222126e752dd611edc2', 'id': 'bedd87e7-7cde-4d24-9396-f303eeb1c97b', 'created_at': datetime.datetime(2026, 7, 16, 21, 28, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 21, 28, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bedd87e7-7cde-4d24-9396-f303eeb1c97b/file', 'properties': {}}, 'image_service': }' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:28 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d40f5d6f-eba6-4954-bc0d-9afa7601fd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:28 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d40f5d6f-eba6-4954-bc0d-9afa7601fd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:28 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9145c8c4-51e4-4d15-b650-37556ddeb789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:28 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Volume cd794a89-2e97-4e68-9508-441f4aca2898: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cd794a89-2e97-4e68-9508-441f4aca2898', 'volume_size': 1, 'image_id': 'bedd87e7-7cde-4d24-9396-f303eeb1c97b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bedd87e7-7cde-4d24-9396-f303eeb1c97b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f9d7d24767c26f73b1f74df9f5a3f30f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e38488cb5d694b80abfc7bf1fcf4cfbd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2f9ae33d72697fe125d4fb4d92e791cbdadb025f8a4e0bf72d361c61ac2c852246523fdc776075353827821e0e2af6f22a95358d5703d222126e752dd611edc2', 'id': 'bedd87e7-7cde-4d24-9396-f303eeb1c97b', 'created_at': datetime.datetime(2026, 7, 16, 21, 28, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 21, 28, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bedd87e7-7cde-4d24-9396-f303eeb1c97b/file', 'properties': {}}, 'image_service': } Jul 16 23:28:28 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Trying to clone cd794a89-2e97-4e68-9508-441f4aca2898 from image bedd87e7-7cde-4d24-9396-f303eeb1c97b at location (None, [{'url': 'file:///opt/stack/data/glance/images/bedd87e7-7cde-4d24-9396-f303eeb1c97b', 'metadata': {}}]). {{(pid=87607) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 16 23:28:29 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bedd87e7-7cde-4d24-9396-f303eeb1c97b_mhjwvsdgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87607) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 16 23:28:29 devstack cinder-volume[87607]: INFO cinder.image.image_utils [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Image download 0.00 MB at 0.00 MB/s Jul 16 23:28:29 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-5076e14a-333d-498a-b735-3444084c5f0e tempest-VolumesGetTest-720293127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:28:29 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5076e14a-333d-498a-b735-3444084c5f0e tempest-VolumesGetTest-720293127 None] Flow 'volume_create_manager' (1c00e387-40df-423f-9ebd-acc9088eb7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:28:29 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5076e14a-333d-498a-b735-3444084c5f0e tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7542b43-9065-4919-8a95-1afc3effd165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:29 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-f2772fd9-1541-4ecd-a84e-79c232e7ee51 tempest-GroupsV314Test-445628626 None] Group tempest-GroupsV314Test-Group-488125999: creating Jul 16 23:28:29 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5076e14a-333d-498a-b735-3444084c5f0e tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7542b43-9065-4919-8a95-1afc3effd165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1203257377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eb28b11-f816-4fde-a6f3-4fa38165e297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d553ba4b271a44df88d94d52e4104064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:28:29Z,use_quota=True,user_id='08f5f2b4e8884331a5914c76b0275b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:29 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5076e14a-333d-498a-b735-3444084c5f0e tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6f85103-d322-4491-b667-854475ae7fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:29 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5076e14a-333d-498a-b735-3444084c5f0e tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6f85103-d322-4491-b667-854475ae7fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:29 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5076e14a-333d-498a-b735-3444084c5f0e tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5746bc0d-8050-4b6b-bfad-f3be4dc43940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:29 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5076e14a-333d-498a-b735-3444084c5f0e tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5746bc0d-8050-4b6b-bfad-f3be4dc43940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4eb28b11-f816-4fde-a6f3-4fa38165e297', 'volume_name': 'volume-4eb28b11-f816-4fde-a6f3-4fa38165e297', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:29 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5076e14a-333d-498a-b735-3444084c5f0e tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a890cd39-30aa-46fe-a3cf-86468775c34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:29 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5076e14a-333d-498a-b735-3444084c5f0e tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a890cd39-30aa-46fe-a3cf-86468775c34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:29 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5076e14a-333d-498a-b735-3444084c5f0e tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a17d063-a0e1-4494-881e-bddd8d22a7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:29 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-5076e14a-333d-498a-b735-3444084c5f0e tempest-VolumesGetTest-720293127 None] Volume 4eb28b11-f816-4fde-a6f3-4fa38165e297: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4eb28b11-f816-4fde-a6f3-4fa38165e297', 'volume_size': 1} Jul 16 23:28:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5076e14a-333d-498a-b735-3444084c5f0e tempest-VolumesGetTest-720293127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5076e14a-333d-498a-b735-3444084c5f0e tempest-VolumesGetTest-720293127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:29 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-5076e14a-333d-498a-b735-3444084c5f0e tempest-VolumesGetTest-720293127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1203257377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eb28b11-f816-4fde-a6f3-4fa38165e297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d553ba4b271a44df88d94d52e4104064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:28:29Z,use_quota=True,user_id='08f5f2b4e8884331a5914c76b0275b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:28:29 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-5076e14a-333d-498a-b735-3444084c5f0e tempest-VolumesGetTest-720293127 None] Creating volume 4eb28b11-f816-4fde-a6f3-4fa38165e297 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:28:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5076e14a-333d-498a-b735-3444084c5f0e tempest-VolumesGetTest-720293127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5076e14a-333d-498a-b735-3444084c5f0e tempest-VolumesGetTest-720293127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:29 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-5076e14a-333d-498a-b735-3444084c5f0e tempest-VolumesGetTest-720293127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:28:29 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-5076e14a-333d-498a-b735-3444084c5f0e tempest-VolumesGetTest-720293127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:28:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5076e14a-333d-498a-b735-3444084c5f0e tempest-VolumesGetTest-720293127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:29 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-5076e14a-333d-498a-b735-3444084c5f0e tempest-VolumesGetTest-720293127 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:28:29 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-5076e14a-333d-498a-b735-3444084c5f0e tempest-VolumesGetTest-720293127 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:28:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5076e14a-333d-498a-b735-3444084c5f0e tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:29 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04490df-7ad0-4bae-8b15-a8dc8facdd28]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:28:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bedd87e7-7cde-4d24-9396-f303eeb1c97b_mhjwvsdgdevstack@QuobyteHD {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:29 devstack sudo[101233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297 1073741824 Jul 16 23:28:29 devstack sudo[101233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:29 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-f2772fd9-1541-4ecd-a84e-79c232e7ee51 tempest-GroupsV314Test-445628626 None] Group tempest-GroupsV314Test-Group-488125999: created successfully Jul 16 23:28:29 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-f2772fd9-1541-4ecd-a84e-79c232e7ee51 tempest-GroupsV314Test-445628626 None] Create group completed successfully. Jul 16 23:28:29 devstack sudo[101234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bedd87e7-7cde-4d24-9396-f303eeb1c97b_mhjwvsdgdevstack@QuobyteHD Jul 16 23:28:29 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:29 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bedd87e7-7cde-4d24-9396-f303eeb1c97b_mhjwvsdgdevstack@QuobyteHD" returned: 0 in 0.377s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bedd87e7-7cde-4d24-9396-f303eeb1c97b_mhjwvsdgdevstack@QuobyteHD {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:29 devstack sudo[101242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bedd87e7-7cde-4d24-9396-f303eeb1c97b_mhjwvsdgdevstack@QuobyteHD Jul 16 23:28:29 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:29 devstack sudo[101233]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5076e14a-333d-498a-b735-3444084c5f0e tempest-VolumesGetTest-720293127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297 1073741824" returned: 0 in 0.545s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5076e14a-333d-498a-b735-3444084c5f0e tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:29 devstack sudo[101244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297 Jul 16 23:28:29 devstack sudo[101244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:30 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bedd87e7-7cde-4d24-9396-f303eeb1c97b_mhjwvsdgdevstack@QuobyteHD" returned: 1 in 0.359s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bedd87e7-7cde-4d24-9396-f303eeb1c97b_mhjwvsdgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 23:28:30 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Temporary image bedd87e7-7cde-4d24-9396-f303eeb1c97b is fetched for user bfb248dd77a9440cae57ceb70096b5ec. {{(pid=87607) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 16 23:28:30 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[72860aed-aaf4-44cd-ae8e-397c185d2347]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:28:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bedd87e7-7cde-4d24-9396-f303eeb1c97b_mhjwvsdgdevstack@QuobyteHD {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:30 devstack sudo[101244]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5076e14a-333d-498a-b735-3444084c5f0e tempest-VolumesGetTest-720293127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297" returned: 0 in 0.306s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:30 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-5076e14a-333d-498a-b735-3444084c5f0e tempest-VolumesGetTest-720293127 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:28:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5076e14a-333d-498a-b735-3444084c5f0e tempest-VolumesGetTest-720293127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:30 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5076e14a-333d-498a-b735-3444084c5f0e tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a17d063-a0e1-4494-881e-bddd8d22a7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4eb28b11-f816-4fde-a6f3-4fa38165e297', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:30 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5076e14a-333d-498a-b735-3444084c5f0e tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01479434-1291-4c59-90e0-a2c1975f19d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:30 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-5076e14a-333d-498a-b735-3444084c5f0e tempest-VolumesGetTest-720293127 None] Volume volume-4eb28b11-f816-4fde-a6f3-4fa38165e297 (4eb28b11-f816-4fde-a6f3-4fa38165e297): created successfully Jul 16 23:28:30 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5076e14a-333d-498a-b735-3444084c5f0e tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01479434-1291-4c59-90e0-a2c1975f19d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:30 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-5076e14a-333d-498a-b735-3444084c5f0e tempest-VolumesGetTest-720293127 None] Flow 'volume_create_manager' (1c00e387-40df-423f-9ebd-acc9088eb7a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:28:30 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-5076e14a-333d-498a-b735-3444084c5f0e tempest-VolumesGetTest-720293127 None] Created volume successfully. Jul 16 23:28:30 devstack sudo[101250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bedd87e7-7cde-4d24-9396-f303eeb1c97b_mhjwvsdgdevstack@QuobyteHD Jul 16 23:28:30 devstack sudo[101250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:30 devstack sudo[101250]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bedd87e7-7cde-4d24-9396-f303eeb1c97b_mhjwvsdgdevstack@QuobyteHD" returned: 0 in 0.423s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bedd87e7-7cde-4d24-9396-f303eeb1c97b_mhjwvsdgdevstack@QuobyteHD {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:30 devstack sudo[101254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bedd87e7-7cde-4d24-9396-f303eeb1c97b_mhjwvsdgdevstack@QuobyteHD Jul 16 23:28:30 devstack sudo[101254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:30 devstack sudo[101254]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bedd87e7-7cde-4d24-9396-f303eeb1c97b_mhjwvsdgdevstack@QuobyteHD" returned: 1 in 0.402s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bedd87e7-7cde-4d24-9396-f303eeb1c97b_mhjwvsdgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 23:28:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:30 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd794a89-2e97-4e68-9508-441f4aca2898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e38488cb5d694b80abfc7bf1fcf4cfbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:28:28Z,use_quota=True,user_id='bfb248dd77a9440cae57ceb70096b5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:28:30 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Creating volume cd794a89-2e97-4e68-9508-441f4aca2898 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:28:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:30 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:28:31 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:28:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:31 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:28:31 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:28:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cd794a89-2e97-4e68-9508-441f4aca2898 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:31 devstack sudo[101259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cd794a89-2e97-4e68-9508-441f4aca2898 1073741824 Jul 16 23:28:31 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-377d229f-7608-418e-9011-1f253683dd05 tempest-GroupsV314Test-445628626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:28:31 devstack sudo[101259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:31 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-377d229f-7608-418e-9011-1f253683dd05 tempest-GroupsV314Test-445628626 None] Flow 'volume_create_manager' (495747d3-e04b-42a2-a1b2-9ddf2b50cea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:28:31 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-377d229f-7608-418e-9011-1f253683dd05 tempest-GroupsV314Test-445628626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a58387d8-07fa-416d-b042-8acf603e91fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:31 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-377d229f-7608-418e-9011-1f253683dd05 tempest-GroupsV314Test-445628626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a58387d8-07fa-416d-b042-8acf603e91fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1113682324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=482c81e2-76ef-4cf7-8ec9-75c38db6643d,host='devstack@QuobyteHD#QuobyteHD',id=20775ce2-4b11-4f12-a23f-c657f02a1865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3848aeeb6f0428a9c3532624184ea6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:28:31Z,use_quota=True,user_id='4d8f8a93b1624c1db51693942ed0fe5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7207daa8-c2e1-45e6-a88a-355fc5840529),volume_type_id=7207daa8-c2e1-45e6-a88a-355fc5840529)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:31 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-377d229f-7608-418e-9011-1f253683dd05 tempest-GroupsV314Test-445628626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (877e5ff1-e36f-482f-a96a-5ff22debb161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:31 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-377d229f-7608-418e-9011-1f253683dd05 tempest-GroupsV314Test-445628626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (877e5ff1-e36f-482f-a96a-5ff22debb161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:31 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-377d229f-7608-418e-9011-1f253683dd05 tempest-GroupsV314Test-445628626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb4f1eba-4f18-4a61-8f86-88a15263ff9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:31 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-377d229f-7608-418e-9011-1f253683dd05 tempest-GroupsV314Test-445628626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb4f1eba-4f18-4a61-8f86-88a15263ff9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20775ce2-4b11-4f12-a23f-c657f02a1865', 'volume_name': 'volume-20775ce2-4b11-4f12-a23f-c657f02a1865', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:31 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-377d229f-7608-418e-9011-1f253683dd05 tempest-GroupsV314Test-445628626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4557c6b-b830-464d-96e1-1032db770805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:31 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-377d229f-7608-418e-9011-1f253683dd05 tempest-GroupsV314Test-445628626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4557c6b-b830-464d-96e1-1032db770805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:31 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-377d229f-7608-418e-9011-1f253683dd05 tempest-GroupsV314Test-445628626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee2a78b8-9df7-4d9f-a4b3-e1812eb4a2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:31 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-377d229f-7608-418e-9011-1f253683dd05 tempest-GroupsV314Test-445628626 None] Volume 20775ce2-4b11-4f12-a23f-c657f02a1865: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20775ce2-4b11-4f12-a23f-c657f02a1865', 'volume_size': 1} Jul 16 23:28:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-377d229f-7608-418e-9011-1f253683dd05 tempest-GroupsV314Test-445628626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:31 devstack sudo[101259]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cd794a89-2e97-4e68-9508-441f4aca2898 1073741824" returned: 0 in 0.834s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cd794a89-2e97-4e68-9508-441f4aca2898 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:31 devstack sudo[101265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cd794a89-2e97-4e68-9508-441f4aca2898 Jul 16 23:28:31 devstack sudo[101265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:32 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:28:32 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Flow 'volume_create_manager' (88790bde-f0a1-4d34-bbe5-3395eaf0f935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:28:32 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e216143a-28e7-4c9b-83f1-771539392954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:32 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e216143a-28e7-4c9b-83f1-771539392954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-795707737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a872c0f-59c0-4aed-b59b-12ee9c9a4ac3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d553ba4b271a44df88d94d52e4104064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=4eb28b11-f816-4fde-a6f3-4fa38165e297,status='creating',terminated_at=None,updated_at=2026-07-16T21:28:32Z,use_quota=True,user_id='08f5f2b4e8884331a5914c76b0275b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:32 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91db2ff2-afcd-43f8-a7b9-7617874f77cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:32 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91db2ff2-afcd-43f8-a7b9-7617874f77cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:32 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da6af69f-4b9d-4440-b6d0-288c26a02327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:32 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da6af69f-4b9d-4440-b6d0-288c26a02327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2a872c0f-59c0-4aed-b59b-12ee9c9a4ac3', 'volume_name': 'volume-2a872c0f-59c0-4aed-b59b-12ee9c9a4ac3', 'volume_size': 1, 'source_volid': '4eb28b11-f816-4fde-a6f3-4fa38165e297', 'source_volstatus': 'available'}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:32 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccee87c8-7625-4362-8c88-b40ebdf1edbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:32 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccee87c8-7625-4362-8c88-b40ebdf1edbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:32 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e014329-1209-49c0-897e-bf9a04938fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:32 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Volume 2a872c0f-59c0-4aed-b59b-12ee9c9a4ac3: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2a872c0f-59c0-4aed-b59b-12ee9c9a4ac3', 'volume_size': 1, 'source_volid': '4eb28b11-f816-4fde-a6f3-4fa38165e297', 'source_volstatus': 'available'} Jul 16 23:28:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:32 devstack sudo[101265]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cd794a89-2e97-4e68-9508-441f4aca2898" returned: 0 in 0.280s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:32 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:28:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-377d229f-7608-418e-9011-1f253683dd05 tempest-GroupsV314Test-445628626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.946s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:32 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-377d229f-7608-418e-9011-1f253683dd05 tempest-GroupsV314Test-445628626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=482c81e2-76ef-4cf7-8ec9-75c38db6643d,created_at=2026-07-16T21:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1113682324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=482c81e2-76ef-4cf7-8ec9-75c38db6643d,host='devstack@QuobyteHD#QuobyteHD',id=20775ce2-4b11-4f12-a23f-c657f02a1865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3848aeeb6f0428a9c3532624184ea6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:28:31Z,use_quota=True,user_id='4d8f8a93b1624c1db51693942ed0fe5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7207daa8-c2e1-45e6-a88a-355fc5840529),volume_type_id=7207daa8-c2e1-45e6-a88a-355fc5840529)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:28:32 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-377d229f-7608-418e-9011-1f253683dd05 tempest-GroupsV314Test-445628626 None] Creating volume 20775ce2-4b11-4f12-a23f-c657f02a1865 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:28:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-377d229f-7608-418e-9011-1f253683dd05 tempest-GroupsV314Test-445628626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-377d229f-7608-418e-9011-1f253683dd05 tempest-GroupsV314Test-445628626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:32 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-377d229f-7608-418e-9011-1f253683dd05 tempest-GroupsV314Test-445628626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:28:32 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-377d229f-7608-418e-9011-1f253683dd05 tempest-GroupsV314Test-445628626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:28:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-377d229f-7608-418e-9011-1f253683dd05 tempest-GroupsV314Test-445628626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:32 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-377d229f-7608-418e-9011-1f253683dd05 tempest-GroupsV314Test-445628626 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:28:32 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-377d229f-7608-418e-9011-1f253683dd05 tempest-GroupsV314Test-445628626 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:28:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-377d229f-7608-418e-9011-1f253683dd05 tempest-GroupsV314Test-445628626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:32 devstack sudo[101268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865 1073741824 Jul 16 23:28:32 devstack sudo[101268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:32 devstack cinder-volume[87607]: DEBUG cinder.volume.volume_utils [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Attempting download of bedd87e7-7cde-4d24-9396-f303eeb1c97b ((None, [{'url': 'file:///opt/stack/data/glance/images/bedd87e7-7cde-4d24-9396-f303eeb1c97b', 'metadata': {}}])) to volume cd794a89-2e97-4e68-9508-441f4aca2898. {{(pid=87607) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 16 23:28:32 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[7489ef58-cae7-4c21-83f0-f83f283cf12b]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:28:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bedd87e7-7cde-4d24-9396-f303eeb1c97b_lu_92w9z {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:32 devstack sudo[101270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bedd87e7-7cde-4d24-9396-f303eeb1c97b_lu_92w9z Jul 16 23:28:32 devstack sudo[101270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:32 devstack sudo[101270]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bedd87e7-7cde-4d24-9396-f303eeb1c97b_lu_92w9z" returned: 0 in 0.330s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bedd87e7-7cde-4d24-9396-f303eeb1c97b_lu_92w9z {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:32 devstack sudo[101268]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-377d229f-7608-418e-9011-1f253683dd05 tempest-GroupsV314Test-445628626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865 1073741824" returned: 0 in 0.538s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-377d229f-7608-418e-9011-1f253683dd05 tempest-GroupsV314Test-445628626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:32 devstack sudo[101277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bedd87e7-7cde-4d24-9396-f303eeb1c97b_lu_92w9z Jul 16 23:28:32 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:32 devstack sudo[101279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865 Jul 16 23:28:32 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:33 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bedd87e7-7cde-4d24-9396-f303eeb1c97b_lu_92w9z" returned: 1 in 0.422s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bedd87e7-7cde-4d24-9396-f303eeb1c97b_lu_92w9z' failed. Not Retrying. {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 23:28:33 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce35dade-0797-40a3-9355-4937b67e62b1]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:28:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bedd87e7-7cde-4d24-9396-f303eeb1c97b_mhjwvsdgdevstack@QuobyteHD {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:33 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-377d229f-7608-418e-9011-1f253683dd05 tempest-GroupsV314Test-445628626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865" returned: 0 in 0.312s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:33 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-377d229f-7608-418e-9011-1f253683dd05 tempest-GroupsV314Test-445628626 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:28:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-377d229f-7608-418e-9011-1f253683dd05 tempest-GroupsV314Test-445628626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.936s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:33 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Cloning volume 4eb28b11-f816-4fde-a6f3-4fa38165e297 to volume 2a872c0f-59c0-4aed-b59b-12ee9c9a4ac3 Jul 16 23:28:33 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-377d229f-7608-418e-9011-1f253683dd05 tempest-GroupsV314Test-445628626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee2a78b8-9df7-4d9f-a4b3-e1812eb4a2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20775ce2-4b11-4f12-a23f-c657f02a1865', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:33 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-377d229f-7608-418e-9011-1f253683dd05 tempest-GroupsV314Test-445628626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af86c483-adc7-4c2f-8d21-865d43aef333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:33 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-377d229f-7608-418e-9011-1f253683dd05 tempest-GroupsV314Test-445628626 None] Volume volume-20775ce2-4b11-4f12-a23f-c657f02a1865 (20775ce2-4b11-4f12-a23f-c657f02a1865): created successfully Jul 16 23:28:33 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-377d229f-7608-418e-9011-1f253683dd05 tempest-GroupsV314Test-445628626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af86c483-adc7-4c2f-8d21-865d43aef333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:33 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-377d229f-7608-418e-9011-1f253683dd05 tempest-GroupsV314Test-445628626 None] Flow 'volume_create_manager' (495747d3-e04b-42a2-a1b2-9ddf2b50cea7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:28:33 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-377d229f-7608-418e-9011-1f253683dd05 tempest-GroupsV314Test-445628626 None] Created volume successfully. Jul 16 23:28:33 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Creating offline snapshot 24d9f07b-ae53-4fae-979f-0886c91d8f03 of volume 4eb28b11-f816-4fde-a6f3-4fa38165e297 {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:28:33 devstack sudo[101284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bedd87e7-7cde-4d24-9396-f303eeb1c97b_mhjwvsdgdevstack@QuobyteHD Jul 16 23:28:33 devstack sudo[101284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:33 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be7635e-19c2-4429-af79-0ed648e34146]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:28:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:33 devstack sudo[101286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297 Jul 16 23:28:33 devstack sudo[101286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:33 devstack sudo[101284]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bedd87e7-7cde-4d24-9396-f303eeb1c97b_mhjwvsdgdevstack@QuobyteHD" returned: 0 in 0.350s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bedd87e7-7cde-4d24-9396-f303eeb1c97b_mhjwvsdgdevstack@QuobyteHD {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:33 devstack sudo[101290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bedd87e7-7cde-4d24-9396-f303eeb1c97b_mhjwvsdgdevstack@QuobyteHD Jul 16 23:28:33 devstack sudo[101290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:33 devstack sudo[101286]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297" returned: 0 in 0.467s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297.24d9f07b-ae53-4fae-979f-0886c91d8f03 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:33 devstack sudo[101295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297.24d9f07b-ae53-4fae-979f-0886c91d8f03 1G Jul 16 23:28:33 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:33 devstack sudo[101290]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bedd87e7-7cde-4d24-9396-f303eeb1c97b_mhjwvsdgdevstack@QuobyteHD" returned: 1 in 0.467s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bedd87e7-7cde-4d24-9396-f303eeb1c97b_mhjwvsdgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 23:28:33 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] bedd87e7-7cde-4d24-9396-f303eeb1c97b was raw, converting to qcow2 {{(pid=87607) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 16 23:28:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bedd87e7-7cde-4d24-9396-f303eeb1c97b_mhjwvsdgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cd794a89-2e97-4e68-9508-441f4aca2898 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:33 devstack sudo[101300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bedd87e7-7cde-4d24-9396-f303eeb1c97b_mhjwvsdgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cd794a89-2e97-4e68-9508-441f4aca2898 Jul 16 23:28:33 devstack sudo[101300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:34 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:34 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:34 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297.24d9f07b-ae53-4fae-979f-0886c91d8f03 1G" returned: 0 in 0.575s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:34 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4eb28b11-f816-4fde-a6f3-4fa38165e297 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297.24d9f07b-ae53-4fae-979f-0886c91d8f03 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:34 devstack sudo[101306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4eb28b11-f816-4fde-a6f3-4fa38165e297 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297.24d9f07b-ae53-4fae-979f-0886c91d8f03 Jul 16 23:28:34 devstack sudo[101306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:34 devstack sudo[101300]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:34 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bedd87e7-7cde-4d24-9396-f303eeb1c97b_mhjwvsdgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cd794a89-2e97-4e68-9508-441f4aca2898" returned: 0 in 0.665s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:34 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bedd87e7-7cde-4d24-9396-f303eeb1c97b_mhjwvsdgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cd794a89-2e97-4e68-9508-441f4aca2898 {{(pid=87607) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 23:28:34 devstack cinder-volume[87607]: INFO cinder.image.image_utils [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Converted 0.00 MB image at 0.00 MB/s Jul 16 23:28:34 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cd794a89-2e97-4e68-9508-441f4aca2898 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:34 devstack sudo[101314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cd794a89-2e97-4e68-9508-441f4aca2898 1G Jul 16 23:28:34 devstack sudo[101314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:34 devstack sudo[101306]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:34 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4eb28b11-f816-4fde-a6f3-4fa38165e297 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297.24d9f07b-ae53-4fae-979f-0886c91d8f03" returned: 0 in 0.366s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:34 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297.24d9f07b-ae53-4fae-979f-0886c91d8f03 is being set with open permissions: ugo+rw Jul 16 23:28:34 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297.24d9f07b-ae53-4fae-979f-0886c91d8f03 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:34 devstack sudo[101316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297.24d9f07b-ae53-4fae-979f-0886c91d8f03 Jul 16 23:28:34 devstack sudo[101316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:34 devstack sudo[101316]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:34 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297.24d9f07b-ae53-4fae-979f-0886c91d8f03" returned: 0 in 0.294s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:34 devstack sudo[101314]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:34 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:34 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cd794a89-2e97-4e68-9508-441f4aca2898 1G" returned: 0 in 0.386s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:34 devstack cinder-volume[87607]: DEBUG cinder.volume.volume_utils [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Downloaded image bedd87e7-7cde-4d24-9396-f303eeb1c97b ((None, [{'url': 'file:///opt/stack/data/glance/images/bedd87e7-7cde-4d24-9396-f303eeb1c97b', 'metadata': {}}])) to volume cd794a89-2e97-4e68-9508-441f4aca2898 successfully. {{(pid=87607) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 16 23:28:34 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Temporary image bedd87e7-7cde-4d24-9396-f303eeb1c97b for user bfb248dd77a9440cae57ceb70096b5ec is deleted. {{(pid=87607) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 16 23:28:34 devstack cinder-volume[87607]: DEBUG cinder.volume.volume_utils [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Marking volume cd794a89-2e97-4e68-9508-441f4aca2898 as bootable. {{(pid=87607) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 16 23:28:34 devstack sudo[101323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297.info Jul 16 23:28:34 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:34 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Copying metadata from image bedd87e7-7cde-4d24-9396-f303eeb1c97b to cd794a89-2e97-4e68-9508-441f4aca2898. {{(pid=87607) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 16 23:28:34 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Creating volume glance metadata for volume cd794a89-2e97-4e68-9508-441f4aca2898 backed by image bedd87e7-7cde-4d24-9396-f303eeb1c97b with: {'image_id': 'bedd87e7-7cde-4d24-9396-f303eeb1c97b', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f9d7d24767c26f73b1f74df9f5a3f30f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87607) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 16 23:28:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9145c8c4-51e4-4d15-b650-37556ddeb789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd794a89-2e97-4e68-9508-441f4aca2898', 'volume_size': 1, 'image_id': 'bedd87e7-7cde-4d24-9396-f303eeb1c97b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bedd87e7-7cde-4d24-9396-f303eeb1c97b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f9d7d24767c26f73b1f74df9f5a3f30f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e38488cb5d694b80abfc7bf1fcf4cfbd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2f9ae33d72697fe125d4fb4d92e791cbdadb025f8a4e0bf72d361c61ac2c852246523fdc776075353827821e0e2af6f22a95358d5703d222126e752dd611edc2', 'id': 'bedd87e7-7cde-4d24-9396-f303eeb1c97b', 'created_at': datetime.datetime(2026, 7, 16, 21, 28, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 21, 28, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bedd87e7-7cde-4d24-9396-f303eeb1c97b/file', 'properties': {}}, 'image_service': }' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95fa2a19-66ad-4814-b963-1c6f71011d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:35 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Volume volume-cd794a89-2e97-4e68-9508-441f4aca2898 (cd794a89-2e97-4e68-9508-441f4aca2898): created successfully Jul 16 23:28:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95fa2a19-66ad-4814-b963-1c6f71011d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Flow 'volume_create_manager' (be638bf8-605b-4cb7-8283-9a85a49624a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:28:35 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-e191d578-4572-430b-9329-8d0881f714e1 tempest-VolumeImageDependencyTests-520474448 None] Created volume successfully. Jul 16 23:28:35 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297.info" returned: 0 in 0.284s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:35 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297.info is being set with open permissions: ugo+rw Jul 16 23:28:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:35 devstack sudo[101326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297.info Jul 16 23:28:35 devstack sudo[101326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:35 devstack sudo[101326]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297.info" returned: 0 in 0.268s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:35 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Acquiring lock "cinder-quobyte-2a872c0f-59c0-4aed-b59b-12ee9c9a4ac3" by "_copy_volume_from_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:28:35 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Lock "cinder-quobyte-2a872c0f-59c0-4aed-b59b-12ee9c9a4ac3" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:28:35 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] snapshot: 24d9f07b-ae53-4fae-979f-0886c91d8f03, volume: 2a872c0f-59c0-4aed-b59b-12ee9c9a4ac3, {{(pid=87607) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 16 23:28:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:35 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:28:35 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:28:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:35 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6be3914-2a12-402f-a7ef-76c4d7404a5f]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:28:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297.24d9f07b-ae53-4fae-979f-0886c91d8f03 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:35 devstack sudo[101329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297.24d9f07b-ae53-4fae-979f-0886c91d8f03 Jul 16 23:28:35 devstack sudo[101329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:35 devstack sudo[101329]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297.24d9f07b-ae53-4fae-979f-0886c91d8f03" returned: 0 in 0.388s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:35 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4eb28b11-f816-4fde-a6f3-4fa38165e297(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:28:35 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297 {{(pid=87607) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 16 23:28:35 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Creating direct copy from snapshot {{(pid=87607) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 16 23:28:35 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[84dba246-437e-49eb-9d4b-c84e82142692]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:28:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:36 devstack sudo[101334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297 Jul 16 23:28:36 devstack sudo[101334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:36 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b3d1aed9-0477-4f7c-ad0a-cfec1e7fc559 tempest-VolumeImageDependencyTests-520474448 None] Acquiring lock "cinder-cd794a89-2e97-4e68-9508-441f4aca2898-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:28:36 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b3d1aed9-0477-4f7c-ad0a-cfec1e7fc559 tempest-VolumeImageDependencyTests-520474448 None] Lock "cinder-cd794a89-2e97-4e68-9508-441f4aca2898-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:28:36 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b3d1aed9-0477-4f7c-ad0a-cfec1e7fc559 tempest-VolumeImageDependencyTests-520474448 None] Acquiring lock "cinder-quobyte-cd794a89-2e97-4e68-9508-441f4aca2898" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:28:36 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b3d1aed9-0477-4f7c-ad0a-cfec1e7fc559 tempest-VolumeImageDependencyTests-520474448 None] Lock "cinder-quobyte-cd794a89-2e97-4e68-9508-441f4aca2898" acquired by "delete_volume" :: waited 0.019s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:28:36 devstack sudo[101334]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297" returned: 0 in 0.407s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:36 devstack cinder-volume[87607]: DEBUG cinder.utils [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Path /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2a872c0f-59c0-4aed-b59b-12ee9c9a4ac3 not found in is_blk_device check {{(pid=87607) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 16 23:28:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2a872c0f-59c0-4aed-b59b-12ee9c9a4ac3 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:36 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[726da0f8-d3d4-4a2a-ac04-3b04e57f8514]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:28:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b3d1aed9-0477-4f7c-ad0a-cfec1e7fc559 tempest-VolumeImageDependencyTests-520474448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cd794a89-2e97-4e68-9508-441f4aca2898 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:36 devstack sudo[101339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2a872c0f-59c0-4aed-b59b-12ee9c9a4ac3 Jul 16 23:28:36 devstack sudo[101339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:36 devstack sudo[101340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cd794a89-2e97-4e68-9508-441f4aca2898 Jul 16 23:28:36 devstack sudo[101340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:36 devstack sudo[101340]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b3d1aed9-0477-4f7c-ad0a-cfec1e7fc559 tempest-VolumeImageDependencyTests-520474448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cd794a89-2e97-4e68-9508-441f4aca2898" returned: 0 in 0.565s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b3d1aed9-0477-4f7c-ad0a-cfec1e7fc559 tempest-VolumeImageDependencyTests-520474448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cd794a89-2e97-4e68-9508-441f4aca2898 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:37 devstack sudo[101386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cd794a89-2e97-4e68-9508-441f4aca2898 Jul 16 23:28:37 devstack sudo[101386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:37 devstack sudo[101386]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b3d1aed9-0477-4f7c-ad0a-cfec1e7fc559 tempest-VolumeImageDependencyTests-520474448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cd794a89-2e97-4e68-9508-441f4aca2898" returned: 0 in 0.748s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:37 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b3d1aed9-0477-4f7c-ad0a-cfec1e7fc559 tempest-VolumeImageDependencyTests-520474448 None] Lock "cinder-quobyte-cd794a89-2e97-4e68-9508-441f4aca2898" released by "delete_volume" :: held 1.379s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:28:37 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-b3d1aed9-0477-4f7c-ad0a-cfec1e7fc559 tempest-VolumeImageDependencyTests-520474448 None] Created reservations ['4869062d-00d8-4c9d-8295-d7f7d8ba5805', 'a1fa5082-91d2-4a8f-9d4b-6b44a214f8b8', '754b301e-fe1f-4b60-8107-d185b8bcea99', '4d949a97-8a8a-4a04-8851-f9d4bc648a18'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:28:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b3d1aed9-0477-4f7c-ad0a-cfec1e7fc559 tempest-VolumeImageDependencyTests-520474448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b3d1aed9-0477-4f7c-ad0a-cfec1e7fc559 tempest-VolumeImageDependencyTests-520474448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:38 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-b3d1aed9-0477-4f7c-ad0a-cfec1e7fc559 tempest-VolumeImageDependencyTests-520474448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:28:38 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-b3d1aed9-0477-4f7c-ad0a-cfec1e7fc559 tempest-VolumeImageDependencyTests-520474448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:28:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b3d1aed9-0477-4f7c-ad0a-cfec1e7fc559 tempest-VolumeImageDependencyTests-520474448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b3d1aed9-0477-4f7c-ad0a-cfec1e7fc559 tempest-VolumeImageDependencyTests-520474448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:38 devstack sudo[101396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:28:38 devstack sudo[101396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:38 devstack sudo[101396]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b3d1aed9-0477-4f7c-ad0a-cfec1e7fc559 tempest-VolumeImageDependencyTests-520474448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.525s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:38 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-b3d1aed9-0477-4f7c-ad0a-cfec1e7fc559 tempest-VolumeImageDependencyTests-520474448 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:28:38 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-b3d1aed9-0477-4f7c-ad0a-cfec1e7fc559 tempest-VolumeImageDependencyTests-520474448 None] Deleted volume successfully. Jul 16 23:28:38 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b3d1aed9-0477-4f7c-ad0a-cfec1e7fc559 tempest-VolumeImageDependencyTests-520474448 None] Lock "cinder-cd794a89-2e97-4e68-9508-441f4aca2898-delete_volume" released by "delete_volume" :: held 2.325s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:28:39 devstack cinder-volume[87607]: DEBUG oslo_service.periodic_task [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:28:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:28:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:28:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:39 devstack sudo[101400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:28:39 devstack sudo[101400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:40 devstack sudo[101400]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 1.015s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:40 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:28:40 devstack cinder-volume[87607]: DEBUG oslo_service.periodic_task [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running periodic task VolumeManager._thread_info {{(pid=87607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:28:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] thread count: 28 {{(pid=87607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 23:28:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] thread info: [<_MainThread(MainThread, started 139090403627136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 23:28:42 devstack sudo[101339]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2a872c0f-59c0-4aed-b59b-12ee9c9a4ac3" returned: 0 in 6.058s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:42 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71bd73c-1ef2-44fd-8ac7-f6dd3477e9bb]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:28:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:42 devstack sudo[101403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297 Jul 16 23:28:42 devstack sudo[101403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:43 devstack sudo[101403]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297" returned: 0 in 0.632s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:43 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Image conversion details: src /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297, size 1024.00 MB, duration 6.06 sec, destination /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2a872c0f-59c0-4aed-b59b-12ee9c9a4ac3 {{(pid=87607) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 23:28:43 devstack cinder-volume[87607]: INFO cinder.image.image_utils [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Converted 1024.00 MB image at 169.01 MB/s Jul 16 23:28:43 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2a872c0f-59c0-4aed-b59b-12ee9c9a4ac3 is being set with open permissions: ugo+rw Jul 16 23:28:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2a872c0f-59c0-4aed-b59b-12ee9c9a4ac3 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:43 devstack sudo[101408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2a872c0f-59c0-4aed-b59b-12ee9c9a4ac3 Jul 16 23:28:43 devstack sudo[101408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:43 devstack sudo[101408]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2a872c0f-59c0-4aed-b59b-12ee9c9a4ac3" returned: 0 in 0.270s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:43 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Lock "cinder-quobyte-2a872c0f-59c0-4aed-b59b-12ee9c9a4ac3" released by "_copy_volume_from_snapshot" :: held 7.836s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:28:43 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Acquiring lock "cinder-quobyte-24d9f07b-ae53-4fae-979f-0886c91d8f03" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:28:43 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Lock "cinder-quobyte-24d9f07b-ae53-4fae-979f-0886c91d8f03" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:28:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Deleting offline snapshot 24d9f07b-ae53-4fae-979f-0886c91d8f03 of volume 4eb28b11-f816-4fde-a6f3-4fa38165e297 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:28:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] snapshot_file for this snap is: volume-4eb28b11-f816-4fde-a6f3-4fa38165e297.24d9f07b-ae53-4fae-979f-0886c91d8f03 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:28:43 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd3f06f-28b5-4a83-97d8-ec7072811280]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:28:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297.24d9f07b-ae53-4fae-979f-0886c91d8f03 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:43 devstack sudo[101411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297.24d9f07b-ae53-4fae-979f-0886c91d8f03 Jul 16 23:28:43 devstack sudo[101411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:43 devstack sudo[101411]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297.24d9f07b-ae53-4fae-979f-0886c91d8f03" returned: 0 in 0.481s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4eb28b11-f816-4fde-a6f3-4fa38165e297(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:28:43 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b6dbb3-33e0-4bf6-8a99-8e142b67a1b9]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:28:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:44 devstack sudo[101417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297 Jul 16 23:28:44 devstack sudo[101417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:44 devstack sudo[101417]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297" returned: 0 in 0.554s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297.24d9f07b-ae53-4fae-979f-0886c91d8f03 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:44 devstack sudo[101422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297.24d9f07b-ae53-4fae-979f-0886c91d8f03 Jul 16 23:28:44 devstack sudo[101422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:45 devstack sudo[101422]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297.24d9f07b-ae53-4fae-979f-0886c91d8f03" returned: 0 in 0.592s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297.24d9f07b-ae53-4fae-979f-0886c91d8f03 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:45 devstack sudo[101427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297.24d9f07b-ae53-4fae-979f-0886c91d8f03 Jul 16 23:28:45 devstack sudo[101427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:45 devstack sudo[101427]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297.24d9f07b-ae53-4fae-979f-0886c91d8f03" returned: 0 in 0.307s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:45 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Lock "cinder-quobyte-24d9f07b-ae53-4fae-979f-0886c91d8f03" released by "_delete_snapshot" :: held 2.087s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:28:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.473s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 11.366s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:45 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] Cloning volume 20775ce2-4b11-4f12-a23f-c657f02a1865 to volume 694ddfc7-b3f2-40ca-bfb6-e71c02e5ef57 Jul 16 23:28:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e014329-1209-49c0-897e-bf9a04938fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a872c0f-59c0-4aed-b59b-12ee9c9a4ac3', 'volume_size': 1, 'source_volid': '4eb28b11-f816-4fde-a6f3-4fa38165e297', 'source_volstatus': 'available'}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e13d765-4e86-4291-b173-5624711ff71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:45 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Volume volume-2a872c0f-59c0-4aed-b59b-12ee9c9a4ac3 (2a872c0f-59c0-4aed-b59b-12ee9c9a4ac3): created successfully Jul 16 23:28:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e13d765-4e86-4291-b173-5624711ff71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Flow 'volume_create_manager' (88790bde-f0a1-4d34-bbe5-3395eaf0f935) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:28:45 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] Creating offline snapshot 661c5075-6483-442e-bcef-bc490c228e69 of volume 20775ce2-4b11-4f12-a23f-c657f02a1865 {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:28:45 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-fbccac78-4e9f-4574-8305-104981fd67b8 tempest-VolumesGetTest-720293127 None] Created volume successfully. Jul 16 23:28:45 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75c7937-9b9a-4f0c-b0ed-84048d87a207]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:28:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:45 devstack sudo[101430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865 Jul 16 23:28:45 devstack sudo[101430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:46 devstack sudo[101430]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865" returned: 0 in 0.536s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865.661c5075-6483-442e-bcef-bc490c228e69 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:46 devstack sudo[101435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865.661c5075-6483-442e-bcef-bc490c228e69 1G Jul 16 23:28:46 devstack sudo[101435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:46 devstack sudo[101435]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865.661c5075-6483-442e-bcef-bc490c228e69 1G" returned: 0 in 0.604s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20775ce2-4b11-4f12-a23f-c657f02a1865 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865.661c5075-6483-442e-bcef-bc490c228e69 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:46 devstack sudo[101442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20775ce2-4b11-4f12-a23f-c657f02a1865 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865.661c5075-6483-442e-bcef-bc490c228e69 Jul 16 23:28:46 devstack sudo[101442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:47 devstack sudo[101442]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20775ce2-4b11-4f12-a23f-c657f02a1865 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865.661c5075-6483-442e-bcef-bc490c228e69" returned: 0 in 0.359s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:47 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865.661c5075-6483-442e-bcef-bc490c228e69 is being set with open permissions: ugo+rw: NotImplementedError Jul 16 23:28:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865.661c5075-6483-442e-bcef-bc490c228e69 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:47 devstack sudo[101448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865.661c5075-6483-442e-bcef-bc490c228e69 Jul 16 23:28:47 devstack sudo[101448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:47 devstack sudo[101448]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865.661c5075-6483-442e-bcef-bc490c228e69" returned: 0 in 0.330s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:47 devstack sudo[101451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865.info Jul 16 23:28:47 devstack sudo[101451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:47 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ef80a6f-57b0-4c57-b976-c9191b51aef6 tempest-VolumesGetTest-720293127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:28:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0ef80a6f-57b0-4c57-b976-c9191b51aef6 tempest-VolumesGetTest-720293127 None] Flow 'volume_create_manager' (4317bfa2-4808-49dd-ac28-004d0f1afcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:28:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0ef80a6f-57b0-4c57-b976-c9191b51aef6 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac98f6d8-a236-4169-bce7-7eccd13efdbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0ef80a6f-57b0-4c57-b976-c9191b51aef6 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac98f6d8-a236-4169-bce7-7eccd13efdbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:28:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1660394742',display_name='tempest-VolumesGetTest-Volume-1325385950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f65baeb-0aa7-406b-9e4c-e13eb090db1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d553ba4b271a44df88d94d52e4104064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:28:48Z,use_quota=True,user_id='08f5f2b4e8884331a5914c76b0275b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0ef80a6f-57b0-4c57-b976-c9191b51aef6 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffdfbf12-719f-409f-94c8-84711f627c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0ef80a6f-57b0-4c57-b976-c9191b51aef6 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffdfbf12-719f-409f-94c8-84711f627c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0ef80a6f-57b0-4c57-b976-c9191b51aef6 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c87f395-d91d-4d75-90c2-4d871353c041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0ef80a6f-57b0-4c57-b976-c9191b51aef6 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c87f395-d91d-4d75-90c2-4d871353c041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f65baeb-0aa7-406b-9e4c-e13eb090db1b', 'volume_name': 'volume-0f65baeb-0aa7-406b-9e4c-e13eb090db1b', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0ef80a6f-57b0-4c57-b976-c9191b51aef6 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f018f2d-8e1e-465f-b4d8-998ebbae2506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0ef80a6f-57b0-4c57-b976-c9191b51aef6 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f018f2d-8e1e-465f-b4d8-998ebbae2506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0ef80a6f-57b0-4c57-b976-c9191b51aef6 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb50206c-0759-4f52-9687-71d0ea70455b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:47 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-0ef80a6f-57b0-4c57-b976-c9191b51aef6 tempest-VolumesGetTest-720293127 None] Volume 0f65baeb-0aa7-406b-9e4c-e13eb090db1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f65baeb-0aa7-406b-9e4c-e13eb090db1b', 'volume_size': 1} Jul 16 23:28:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0ef80a6f-57b0-4c57-b976-c9191b51aef6 tempest-VolumesGetTest-720293127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:47 devstack sudo[101451]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865.info" returned: 0 in 0.306s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:47 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865.info is being set with open permissions: ugo+rw: NotImplementedError Jul 16 23:28:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:47 devstack sudo[101454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865.info Jul 16 23:28:47 devstack sudo[101454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:48 devstack sudo[101454]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865.info" returned: 0 in 0.297s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:48 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] Acquiring lock "cinder-quobyte-694ddfc7-b3f2-40ca-bfb6-e71c02e5ef57" by "_copy_volume_from_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:28:48 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] Lock "cinder-quobyte-694ddfc7-b3f2-40ca-bfb6-e71c02e5ef57" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:28:48 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] snapshot: 661c5075-6483-442e-bcef-bc490c228e69, volume: 694ddfc7-b3f2-40ca-bfb6-e71c02e5ef57, {{(pid=87607) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 16 23:28:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:48 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:28:48 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:28:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:48 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6c7296-d90a-479d-802b-690d5b7f389b]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:28:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865.661c5075-6483-442e-bcef-bc490c228e69 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:48 devstack sudo[101457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865.661c5075-6483-442e-bcef-bc490c228e69 Jul 16 23:28:48 devstack sudo[101457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:48 devstack sudo[101457]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865.661c5075-6483-442e-bcef-bc490c228e69" returned: 0 in 0.411s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:48 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20775ce2-4b11-4f12-a23f-c657f02a1865(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:28:48 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865 {{(pid=87607) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 16 23:28:48 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] Creating direct copy from snapshot {{(pid=87607) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 16 23:28:48 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96ea131-a79e-47b2-9bb1-9a50994e58fb]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:28:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:48 devstack sudo[101467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865 Jul 16 23:28:48 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:49 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865" returned: 0 in 0.466s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:49 devstack cinder-volume[87607]: DEBUG cinder.utils [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] Path /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-694ddfc7-b3f2-40ca-bfb6-e71c02e5ef57 not found in is_blk_device check {{(pid=87607) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 16 23:28:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-694ddfc7-b3f2-40ca-bfb6-e71c02e5ef57 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:49 devstack sudo[101473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-694ddfc7-b3f2-40ca-bfb6-e71c02e5ef57 Jul 16 23:28:49 devstack sudo[101473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:50 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:28:50 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Flow 'volume_create_manager' (695d731d-c844-48b1-9dbd-f97046b95d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:28:50 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe33761c-1c2f-44c2-b166-f9dbefc8f79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:50 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe33761c-1c2f-44c2-b166-f9dbefc8f79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1030048089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=173ebabb-fafd-45ec-b706-db6173da5b83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='559ed92f0c0c4e3f8fe573afad38c1ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:28:50Z,use_quota=True,user_id='e9d816b303b44ddfb72223744cb080f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:50 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8dbf3f4-f46c-4152-862f-1d8cffb1414a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:50 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8dbf3f4-f46c-4152-862f-1d8cffb1414a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:50 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d53a024b-b3d3-442e-b09a-be3f36084909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:50 devstack cinder-volume[87607]: DEBUG cinder.image.glance [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Creating Keystone auth plugin from conf {{(pid=87607) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 16 23:28:51 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d53a024b-b3d3-442e-b09a-be3f36084909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '173ebabb-fafd-45ec-b706-db6173da5b83', 'volume_name': 'volume-173ebabb-fafd-45ec-b706-db6173da5b83', 'volume_size': 1, 'image_id': '6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3319c84d612344f1b9ca29a92bf5a474', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'created_at': datetime.datetime(2026, 7, 16, 21, 12, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 21, 12, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6519f5ae-0b5b-4a63-9b9b-0adb6304882e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:51 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e3c362d-475f-4c30-8b18-d7eaccdc4d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:51 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e3c362d-475f-4c30-8b18-d7eaccdc4d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:51 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c0a12b7-c49f-4505-89ef-398919a69f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:51 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Volume 173ebabb-fafd-45ec-b706-db6173da5b83: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-173ebabb-fafd-45ec-b706-db6173da5b83', 'volume_size': 1, 'image_id': '6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3319c84d612344f1b9ca29a92bf5a474', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'created_at': datetime.datetime(2026, 7, 16, 21, 12, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 21, 12, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6519f5ae-0b5b-4a63-9b9b-0adb6304882e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 16 23:28:51 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Trying to clone 173ebabb-fafd-45ec-b706-db6173da5b83 from image 6519f5ae-0b5b-4a63-9b9b-0adb6304882e at location (None, [{'url': 'file:///opt/stack/data/glance/images/6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'metadata': {}}]). {{(pid=87607) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 16 23:28:52 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_e9_kau89devstack@QuobyteHD, size 20.69 MB, duration 1.02 sec {{(pid=87607) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 16 23:28:52 devstack cinder-volume[87607]: INFO cinder.image.image_utils [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Image download 20.69 MB at 20.21 MB/s Jul 16 23:28:52 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[349b6c39-b408-405e-b359-f578efaccb8c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:28:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_e9_kau89devstack@QuobyteHD {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:53 devstack sudo[101493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_e9_kau89devstack@QuobyteHD Jul 16 23:28:53 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:53 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_e9_kau89devstack@QuobyteHD" returned: 0 in 0.837s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:53 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Temporary image 6519f5ae-0b5b-4a63-9b9b-0adb6304882e is fetched for user e9d816b303b44ddfb72223744cb080f5. {{(pid=87607) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 16 23:28:53 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4976d4-933d-4a23-9c2e-c95ed9ebb9a6]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:28:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_e9_kau89devstack@QuobyteHD {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:54 devstack sudo[101498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_e9_kau89devstack@QuobyteHD Jul 16 23:28:54 devstack sudo[101498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:54 devstack sudo[101498]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_e9_kau89devstack@QuobyteHD" returned: 0 in 0.927s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:54 devstack sudo[101473]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-694ddfc7-b3f2-40ca-bfb6-e71c02e5ef57" returned: 0 in 5.749s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:54 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[648256b3-372e-413c-956a-49975e318225]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:28:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:55 devstack sudo[101503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865 Jul 16 23:28:55 devstack sudo[101503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:55 devstack sudo[101503]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865" returned: 0 in 0.592s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:55 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] Image conversion details: src /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865, size 1024.00 MB, duration 5.75 sec, destination /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-694ddfc7-b3f2-40ca-bfb6-e71c02e5ef57 {{(pid=87607) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 23:28:55 devstack cinder-volume[87607]: INFO cinder.image.image_utils [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] Converted 1024.00 MB image at 178.10 MB/s Jul 16 23:28:55 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-694ddfc7-b3f2-40ca-bfb6-e71c02e5ef57 is being set with open permissions: ugo+rw: NotImplementedError Jul 16 23:28:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-694ddfc7-b3f2-40ca-bfb6-e71c02e5ef57 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:55 devstack sudo[101508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-694ddfc7-b3f2-40ca-bfb6-e71c02e5ef57 Jul 16 23:28:55 devstack sudo[101508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:55 devstack sudo[101508]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-694ddfc7-b3f2-40ca-bfb6-e71c02e5ef57" returned: 0 in 0.265s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:55 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] Lock "cinder-quobyte-694ddfc7-b3f2-40ca-bfb6-e71c02e5ef57" released by "_copy_volume_from_snapshot" :: held 7.591s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:28:55 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] Acquiring lock "cinder-quobyte-661c5075-6483-442e-bcef-bc490c228e69" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:28:55 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] Lock "cinder-quobyte-661c5075-6483-442e-bcef-bc490c228e69" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:28:55 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] Deleting offline snapshot 661c5075-6483-442e-bcef-bc490c228e69 of volume 20775ce2-4b11-4f12-a23f-c657f02a1865 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:28:55 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] snapshot_file for this snap is: volume-20775ce2-4b11-4f12-a23f-c657f02a1865.661c5075-6483-442e-bcef-bc490c228e69 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:28:55 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c62d639-1e06-4cc9-a981-484d3e8754a5]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:28:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865.661c5075-6483-442e-bcef-bc490c228e69 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:56 devstack sudo[101511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865.661c5075-6483-442e-bcef-bc490c228e69 Jul 16 23:28:56 devstack sudo[101511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:56 devstack sudo[101511]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865.661c5075-6483-442e-bcef-bc490c228e69" returned: 0 in 0.421s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:56 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20775ce2-4b11-4f12-a23f-c657f02a1865(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:28:56 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[b811ced8-760e-41c2-9a1a-b4d617a9e73f]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:28:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:56 devstack sudo[101520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865 Jul 16 23:28:56 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:56 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865" returned: 0 in 0.392s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865.661c5075-6483-442e-bcef-bc490c228e69 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:56 devstack sudo[101525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865.661c5075-6483-442e-bcef-bc490c228e69 Jul 16 23:28:56 devstack sudo[101525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:57 devstack sudo[101525]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865.661c5075-6483-442e-bcef-bc490c228e69" returned: 0 in 0.343s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865.661c5075-6483-442e-bcef-bc490c228e69 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:57 devstack sudo[101530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865.661c5075-6483-442e-bcef-bc490c228e69 Jul 16 23:28:57 devstack sudo[101530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:57 devstack sudo[101530]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865.661c5075-6483-442e-bcef-bc490c228e69" returned: 0 in 0.280s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:57 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] Lock "cinder-quobyte-661c5075-6483-442e-bcef-bc490c228e69" released by "_delete_snapshot" :: held 1.531s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:28:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.880s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0ef80a6f-57b0-4c57-b976-c9191b51aef6 tempest-VolumesGetTest-720293127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.598s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:57 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0ef80a6f-57b0-4c57-b976-c9191b51aef6 tempest-VolumesGetTest-720293127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:28:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1660394742',display_name='tempest-VolumesGetTest-Volume-1325385950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f65baeb-0aa7-406b-9e4c-e13eb090db1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d553ba4b271a44df88d94d52e4104064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:28:48Z,use_quota=True,user_id='08f5f2b4e8884331a5914c76b0275b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:28:57 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-0ef80a6f-57b0-4c57-b976-c9191b51aef6 tempest-VolumesGetTest-720293127 None] Creating volume 0f65baeb-0aa7-406b-9e4c-e13eb090db1b {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:28:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0ef80a6f-57b0-4c57-b976-c9191b51aef6 tempest-VolumesGetTest-720293127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0ef80a6f-57b0-4c57-b976-c9191b51aef6 tempest-VolumesGetTest-720293127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:57 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0ef80a6f-57b0-4c57-b976-c9191b51aef6 tempest-VolumesGetTest-720293127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:28:57 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0ef80a6f-57b0-4c57-b976-c9191b51aef6 tempest-VolumesGetTest-720293127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:28:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0ef80a6f-57b0-4c57-b976-c9191b51aef6 tempest-VolumesGetTest-720293127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:57 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0ef80a6f-57b0-4c57-b976-c9191b51aef6 tempest-VolumesGetTest-720293127 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:28:57 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-0ef80a6f-57b0-4c57-b976-c9191b51aef6 tempest-VolumesGetTest-720293127 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:28:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0ef80a6f-57b0-4c57-b976-c9191b51aef6 tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0f65baeb-0aa7-406b-9e4c-e13eb090db1b 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:57 devstack sudo[101533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0f65baeb-0aa7-406b-9e4c-e13eb090db1b 1073741824 Jul 16 23:28:57 devstack sudo[101533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:57 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-84ecdc7e-4855-443f-a617-322da557918a tempest-GroupsV314Test-445628626 None] Create group from source-group-482c81e2-76ef-4cf7-8ec9-75c38db6643d completed successfully. Jul 16 23:28:57 devstack sudo[101533]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0ef80a6f-57b0-4c57-b976-c9191b51aef6 tempest-VolumesGetTest-720293127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0f65baeb-0aa7-406b-9e4c-e13eb090db1b 1073741824" returned: 0 in 0.478s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0ef80a6f-57b0-4c57-b976-c9191b51aef6 tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0f65baeb-0aa7-406b-9e4c-e13eb090db1b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:57 devstack sudo[101539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0f65baeb-0aa7-406b-9e4c-e13eb090db1b Jul 16 23:28:57 devstack sudo[101539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:58 devstack sudo[101539]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0ef80a6f-57b0-4c57-b976-c9191b51aef6 tempest-VolumesGetTest-720293127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0f65baeb-0aa7-406b-9e4c-e13eb090db1b" returned: 0 in 0.247s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:58 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0ef80a6f-57b0-4c57-b976-c9191b51aef6 tempest-VolumesGetTest-720293127 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:28:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0ef80a6f-57b0-4c57-b976-c9191b51aef6 tempest-VolumesGetTest-720293127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.469s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:58 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1030048089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=173ebabb-fafd-45ec-b706-db6173da5b83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='559ed92f0c0c4e3f8fe573afad38c1ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:28:50Z,use_quota=True,user_id='e9d816b303b44ddfb72223744cb080f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:28:58 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Creating volume 173ebabb-fafd-45ec-b706-db6173da5b83 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:28:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:28:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:28:58 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:28:58 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:28:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:58 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:28:58 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:28:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-173ebabb-fafd-45ec-b706-db6173da5b83 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0ef80a6f-57b0-4c57-b976-c9191b51aef6 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb50206c-0759-4f52-9687-71d0ea70455b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f65baeb-0aa7-406b-9e4c-e13eb090db1b', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:58 devstack sudo[101542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-173ebabb-fafd-45ec-b706-db6173da5b83 1073741824 Jul 16 23:28:58 devstack sudo[101542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0ef80a6f-57b0-4c57-b976-c9191b51aef6 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7522daae-01f4-4a07-84db-e2a05a54c467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:28:58 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-0ef80a6f-57b0-4c57-b976-c9191b51aef6 tempest-VolumesGetTest-720293127 None] Volume volume-0f65baeb-0aa7-406b-9e4c-e13eb090db1b (0f65baeb-0aa7-406b-9e4c-e13eb090db1b): created successfully Jul 16 23:28:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0ef80a6f-57b0-4c57-b976-c9191b51aef6 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7522daae-01f4-4a07-84db-e2a05a54c467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:28:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0ef80a6f-57b0-4c57-b976-c9191b51aef6 tempest-VolumesGetTest-720293127 None] Flow 'volume_create_manager' (4317bfa2-4808-49dd-ac28-004d0f1afcd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:28:58 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-0ef80a6f-57b0-4c57-b976-c9191b51aef6 tempest-VolumesGetTest-720293127 None] Created volume successfully. Jul 16 23:28:58 devstack sudo[101542]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-173ebabb-fafd-45ec-b706-db6173da5b83 1073741824" returned: 0 in 0.660s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-173ebabb-fafd-45ec-b706-db6173da5b83 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:58 devstack sudo[101549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-173ebabb-fafd-45ec-b706-db6173da5b83 Jul 16 23:28:58 devstack sudo[101549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:59 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4b8071ee-2a7b-4a26-82d1-bb5dcf52be1a tempest-VolumesGetTest-720293127 None] Acquiring lock "cinder-0f65baeb-0aa7-406b-9e4c-e13eb090db1b-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:28:59 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4b8071ee-2a7b-4a26-82d1-bb5dcf52be1a tempest-VolumesGetTest-720293127 None] Lock "cinder-0f65baeb-0aa7-406b-9e4c-e13eb090db1b-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:28:59 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-811499fb-888d-4023-b616-102ab2a8cb60 tempest-GroupsV314Test-445628626 None] Acquiring lock "cinder-quobyte-694ddfc7-b3f2-40ca-bfb6-e71c02e5ef57" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:28:59 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-811499fb-888d-4023-b616-102ab2a8cb60 tempest-GroupsV314Test-445628626 None] Lock "cinder-quobyte-694ddfc7-b3f2-40ca-bfb6-e71c02e5ef57" acquired by "delete_volume" :: waited 0.026s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:28:59 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4b8071ee-2a7b-4a26-82d1-bb5dcf52be1a tempest-VolumesGetTest-720293127 None] Acquiring lock "cinder-quobyte-0f65baeb-0aa7-406b-9e4c-e13eb090db1b" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:28:59 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4b8071ee-2a7b-4a26-82d1-bb5dcf52be1a tempest-VolumesGetTest-720293127 None] Lock "cinder-quobyte-0f65baeb-0aa7-406b-9e4c-e13eb090db1b" acquired by "delete_volume" :: waited 0.025s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:28:59 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebe63ed-b3af-41a1-a3b8-283e3f8cecdb]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:28:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-811499fb-888d-4023-b616-102ab2a8cb60 tempest-GroupsV314Test-445628626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-694ddfc7-b3f2-40ca-bfb6-e71c02e5ef57 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:59 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9057117-ea5c-4eeb-9905-0d500d116b64]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:28:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4b8071ee-2a7b-4a26-82d1-bb5dcf52be1a tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0f65baeb-0aa7-406b-9e4c-e13eb090db1b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:59 devstack sudo[101549]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-173ebabb-fafd-45ec-b706-db6173da5b83" returned: 0 in 0.333s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:59 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:28:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:28:59 devstack cinder-volume[87607]: DEBUG cinder.volume.volume_utils [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Attempting download of 6519f5ae-0b5b-4a63-9b9b-0adb6304882e ((None, [{'url': 'file:///opt/stack/data/glance/images/6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'metadata': {}}])) to volume 173ebabb-fafd-45ec-b706-db6173da5b83. {{(pid=87607) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 16 23:28:59 devstack sudo[101551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-694ddfc7-b3f2-40ca-bfb6-e71c02e5ef57 Jul 16 23:28:59 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:59 devstack sudo[101552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0f65baeb-0aa7-406b-9e4c-e13eb090db1b Jul 16 23:28:59 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:59 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7354338-e336-4906-9db1-64d83bcf7563]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:28:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_gaqiu80m {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:59 devstack sudo[101556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_gaqiu80m Jul 16 23:28:59 devstack sudo[101556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:59 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4b8071ee-2a7b-4a26-82d1-bb5dcf52be1a tempest-VolumesGetTest-720293127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0f65baeb-0aa7-406b-9e4c-e13eb090db1b" returned: 0 in 0.498s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4b8071ee-2a7b-4a26-82d1-bb5dcf52be1a tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0f65baeb-0aa7-406b-9e4c-e13eb090db1b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:59 devstack sudo[101563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0f65baeb-0aa7-406b-9e4c-e13eb090db1b Jul 16 23:28:59 devstack sudo[101563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:59 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-811499fb-888d-4023-b616-102ab2a8cb60 tempest-GroupsV314Test-445628626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-694ddfc7-b3f2-40ca-bfb6-e71c02e5ef57" returned: 0 in 0.658s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-811499fb-888d-4023-b616-102ab2a8cb60 tempest-GroupsV314Test-445628626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-694ddfc7-b3f2-40ca-bfb6-e71c02e5ef57 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:28:59 devstack sudo[101568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-694ddfc7-b3f2-40ca-bfb6-e71c02e5ef57 Jul 16 23:28:59 devstack sudo[101568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:28:59 devstack sudo[101556]: pam_unix(sudo:session): session closed for user root Jul 16 23:28:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_gaqiu80m" returned: 0 in 0.521s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:28:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_gaqiu80m {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:00 devstack sudo[101563]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4b8071ee-2a7b-4a26-82d1-bb5dcf52be1a tempest-VolumesGetTest-720293127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0f65baeb-0aa7-406b-9e4c-e13eb090db1b" returned: 0 in 0.340s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:00 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4b8071ee-2a7b-4a26-82d1-bb5dcf52be1a tempest-VolumesGetTest-720293127 None] Lock "cinder-quobyte-0f65baeb-0aa7-406b-9e4c-e13eb090db1b" released by "delete_volume" :: held 0.906s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:29:00 devstack sudo[101570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_gaqiu80m Jul 16 23:29:00 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:00 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-4b8071ee-2a7b-4a26-82d1-bb5dcf52be1a tempest-VolumesGetTest-720293127 None] Created reservations ['a181af03-f943-44e3-aaae-6624bb8adc34', '940a1650-97b0-4a63-b049-0a313f0051a8', '236063ac-68c3-44e3-8513-cc853d8c6803', 'bdafd7e1-02c5-4818-b8da-13ecac98169c'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:29:00 devstack sudo[101568]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-811499fb-888d-4023-b616-102ab2a8cb60 tempest-GroupsV314Test-445628626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-694ddfc7-b3f2-40ca-bfb6-e71c02e5ef57" returned: 0 in 0.454s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:00 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-811499fb-888d-4023-b616-102ab2a8cb60 tempest-GroupsV314Test-445628626 None] Lock "cinder-quobyte-694ddfc7-b3f2-40ca-bfb6-e71c02e5ef57" released by "delete_volume" :: held 1.198s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:29:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4b8071ee-2a7b-4a26-82d1-bb5dcf52be1a tempest-VolumesGetTest-720293127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:29:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4b8071ee-2a7b-4a26-82d1-bb5dcf52be1a tempest-VolumesGetTest-720293127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:29:00 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4b8071ee-2a7b-4a26-82d1-bb5dcf52be1a tempest-VolumesGetTest-720293127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:29:00 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4b8071ee-2a7b-4a26-82d1-bb5dcf52be1a tempest-VolumesGetTest-720293127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:29:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4b8071ee-2a7b-4a26-82d1-bb5dcf52be1a tempest-VolumesGetTest-720293127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:29:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4b8071ee-2a7b-4a26-82d1-bb5dcf52be1a tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:00 devstack sudo[101574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:29:00 devstack sudo[101574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:00 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_gaqiu80m" returned: 1 in 0.514s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_gaqiu80m' failed. Not Retrying. {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 23:29:00 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-811499fb-888d-4023-b616-102ab2a8cb60 tempest-GroupsV314Test-445628626 None] Created reservations ['0be7ace7-ae15-473c-b97c-e479a641ed71'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:29:00 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d51209-a3cd-4102-9d03-292fa42abef0]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:29:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_e9_kau89devstack@QuobyteHD {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:00 devstack cinder-volume[87607]: WARNING cinder.quota [None req-811499fb-888d-4023-b616-102ab2a8cb60 tempest-GroupsV314Test-445628626 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-622547581 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-622547581, it is now deprecated. Please use the default quota class for default quota. Jul 16 23:29:00 devstack cinder-volume[87607]: WARNING cinder.quota [None req-811499fb-888d-4023-b616-102ab2a8cb60 tempest-GroupsV314Test-445628626 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-622547581 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-622547581, it is now deprecated. Please use the default quota class for default quota. Jul 16 23:29:00 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-811499fb-888d-4023-b616-102ab2a8cb60 tempest-GroupsV314Test-445628626 None] Created reservations ['2b41bd56-b002-4f5b-9617-46873c464e87', 'ce266b48-11d7-4389-9b42-254e4098bfc8', 'd2231c19-9b3b-4d56-b7f7-5511b7c7a7b6', 'd1db9059-a73a-4075-ad71-811061caca3e'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:29:00 devstack sudo[101578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_e9_kau89devstack@QuobyteHD Jul 16 23:29:00 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:00 devstack sudo[101574]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4b8071ee-2a7b-4a26-82d1-bb5dcf52be1a tempest-VolumesGetTest-720293127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.425s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:00 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-4b8071ee-2a7b-4a26-82d1-bb5dcf52be1a tempest-VolumesGetTest-720293127 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:29:00 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-4b8071ee-2a7b-4a26-82d1-bb5dcf52be1a tempest-VolumesGetTest-720293127 None] Deleted volume successfully. Jul 16 23:29:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-811499fb-888d-4023-b616-102ab2a8cb60 tempest-GroupsV314Test-445628626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:29:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-811499fb-888d-4023-b616-102ab2a8cb60 tempest-GroupsV314Test-445628626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:29:00 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-811499fb-888d-4023-b616-102ab2a8cb60 tempest-GroupsV314Test-445628626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:29:00 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-811499fb-888d-4023-b616-102ab2a8cb60 tempest-GroupsV314Test-445628626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:29:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-811499fb-888d-4023-b616-102ab2a8cb60 tempest-GroupsV314Test-445628626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:29:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-811499fb-888d-4023-b616-102ab2a8cb60 tempest-GroupsV314Test-445628626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:00 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4b8071ee-2a7b-4a26-82d1-bb5dcf52be1a tempest-VolumesGetTest-720293127 None] Lock "cinder-0f65baeb-0aa7-406b-9e4c-e13eb090db1b-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:29:00 devstack sudo[101581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:29:00 devstack sudo[101581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:01 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_e9_kau89devstack@QuobyteHD" returned: 0 in 0.545s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:01 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] 6519f5ae-0b5b-4a63-9b9b-0adb6304882e was qcow2, converting to qcow2 {{(pid=87607) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 16 23:29:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_e9_kau89devstack@QuobyteHD /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-173ebabb-fafd-45ec-b706-db6173da5b83 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:01 devstack sudo[101587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_e9_kau89devstack@QuobyteHD /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-173ebabb-fafd-45ec-b706-db6173da5b83 Jul 16 23:29:01 devstack sudo[101587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:01 devstack sudo[101581]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-811499fb-888d-4023-b616-102ab2a8cb60 tempest-GroupsV314Test-445628626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.404s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:01 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-811499fb-888d-4023-b616-102ab2a8cb60 tempest-GroupsV314Test-445628626 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:29:01 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-811499fb-888d-4023-b616-102ab2a8cb60 tempest-GroupsV314Test-445628626 None] Delete group completed successfully. Jul 16 23:29:01 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c69f39af-c29e-4c9b-8133-9c7974f16791 tempest-VolumesGetTest-720293127 None] Acquiring lock "cinder-2a872c0f-59c0-4aed-b59b-12ee9c9a4ac3-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:29:01 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c69f39af-c29e-4c9b-8133-9c7974f16791 tempest-VolumesGetTest-720293127 None] Lock "cinder-2a872c0f-59c0-4aed-b59b-12ee9c9a4ac3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:29:01 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c69f39af-c29e-4c9b-8133-9c7974f16791 tempest-VolumesGetTest-720293127 None] Acquiring lock "cinder-quobyte-2a872c0f-59c0-4aed-b59b-12ee9c9a4ac3" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:29:01 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c69f39af-c29e-4c9b-8133-9c7974f16791 tempest-VolumesGetTest-720293127 None] Lock "cinder-quobyte-2a872c0f-59c0-4aed-b59b-12ee9c9a4ac3" acquired by "delete_volume" :: waited 0.024s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:29:01 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df5f12c-79f1-49ed-9a07-3a3bf0619e84]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:29:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c69f39af-c29e-4c9b-8133-9c7974f16791 tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2a872c0f-59c0-4aed-b59b-12ee9c9a4ac3 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:01 devstack sudo[101594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2a872c0f-59c0-4aed-b59b-12ee9c9a4ac3 Jul 16 23:29:01 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:02 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-105bcc5b-72ed-40aa-a01e-85da828574a6 tempest-GroupsV314Test-445628626 None] Acquiring lock "cinder-quobyte-20775ce2-4b11-4f12-a23f-c657f02a1865" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:29:02 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-105bcc5b-72ed-40aa-a01e-85da828574a6 tempest-GroupsV314Test-445628626 None] Lock "cinder-quobyte-20775ce2-4b11-4f12-a23f-c657f02a1865" acquired by "delete_volume" :: waited 0.028s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:29:02 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc13cc1-1e3b-475b-b32c-136b4bd03d49]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:29:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-105bcc5b-72ed-40aa-a01e-85da828574a6 tempest-GroupsV314Test-445628626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:02 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c69f39af-c29e-4c9b-8133-9c7974f16791 tempest-VolumesGetTest-720293127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2a872c0f-59c0-4aed-b59b-12ee9c9a4ac3" returned: 0 in 0.699s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c69f39af-c29e-4c9b-8133-9c7974f16791 tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2a872c0f-59c0-4aed-b59b-12ee9c9a4ac3 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:02 devstack sudo[101602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2a872c0f-59c0-4aed-b59b-12ee9c9a4ac3 Jul 16 23:29:02 devstack sudo[101602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:02 devstack sudo[101601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865 Jul 16 23:29:02 devstack sudo[101601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:02 devstack sudo[101602]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c69f39af-c29e-4c9b-8133-9c7974f16791 tempest-VolumesGetTest-720293127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2a872c0f-59c0-4aed-b59b-12ee9c9a4ac3" returned: 0 in 0.426s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:02 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c69f39af-c29e-4c9b-8133-9c7974f16791 tempest-VolumesGetTest-720293127 None] Lock "cinder-quobyte-2a872c0f-59c0-4aed-b59b-12ee9c9a4ac3" released by "delete_volume" :: held 1.196s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:29:02 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-c69f39af-c29e-4c9b-8133-9c7974f16791 tempest-VolumesGetTest-720293127 None] Created reservations ['0ee52af9-638e-4163-95d3-754ff18232be', '708c95eb-80ac-483b-9cf7-3ffb80063732', '839cc46f-8b14-4fb0-b204-da8d6abacd16', '0261c067-6ebb-4981-8763-60274de14eb6'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:29:02 devstack sudo[101601]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-105bcc5b-72ed-40aa-a01e-85da828574a6 tempest-GroupsV314Test-445628626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865" returned: 0 in 0.687s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-105bcc5b-72ed-40aa-a01e-85da828574a6 tempest-GroupsV314Test-445628626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:02 devstack sudo[101609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865 Jul 16 23:29:02 devstack sudo[101609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c69f39af-c29e-4c9b-8133-9c7974f16791 tempest-VolumesGetTest-720293127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:29:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c69f39af-c29e-4c9b-8133-9c7974f16791 tempest-VolumesGetTest-720293127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:29:02 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-c69f39af-c29e-4c9b-8133-9c7974f16791 tempest-VolumesGetTest-720293127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:29:02 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-c69f39af-c29e-4c9b-8133-9c7974f16791 tempest-VolumesGetTest-720293127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:29:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c69f39af-c29e-4c9b-8133-9c7974f16791 tempest-VolumesGetTest-720293127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:29:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c69f39af-c29e-4c9b-8133-9c7974f16791 tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:03 devstack sudo[101611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:29:03 devstack sudo[101611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:03 devstack sudo[101609]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-105bcc5b-72ed-40aa-a01e-85da828574a6 tempest-GroupsV314Test-445628626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20775ce2-4b11-4f12-a23f-c657f02a1865" returned: 0 in 0.343s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:03 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-105bcc5b-72ed-40aa-a01e-85da828574a6 tempest-GroupsV314Test-445628626 None] Lock "cinder-quobyte-20775ce2-4b11-4f12-a23f-c657f02a1865" released by "delete_volume" :: held 1.143s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:29:03 devstack sudo[101611]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:03 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-105bcc5b-72ed-40aa-a01e-85da828574a6 tempest-GroupsV314Test-445628626 None] Created reservations ['fae37d6e-ae64-4444-9726-580f5b145dc6'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:29:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c69f39af-c29e-4c9b-8133-9c7974f16791 tempest-VolumesGetTest-720293127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.389s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:03 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-c69f39af-c29e-4c9b-8133-9c7974f16791 tempest-VolumesGetTest-720293127 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:29:03 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-c69f39af-c29e-4c9b-8133-9c7974f16791 tempest-VolumesGetTest-720293127 None] Deleted volume successfully. Jul 16 23:29:03 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c69f39af-c29e-4c9b-8133-9c7974f16791 tempest-VolumesGetTest-720293127 None] Lock "cinder-2a872c0f-59c0-4aed-b59b-12ee9c9a4ac3-delete_volume" released by "delete_volume" :: held 1.941s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:29:03 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-105bcc5b-72ed-40aa-a01e-85da828574a6 tempest-GroupsV314Test-445628626 None] Created reservations ['9ad995fd-41d5-4f38-ad09-c4070eed4184', '1e78b7f8-16e6-4ecb-91fd-33dd406d1ee1', '09011b9f-8be5-471f-92a6-6fe9c3cf7305', '92f05730-435d-4807-8ae1-95590f83a0fc'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:29:03 devstack sudo[101587]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_e9_kau89devstack@QuobyteHD /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-173ebabb-fafd-45ec-b706-db6173da5b83" returned: 0 in 2.472s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:03 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_e9_kau89devstack@QuobyteHD, size 112.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-173ebabb-fafd-45ec-b706-db6173da5b83 {{(pid=87607) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 23:29:03 devstack cinder-volume[87607]: INFO cinder.image.image_utils [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Converted 112.00 MB image at 45.29 MB/s Jul 16 23:29:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-173ebabb-fafd-45ec-b706-db6173da5b83 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:03 devstack sudo[101615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-173ebabb-fafd-45ec-b706-db6173da5b83 1G Jul 16 23:29:03 devstack sudo[101615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-105bcc5b-72ed-40aa-a01e-85da828574a6 tempest-GroupsV314Test-445628626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:29:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-105bcc5b-72ed-40aa-a01e-85da828574a6 tempest-GroupsV314Test-445628626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:29:03 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-105bcc5b-72ed-40aa-a01e-85da828574a6 tempest-GroupsV314Test-445628626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:29:03 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-105bcc5b-72ed-40aa-a01e-85da828574a6 tempest-GroupsV314Test-445628626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:29:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-105bcc5b-72ed-40aa-a01e-85da828574a6 tempest-GroupsV314Test-445628626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:29:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-105bcc5b-72ed-40aa-a01e-85da828574a6 tempest-GroupsV314Test-445628626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:03 devstack sudo[101617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:29:03 devstack sudo[101617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:03 devstack sudo[101617]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-105bcc5b-72ed-40aa-a01e-85da828574a6 tempest-GroupsV314Test-445628626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.308s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:03 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-105bcc5b-72ed-40aa-a01e-85da828574a6 tempest-GroupsV314Test-445628626 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:29:03 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-105bcc5b-72ed-40aa-a01e-85da828574a6 tempest-GroupsV314Test-445628626 None] Delete group completed successfully. Jul 16 23:29:03 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-acde1d8a-f0a5-4cf3-9797-574307f20e64 tempest-VolumesGetTest-720293127 None] Acquiring lock "cinder-4eb28b11-f816-4fde-a6f3-4fa38165e297-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:29:03 devstack sudo[101615]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-173ebabb-fafd-45ec-b706-db6173da5b83 1G" returned: 0 in 0.395s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:03 devstack cinder-volume[87607]: DEBUG cinder.volume.volume_utils [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Downloaded image 6519f5ae-0b5b-4a63-9b9b-0adb6304882e ((None, [{'url': 'file:///opt/stack/data/glance/images/6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'metadata': {}}])) to volume 173ebabb-fafd-45ec-b706-db6173da5b83 successfully. {{(pid=87607) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 16 23:29:03 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Temporary image 6519f5ae-0b5b-4a63-9b9b-0adb6304882e for user e9d816b303b44ddfb72223744cb080f5 is deleted. {{(pid=87607) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 16 23:29:03 devstack cinder-volume[87607]: DEBUG cinder.volume.volume_utils [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Marking volume 173ebabb-fafd-45ec-b706-db6173da5b83 as bootable. {{(pid=87607) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 16 23:29:03 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-acde1d8a-f0a5-4cf3-9797-574307f20e64 tempest-VolumesGetTest-720293127 None] Lock "cinder-4eb28b11-f816-4fde-a6f3-4fa38165e297-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:29:03 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Copying metadata from image 6519f5ae-0b5b-4a63-9b9b-0adb6304882e to 173ebabb-fafd-45ec-b706-db6173da5b83. {{(pid=87607) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 16 23:29:03 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Creating volume glance metadata for volume 173ebabb-fafd-45ec-b706-db6173da5b83 backed by image 6519f5ae-0b5b-4a63-9b9b-0adb6304882e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87607) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 16 23:29:03 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-acde1d8a-f0a5-4cf3-9797-574307f20e64 tempest-VolumesGetTest-720293127 None] Acquiring lock "cinder-quobyte-4eb28b11-f816-4fde-a6f3-4fa38165e297" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:29:03 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-acde1d8a-f0a5-4cf3-9797-574307f20e64 tempest-VolumesGetTest-720293127 None] Lock "cinder-quobyte-4eb28b11-f816-4fde-a6f3-4fa38165e297" acquired by "delete_volume" :: waited 0.019s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:29:04 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3291c5-af21-44e4-8315-50c85b81df9f]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:29:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-acde1d8a-f0a5-4cf3-9797-574307f20e64 tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:04 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c0a12b7-c49f-4505-89ef-398919a69f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-173ebabb-fafd-45ec-b706-db6173da5b83', 'volume_size': 1, 'image_id': '6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3319c84d612344f1b9ca29a92bf5a474', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'created_at': datetime.datetime(2026, 7, 16, 21, 12, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 21, 12, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6519f5ae-0b5b-4a63-9b9b-0adb6304882e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:04 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4332dcb-75e4-49b1-8e48-a22ec443de03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:04 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Volume volume-173ebabb-fafd-45ec-b706-db6173da5b83 (173ebabb-fafd-45ec-b706-db6173da5b83): created successfully Jul 16 23:29:04 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4332dcb-75e4-49b1-8e48-a22ec443de03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:04 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Flow 'volume_create_manager' (695d731d-c844-48b1-9dbd-f97046b95d29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:29:04 devstack sudo[101624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297 Jul 16 23:29:04 devstack sudo[101624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:04 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-b6cda659-dc3e-4337-a6e9-71df5d0b67a5 tempest-TestShelveInstance-125276292 None] Created volume successfully. Jul 16 23:29:04 devstack sudo[101624]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-acde1d8a-f0a5-4cf3-9797-574307f20e64 tempest-VolumesGetTest-720293127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297" returned: 0 in 0.542s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-acde1d8a-f0a5-4cf3-9797-574307f20e64 tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:04 devstack sudo[101629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297 Jul 16 23:29:04 devstack sudo[101629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:04 devstack sudo[101629]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-acde1d8a-f0a5-4cf3-9797-574307f20e64 tempest-VolumesGetTest-720293127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4eb28b11-f816-4fde-a6f3-4fa38165e297" returned: 0 in 0.357s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:04 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-acde1d8a-f0a5-4cf3-9797-574307f20e64 tempest-VolumesGetTest-720293127 None] Lock "cinder-quobyte-4eb28b11-f816-4fde-a6f3-4fa38165e297" released by "delete_volume" :: held 1.006s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:29:05 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-acde1d8a-f0a5-4cf3-9797-574307f20e64 tempest-VolumesGetTest-720293127 None] Created reservations ['07e76d9e-c2ba-45c3-887e-e21cc8238363', '0feed56f-c3fe-4280-ba6b-c8a109cb0498', '86d840d1-353c-4bb3-b083-e270e5f6bf65', '8ed4d78c-86d7-4ad6-852a-6a48ac12c011'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:29:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-acde1d8a-f0a5-4cf3-9797-574307f20e64 tempest-VolumesGetTest-720293127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:29:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-acde1d8a-f0a5-4cf3-9797-574307f20e64 tempest-VolumesGetTest-720293127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:29:05 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-acde1d8a-f0a5-4cf3-9797-574307f20e64 tempest-VolumesGetTest-720293127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:29:05 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-acde1d8a-f0a5-4cf3-9797-574307f20e64 tempest-VolumesGetTest-720293127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:29:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-acde1d8a-f0a5-4cf3-9797-574307f20e64 tempest-VolumesGetTest-720293127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:29:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-acde1d8a-f0a5-4cf3-9797-574307f20e64 tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:05 devstack sudo[101632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:29:05 devstack sudo[101632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:05 devstack sudo[101632]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-acde1d8a-f0a5-4cf3-9797-574307f20e64 tempest-VolumesGetTest-720293127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.325s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:05 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-acde1d8a-f0a5-4cf3-9797-574307f20e64 tempest-VolumesGetTest-720293127 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:29:05 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-acde1d8a-f0a5-4cf3-9797-574307f20e64 tempest-VolumesGetTest-720293127 None] Deleted volume successfully. Jul 16 23:29:05 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-acde1d8a-f0a5-4cf3-9797-574307f20e64 tempest-VolumesGetTest-720293127 None] Lock "cinder-4eb28b11-f816-4fde-a6f3-4fa38165e297-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:29:07 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:29:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Flow 'volume_create_manager' (68bd6a60-a9cd-402f-9966-c1ea8cb4e49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:29:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d910003c-bf8f-4567-aee4-ab220c6c41d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d910003c-bf8f-4567-aee4-ab220c6c41d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-548479000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c5cb573-2a5d-48d2-acc0-762078854218,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d553ba4b271a44df88d94d52e4104064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:29:07Z,use_quota=True,user_id='08f5f2b4e8884331a5914c76b0275b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01ff857b-f086-47cd-9f65-c22eacaa1e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01ff857b-f086-47cd-9f65-c22eacaa1e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0f1dc57-25f2-474e-9f63-7df15c59d15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:07 devstack cinder-volume[87607]: DEBUG cinder.image.glance [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Creating Keystone auth plugin from conf {{(pid=87607) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 16 23:29:08 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0f1dc57-25f2-474e-9f63-7df15c59d15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5c5cb573-2a5d-48d2-acc0-762078854218', 'volume_name': 'volume-5c5cb573-2a5d-48d2-acc0-762078854218', 'volume_size': 1, 'image_id': '6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3319c84d612344f1b9ca29a92bf5a474', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'created_at': datetime.datetime(2026, 7, 16, 21, 12, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 21, 12, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6519f5ae-0b5b-4a63-9b9b-0adb6304882e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:08 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f3ce575-b7f6-4b3c-97b1-5b0920a1d8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:08 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f3ce575-b7f6-4b3c-97b1-5b0920a1d8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:08 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98b2a0e0-1e10-4480-8a0c-e6ecb81ed615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:08 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Volume 5c5cb573-2a5d-48d2-acc0-762078854218: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5c5cb573-2a5d-48d2-acc0-762078854218', 'volume_size': 1, 'image_id': '6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3319c84d612344f1b9ca29a92bf5a474', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'created_at': datetime.datetime(2026, 7, 16, 21, 12, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 21, 12, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6519f5ae-0b5b-4a63-9b9b-0adb6304882e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 16 23:29:08 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Trying to clone 5c5cb573-2a5d-48d2-acc0-762078854218 from image 6519f5ae-0b5b-4a63-9b9b-0adb6304882e at location (None, [{'url': 'file:///opt/stack/data/glance/images/6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'metadata': {}}]). {{(pid=87607) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 16 23:29:08 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_171lwuuqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87607) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 16 23:29:08 devstack cinder-volume[87607]: INFO cinder.image.image_utils [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Image download 20.69 MB at 20.69 MB/s Jul 16 23:29:08 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e759fdd-4cb1-4b64-9331-be1d39bfc8a1]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:29:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_171lwuuqdevstack@QuobyteHD {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:08 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_171lwuuqdevstack@QuobyteHD Jul 16 23:29:08 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-694979be-ffb6-46a7-b538-704b1bf06207 req-77322fdc-4c8c-4ec3-8b33-27f30e3ed5c4 tempest-TestShelveInstance-125276292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:29:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-694979be-ffb6-46a7-b538-704b1bf06207 req-77322fdc-4c8c-4ec3-8b33-27f30e3ed5c4 tempest-TestShelveInstance-125276292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:29:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-694979be-ffb6-46a7-b538-704b1bf06207 req-77322fdc-4c8c-4ec3-8b33-27f30e3ed5c4 tempest-TestShelveInstance-125276292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:29:08 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-694979be-ffb6-46a7-b538-704b1bf06207 req-77322fdc-4c8c-4ec3-8b33-27f30e3ed5c4 tempest-TestShelveInstance-125276292 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72', 'name': 'volume-173ebabb-fafd-45ec-b706-db6173da5b83', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8a641d46-e11c-4d6e-a21b-5cb43603e952', 'enforce_multipath': True} {{(pid=87607) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 23:29:09 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_171lwuuqdevstack@QuobyteHD" returned: 0 in 0.506s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:09 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Temporary image 6519f5ae-0b5b-4a63-9b9b-0adb6304882e is fetched for user 08f5f2b4e8884331a5914c76b0275b7f. {{(pid=87607) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 16 23:29:09 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-694979be-ffb6-46a7-b538-704b1bf06207 req-77322fdc-4c8c-4ec3-8b33-27f30e3ed5c4 tempest-TestShelveInstance-125276292 None] attachment_update completed successfully. Jul 16 23:29:09 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca35e28-08ca-4f71-a65b-8dbfb601a55f]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:29:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_171lwuuqdevstack@QuobyteHD {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:09 devstack sudo[101653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_171lwuuqdevstack@QuobyteHD Jul 16 23:29:09 devstack sudo[101653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:09 devstack sudo[101653]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_171lwuuqdevstack@QuobyteHD" returned: 0 in 0.436s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:29:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:29:09 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-548479000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c5cb573-2a5d-48d2-acc0-762078854218,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d553ba4b271a44df88d94d52e4104064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:29:07Z,use_quota=True,user_id='08f5f2b4e8884331a5914c76b0275b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:29:09 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Creating volume 5c5cb573-2a5d-48d2-acc0-762078854218 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:29:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:29:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:29:09 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:29:09 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:29:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:29:09 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:29:09 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:29:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c5cb573-2a5d-48d2-acc0-762078854218 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:09 devstack sudo[101659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c5cb573-2a5d-48d2-acc0-762078854218 1073741824 Jul 16 23:29:09 devstack sudo[101659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:10 devstack sudo[101659]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c5cb573-2a5d-48d2-acc0-762078854218 1073741824" returned: 0 in 0.665s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c5cb573-2a5d-48d2-acc0-762078854218 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:10 devstack sudo[101664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c5cb573-2a5d-48d2-acc0-762078854218 Jul 16 23:29:10 devstack sudo[101664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:10 devstack sudo[101664]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c5cb573-2a5d-48d2-acc0-762078854218" returned: 0 in 0.306s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:10 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:29:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:29:10 devstack cinder-volume[87607]: DEBUG cinder.volume.volume_utils [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Attempting download of 6519f5ae-0b5b-4a63-9b9b-0adb6304882e ((None, [{'url': 'file:///opt/stack/data/glance/images/6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'metadata': {}}])) to volume 5c5cb573-2a5d-48d2-acc0-762078854218. {{(pid=87607) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 16 23:29:10 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[b353ba5e-286f-4d14-bf1f-1e4f3b0fb147]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:29:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_jbm4hg6g {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:10 devstack sudo[101667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_jbm4hg6g Jul 16 23:29:10 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:11 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_jbm4hg6g" returned: 0 in 0.411s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_jbm4hg6g {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:11 devstack sudo[101671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_jbm4hg6g Jul 16 23:29:11 devstack sudo[101671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:11 devstack sudo[101671]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_jbm4hg6g" returned: 1 in 0.448s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_jbm4hg6g' failed. Not Retrying. {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 23:29:11 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ca3cb0-74fa-4555-a87e-8e44d95a47f3]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:29:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_171lwuuqdevstack@QuobyteHD {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:11 devstack sudo[101675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_171lwuuqdevstack@QuobyteHD Jul 16 23:29:11 devstack sudo[101675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:12 devstack sudo[101675]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_171lwuuqdevstack@QuobyteHD" returned: 0 in 0.434s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:12 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] 6519f5ae-0b5b-4a63-9b9b-0adb6304882e was qcow2, converting to qcow2 {{(pid=87607) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 16 23:29:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_171lwuuqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c5cb573-2a5d-48d2-acc0-762078854218 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:12 devstack sudo[101681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_171lwuuqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c5cb573-2a5d-48d2-acc0-762078854218 Jul 16 23:29:12 devstack sudo[101681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:12 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-f639c137-059d-4020-9dcc-6779051b177c tempest-GroupsV320Test-261720781 None] Group tempest-GroupsV320Test-Group-1282395051: creating Jul 16 23:29:12 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-f639c137-059d-4020-9dcc-6779051b177c tempest-GroupsV320Test-261720781 None] Group tempest-GroupsV320Test-Group-1282395051: created successfully Jul 16 23:29:12 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-f639c137-059d-4020-9dcc-6779051b177c tempest-GroupsV320Test-261720781 None] Create group completed successfully. Jul 16 23:29:14 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-76fac2d9-d776-4ec1-a4dc-00f986fc85ba tempest-GroupsV320Test-261720781 None] Created reservations ['37ee6954-aaf3-4745-833a-5e825aa2b558'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:29:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-76fac2d9-d776-4ec1-a4dc-00f986fc85ba tempest-GroupsV320Test-261720781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:29:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-76fac2d9-d776-4ec1-a4dc-00f986fc85ba tempest-GroupsV320Test-261720781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:29:14 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-76fac2d9-d776-4ec1-a4dc-00f986fc85ba tempest-GroupsV320Test-261720781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:29:14 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-76fac2d9-d776-4ec1-a4dc-00f986fc85ba tempest-GroupsV320Test-261720781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:29:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-76fac2d9-d776-4ec1-a4dc-00f986fc85ba tempest-GroupsV320Test-261720781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:29:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-76fac2d9-d776-4ec1-a4dc-00f986fc85ba tempest-GroupsV320Test-261720781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:14 devstack sudo[102128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:29:14 devstack sudo[102128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:15 devstack sudo[102128]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-76fac2d9-d776-4ec1-a4dc-00f986fc85ba tempest-GroupsV320Test-261720781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.327s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:15 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-76fac2d9-d776-4ec1-a4dc-00f986fc85ba tempest-GroupsV320Test-261720781 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:29:15 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-76fac2d9-d776-4ec1-a4dc-00f986fc85ba tempest-GroupsV320Test-261720781 None] Delete group completed successfully. Jul 16 23:29:15 devstack sudo[101681]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_171lwuuqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c5cb573-2a5d-48d2-acc0-762078854218" returned: 0 in 3.113s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:15 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6519f5ae-0b5b-4a63-9b9b-0adb6304882e_171lwuuqdevstack@QuobyteHD, size 112.00 MB, duration 3.11 sec, destination /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c5cb573-2a5d-48d2-acc0-762078854218 {{(pid=87607) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 23:29:15 devstack cinder-volume[87607]: INFO cinder.image.image_utils [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Converted 112.00 MB image at 35.97 MB/s Jul 16 23:29:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c5cb573-2a5d-48d2-acc0-762078854218 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:15 devstack sudo[102133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c5cb573-2a5d-48d2-acc0-762078854218 1G Jul 16 23:29:15 devstack sudo[102133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:15 devstack sudo[102133]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c5cb573-2a5d-48d2-acc0-762078854218 1G" returned: 0 in 0.568s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:15 devstack cinder-volume[87607]: DEBUG cinder.volume.volume_utils [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Downloaded image 6519f5ae-0b5b-4a63-9b9b-0adb6304882e ((None, [{'url': 'file:///opt/stack/data/glance/images/6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'metadata': {}}])) to volume 5c5cb573-2a5d-48d2-acc0-762078854218 successfully. {{(pid=87607) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 16 23:29:15 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Temporary image 6519f5ae-0b5b-4a63-9b9b-0adb6304882e for user 08f5f2b4e8884331a5914c76b0275b7f is deleted. {{(pid=87607) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 16 23:29:15 devstack cinder-volume[87607]: DEBUG cinder.volume.volume_utils [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Marking volume 5c5cb573-2a5d-48d2-acc0-762078854218 as bootable. {{(pid=87607) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 16 23:29:15 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Copying metadata from image 6519f5ae-0b5b-4a63-9b9b-0adb6304882e to 5c5cb573-2a5d-48d2-acc0-762078854218. {{(pid=87607) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 16 23:29:15 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Creating volume glance metadata for volume 5c5cb573-2a5d-48d2-acc0-762078854218 backed by image 6519f5ae-0b5b-4a63-9b9b-0adb6304882e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87607) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 16 23:29:15 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98b2a0e0-1e10-4480-8a0c-e6ecb81ed615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c5cb573-2a5d-48d2-acc0-762078854218', 'volume_size': 1, 'image_id': '6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3319c84d612344f1b9ca29a92bf5a474', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6519f5ae-0b5b-4a63-9b9b-0adb6304882e', 'created_at': datetime.datetime(2026, 7, 16, 21, 12, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 21, 12, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6519f5ae-0b5b-4a63-9b9b-0adb6304882e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:15 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0f7cee3-a89f-4f3d-8955-75c0d0d17d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:16 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Volume volume-5c5cb573-2a5d-48d2-acc0-762078854218 (5c5cb573-2a5d-48d2-acc0-762078854218): created successfully Jul 16 23:29:16 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0f7cee3-a89f-4f3d-8955-75c0d0d17d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:16 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Flow 'volume_create_manager' (68bd6a60-a9cd-402f-9966-c1ea8cb4e49c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:29:16 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-3c063f2c-11dc-4178-abc0-74fd8fc2b801 tempest-VolumesGetTest-720293127 None] Created volume successfully. Jul 16 23:29:18 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-aad139ee-7fcd-45ec-bcfe-e9adad12db3a tempest-VolumesGetTest-720293127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:29:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-aad139ee-7fcd-45ec-bcfe-e9adad12db3a tempest-VolumesGetTest-720293127 None] Flow 'volume_create_manager' (19b228ec-68cf-4243-8a07-cc6854463515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:29:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-aad139ee-7fcd-45ec-bcfe-e9adad12db3a tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0c81bc2-0bda-4f1c-b56d-3a47ec658b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-aad139ee-7fcd-45ec-bcfe-e9adad12db3a tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0c81bc2-0bda-4f1c-b56d-3a47ec658b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:29:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1600599085',display_name='tempest-VolumesGetTest-Volume-588880983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d589734a-bfdd-45e8-a80b-e3d34cc35597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d553ba4b271a44df88d94d52e4104064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:29:18Z,use_quota=True,user_id='08f5f2b4e8884331a5914c76b0275b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-aad139ee-7fcd-45ec-bcfe-e9adad12db3a tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0ccc4b9-d008-4200-a45a-f5567f23a5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-aad139ee-7fcd-45ec-bcfe-e9adad12db3a tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0ccc4b9-d008-4200-a45a-f5567f23a5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-aad139ee-7fcd-45ec-bcfe-e9adad12db3a tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a580c493-20d8-418e-b632-76ef671a9662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-aad139ee-7fcd-45ec-bcfe-e9adad12db3a tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a580c493-20d8-418e-b632-76ef671a9662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd589734a-bfdd-45e8-a80b-e3d34cc35597', 'volume_name': 'volume-d589734a-bfdd-45e8-a80b-e3d34cc35597', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-aad139ee-7fcd-45ec-bcfe-e9adad12db3a tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d04806-bd4a-4a5e-9160-f6e43508c65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-aad139ee-7fcd-45ec-bcfe-e9adad12db3a tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d04806-bd4a-4a5e-9160-f6e43508c65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-aad139ee-7fcd-45ec-bcfe-e9adad12db3a tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f2266a2-aaa5-4935-920a-fbaaf100297a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:18 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-aad139ee-7fcd-45ec-bcfe-e9adad12db3a tempest-VolumesGetTest-720293127 None] Volume d589734a-bfdd-45e8-a80b-e3d34cc35597: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d589734a-bfdd-45e8-a80b-e3d34cc35597', 'volume_size': 1} Jul 16 23:29:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-aad139ee-7fcd-45ec-bcfe-e9adad12db3a tempest-VolumesGetTest-720293127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:29:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-aad139ee-7fcd-45ec-bcfe-e9adad12db3a tempest-VolumesGetTest-720293127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:29:18 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-aad139ee-7fcd-45ec-bcfe-e9adad12db3a tempest-VolumesGetTest-720293127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:29:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1600599085',display_name='tempest-VolumesGetTest-Volume-588880983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d589734a-bfdd-45e8-a80b-e3d34cc35597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d553ba4b271a44df88d94d52e4104064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:29:18Z,use_quota=True,user_id='08f5f2b4e8884331a5914c76b0275b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:29:18 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-aad139ee-7fcd-45ec-bcfe-e9adad12db3a tempest-VolumesGetTest-720293127 None] Creating volume d589734a-bfdd-45e8-a80b-e3d34cc35597 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:29:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-aad139ee-7fcd-45ec-bcfe-e9adad12db3a tempest-VolumesGetTest-720293127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:29:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-aad139ee-7fcd-45ec-bcfe-e9adad12db3a tempest-VolumesGetTest-720293127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:29:18 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-aad139ee-7fcd-45ec-bcfe-e9adad12db3a tempest-VolumesGetTest-720293127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:29:18 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-aad139ee-7fcd-45ec-bcfe-e9adad12db3a tempest-VolumesGetTest-720293127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:29:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-aad139ee-7fcd-45ec-bcfe-e9adad12db3a tempest-VolumesGetTest-720293127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:29:18 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-aad139ee-7fcd-45ec-bcfe-e9adad12db3a tempest-VolumesGetTest-720293127 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:29:18 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-aad139ee-7fcd-45ec-bcfe-e9adad12db3a tempest-VolumesGetTest-720293127 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:29:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-aad139ee-7fcd-45ec-bcfe-e9adad12db3a tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d589734a-bfdd-45e8-a80b-e3d34cc35597 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:18 devstack sudo[102143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d589734a-bfdd-45e8-a80b-e3d34cc35597 1073741824 Jul 16 23:29:18 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:19 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-aad139ee-7fcd-45ec-bcfe-e9adad12db3a tempest-VolumesGetTest-720293127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d589734a-bfdd-45e8-a80b-e3d34cc35597 1073741824" returned: 0 in 0.670s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-aad139ee-7fcd-45ec-bcfe-e9adad12db3a tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d589734a-bfdd-45e8-a80b-e3d34cc35597 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:19 devstack sudo[102150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d589734a-bfdd-45e8-a80b-e3d34cc35597 Jul 16 23:29:19 devstack sudo[102150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:19 devstack sudo[102150]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-aad139ee-7fcd-45ec-bcfe-e9adad12db3a tempest-VolumesGetTest-720293127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d589734a-bfdd-45e8-a80b-e3d34cc35597" returned: 0 in 0.459s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:19 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-aad139ee-7fcd-45ec-bcfe-e9adad12db3a tempest-VolumesGetTest-720293127 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:29:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-aad139ee-7fcd-45ec-bcfe-e9adad12db3a tempest-VolumesGetTest-720293127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:29:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-aad139ee-7fcd-45ec-bcfe-e9adad12db3a tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f2266a2-aaa5-4935-920a-fbaaf100297a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d589734a-bfdd-45e8-a80b-e3d34cc35597', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-aad139ee-7fcd-45ec-bcfe-e9adad12db3a tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4150ec61-4b62-43ed-a253-89fe3d232407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:19 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-aad139ee-7fcd-45ec-bcfe-e9adad12db3a tempest-VolumesGetTest-720293127 None] Volume volume-d589734a-bfdd-45e8-a80b-e3d34cc35597 (d589734a-bfdd-45e8-a80b-e3d34cc35597): created successfully Jul 16 23:29:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-aad139ee-7fcd-45ec-bcfe-e9adad12db3a tempest-VolumesGetTest-720293127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4150ec61-4b62-43ed-a253-89fe3d232407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-aad139ee-7fcd-45ec-bcfe-e9adad12db3a tempest-VolumesGetTest-720293127 None] Flow 'volume_create_manager' (19b228ec-68cf-4243-8a07-cc6854463515) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:29:19 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-aad139ee-7fcd-45ec-bcfe-e9adad12db3a tempest-VolumesGetTest-720293127 None] Created volume successfully. Jul 16 23:29:20 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-cacbfd3d-b567-4303-a837-0de4c6cb100e tempest-VolumesGetTest-720293127 None] Acquiring lock "cinder-d589734a-bfdd-45e8-a80b-e3d34cc35597-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:29:20 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-cacbfd3d-b567-4303-a837-0de4c6cb100e tempest-VolumesGetTest-720293127 None] Lock "cinder-d589734a-bfdd-45e8-a80b-e3d34cc35597-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:29:20 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-cacbfd3d-b567-4303-a837-0de4c6cb100e tempest-VolumesGetTest-720293127 None] Acquiring lock "cinder-quobyte-d589734a-bfdd-45e8-a80b-e3d34cc35597" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:29:20 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-cacbfd3d-b567-4303-a837-0de4c6cb100e tempest-VolumesGetTest-720293127 None] Lock "cinder-quobyte-d589734a-bfdd-45e8-a80b-e3d34cc35597" acquired by "delete_volume" :: waited 0.018s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:29:20 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f627531-fab7-4e77-8917-d661ebd2048d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:29:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cacbfd3d-b567-4303-a837-0de4c6cb100e tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d589734a-bfdd-45e8-a80b-e3d34cc35597 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:21 devstack sudo[102153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d589734a-bfdd-45e8-a80b-e3d34cc35597 Jul 16 23:29:21 devstack sudo[102153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:21 devstack sudo[102153]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cacbfd3d-b567-4303-a837-0de4c6cb100e tempest-VolumesGetTest-720293127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d589734a-bfdd-45e8-a80b-e3d34cc35597" returned: 0 in 0.812s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cacbfd3d-b567-4303-a837-0de4c6cb100e tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d589734a-bfdd-45e8-a80b-e3d34cc35597 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:21 devstack sudo[102158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d589734a-bfdd-45e8-a80b-e3d34cc35597 Jul 16 23:29:21 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:21 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cacbfd3d-b567-4303-a837-0de4c6cb100e tempest-VolumesGetTest-720293127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d589734a-bfdd-45e8-a80b-e3d34cc35597" returned: 0 in 0.315s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:22 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-cacbfd3d-b567-4303-a837-0de4c6cb100e tempest-VolumesGetTest-720293127 None] Lock "cinder-quobyte-d589734a-bfdd-45e8-a80b-e3d34cc35597" released by "delete_volume" :: held 1.201s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:29:22 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-cacbfd3d-b567-4303-a837-0de4c6cb100e tempest-VolumesGetTest-720293127 None] Created reservations ['903f4a52-b9b3-482b-99a0-c8a97b68136a', 'd2a33055-95f4-451f-8be4-d774bf3792c5', '127dd257-2409-443a-aeb1-e904e6711931', '77d94562-5b4f-4e25-b68a-c8876c4a6081'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:29:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-cacbfd3d-b567-4303-a837-0de4c6cb100e tempest-VolumesGetTest-720293127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:29:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-cacbfd3d-b567-4303-a837-0de4c6cb100e tempest-VolumesGetTest-720293127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:29:22 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-cacbfd3d-b567-4303-a837-0de4c6cb100e tempest-VolumesGetTest-720293127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:29:22 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-cacbfd3d-b567-4303-a837-0de4c6cb100e tempest-VolumesGetTest-720293127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:29:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-cacbfd3d-b567-4303-a837-0de4c6cb100e tempest-VolumesGetTest-720293127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:29:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cacbfd3d-b567-4303-a837-0de4c6cb100e tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:22 devstack sudo[102161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:29:22 devstack sudo[102161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:22 devstack sudo[102161]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cacbfd3d-b567-4303-a837-0de4c6cb100e tempest-VolumesGetTest-720293127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.354s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:22 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-cacbfd3d-b567-4303-a837-0de4c6cb100e tempest-VolumesGetTest-720293127 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:29:22 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-cacbfd3d-b567-4303-a837-0de4c6cb100e tempest-VolumesGetTest-720293127 None] Deleted volume successfully. Jul 16 23:29:22 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:SELECT=125,cinder:INSERT=42,cinder:UPDATE=127,cinder:DELETE=10 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:29:22 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-cacbfd3d-b567-4303-a837-0de4c6cb100e tempest-VolumesGetTest-720293127 None] Lock "cinder-d589734a-bfdd-45e8-a80b-e3d34cc35597-delete_volume" released by "delete_volume" :: held 1.992s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:29:23 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6cd6b3c8-ff47-470e-aca4-69115c02b58d tempest-VolumesGetTest-720293127 None] Acquiring lock "cinder-5c5cb573-2a5d-48d2-acc0-762078854218-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:29:23 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6cd6b3c8-ff47-470e-aca4-69115c02b58d tempest-VolumesGetTest-720293127 None] Lock "cinder-5c5cb573-2a5d-48d2-acc0-762078854218-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:29:23 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:SELECT=113,cinder:INSERT=49,cinder:UPDATE=128,cinder:DELETE=7 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:29:23 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6cd6b3c8-ff47-470e-aca4-69115c02b58d tempest-VolumesGetTest-720293127 None] Acquiring lock "cinder-quobyte-5c5cb573-2a5d-48d2-acc0-762078854218" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:29:23 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6cd6b3c8-ff47-470e-aca4-69115c02b58d tempest-VolumesGetTest-720293127 None] Lock "cinder-quobyte-5c5cb573-2a5d-48d2-acc0-762078854218" acquired by "delete_volume" :: waited 0.040s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:29:23 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[2356fba6-4a22-44fa-bef6-7d8c0fd08157]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:29:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6cd6b3c8-ff47-470e-aca4-69115c02b58d tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c5cb573-2a5d-48d2-acc0-762078854218 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:23 devstack sudo[102164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c5cb573-2a5d-48d2-acc0-762078854218 Jul 16 23:29:23 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:23 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-79a3c87d-f9ec-48a6-ba4e-1ea4ffb5ad5a tempest-SnapshotDependencyTests-1553893050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:29:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-79a3c87d-f9ec-48a6-ba4e-1ea4ffb5ad5a tempest-SnapshotDependencyTests-1553893050 None] Flow 'volume_create_manager' (836d3085-f1cd-42eb-9202-ba2ca278e551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:29:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-79a3c87d-f9ec-48a6-ba4e-1ea4ffb5ad5a tempest-SnapshotDependencyTests-1553893050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7e6f86c-633f-409c-992f-31a9f3968760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-79a3c87d-f9ec-48a6-ba4e-1ea4ffb5ad5a tempest-SnapshotDependencyTests-1553893050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7e6f86c-633f-409c-992f-31a9f3968760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2017781457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ad1a0be-ddb9-48ad-98b6-e69905a92083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae8bf7c8456e40c4b5d77f71e7bf3e1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:29:24Z,use_quota=True,user_id='28fc6b2a5d7f429ca05fd61cf5d9d851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-79a3c87d-f9ec-48a6-ba4e-1ea4ffb5ad5a tempest-SnapshotDependencyTests-1553893050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (314ded75-bf5f-4098-9ed8-b5a0a5552dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-79a3c87d-f9ec-48a6-ba4e-1ea4ffb5ad5a tempest-SnapshotDependencyTests-1553893050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (314ded75-bf5f-4098-9ed8-b5a0a5552dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-79a3c87d-f9ec-48a6-ba4e-1ea4ffb5ad5a tempest-SnapshotDependencyTests-1553893050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0a0976f-aed9-4669-a891-e8759628ce43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-79a3c87d-f9ec-48a6-ba4e-1ea4ffb5ad5a tempest-SnapshotDependencyTests-1553893050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0a0976f-aed9-4669-a891-e8759628ce43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ad1a0be-ddb9-48ad-98b6-e69905a92083', 'volume_name': 'volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-79a3c87d-f9ec-48a6-ba4e-1ea4ffb5ad5a tempest-SnapshotDependencyTests-1553893050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5618116-5f8e-42b5-807e-e396b17cdcbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-79a3c87d-f9ec-48a6-ba4e-1ea4ffb5ad5a tempest-SnapshotDependencyTests-1553893050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5618116-5f8e-42b5-807e-e396b17cdcbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-79a3c87d-f9ec-48a6-ba4e-1ea4ffb5ad5a tempest-SnapshotDependencyTests-1553893050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be53d2cb-9a5f-4dc7-851c-9cbb4ec8c19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:23 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-79a3c87d-f9ec-48a6-ba4e-1ea4ffb5ad5a tempest-SnapshotDependencyTests-1553893050 None] Volume 0ad1a0be-ddb9-48ad-98b6-e69905a92083: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083', 'volume_size': 1} Jul 16 23:29:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-79a3c87d-f9ec-48a6-ba4e-1ea4ffb5ad5a tempest-SnapshotDependencyTests-1553893050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:29:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-79a3c87d-f9ec-48a6-ba4e-1ea4ffb5ad5a tempest-SnapshotDependencyTests-1553893050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:29:23 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-79a3c87d-f9ec-48a6-ba4e-1ea4ffb5ad5a tempest-SnapshotDependencyTests-1553893050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2017781457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ad1a0be-ddb9-48ad-98b6-e69905a92083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae8bf7c8456e40c4b5d77f71e7bf3e1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:29:24Z,use_quota=True,user_id='28fc6b2a5d7f429ca05fd61cf5d9d851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:29:23 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-79a3c87d-f9ec-48a6-ba4e-1ea4ffb5ad5a tempest-SnapshotDependencyTests-1553893050 None] Creating volume 0ad1a0be-ddb9-48ad-98b6-e69905a92083 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:29:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-79a3c87d-f9ec-48a6-ba4e-1ea4ffb5ad5a tempest-SnapshotDependencyTests-1553893050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:29:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-79a3c87d-f9ec-48a6-ba4e-1ea4ffb5ad5a tempest-SnapshotDependencyTests-1553893050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:29:23 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-79a3c87d-f9ec-48a6-ba4e-1ea4ffb5ad5a tempest-SnapshotDependencyTests-1553893050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:29:23 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-79a3c87d-f9ec-48a6-ba4e-1ea4ffb5ad5a tempest-SnapshotDependencyTests-1553893050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:29:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-79a3c87d-f9ec-48a6-ba4e-1ea4ffb5ad5a tempest-SnapshotDependencyTests-1553893050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:29:23 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-79a3c87d-f9ec-48a6-ba4e-1ea4ffb5ad5a tempest-SnapshotDependencyTests-1553893050 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:29:23 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-79a3c87d-f9ec-48a6-ba4e-1ea4ffb5ad5a tempest-SnapshotDependencyTests-1553893050 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:29:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-79a3c87d-f9ec-48a6-ba4e-1ea4ffb5ad5a tempest-SnapshotDependencyTests-1553893050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:23 devstack sudo[102166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083 1073741824 Jul 16 23:29:23 devstack sudo[102166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:24 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6cd6b3c8-ff47-470e-aca4-69115c02b58d tempest-VolumesGetTest-720293127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c5cb573-2a5d-48d2-acc0-762078854218" returned: 0 in 0.645s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6cd6b3c8-ff47-470e-aca4-69115c02b58d tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c5cb573-2a5d-48d2-acc0-762078854218 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:24 devstack sudo[102171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c5cb573-2a5d-48d2-acc0-762078854218 Jul 16 23:29:24 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:24 devstack sudo[102166]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-79a3c87d-f9ec-48a6-ba4e-1ea4ffb5ad5a tempest-SnapshotDependencyTests-1553893050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083 1073741824" returned: 0 in 0.624s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:24 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6cd6b3c8-ff47-470e-aca4-69115c02b58d tempest-VolumesGetTest-720293127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5c5cb573-2a5d-48d2-acc0-762078854218" returned: 0 in 0.452s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:24 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6cd6b3c8-ff47-470e-aca4-69115c02b58d tempest-VolumesGetTest-720293127 None] Lock "cinder-quobyte-5c5cb573-2a5d-48d2-acc0-762078854218" released by "delete_volume" :: held 1.233s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:29:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-79a3c87d-f9ec-48a6-ba4e-1ea4ffb5ad5a tempest-SnapshotDependencyTests-1553893050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:24 devstack sudo[102178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083 Jul 16 23:29:24 devstack sudo[102178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:24 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-6cd6b3c8-ff47-470e-aca4-69115c02b58d tempest-VolumesGetTest-720293127 None] Created reservations ['cf2aadf7-0e71-4a7e-99a9-375c6f9fdc12', '4d3e8459-b311-4c46-9db4-38de25f1f74e', 'e7546875-396c-477c-b08c-9a7ab9630af2', 'f865a031-aa18-49ef-b202-5462c47ea994'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:29:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6cd6b3c8-ff47-470e-aca4-69115c02b58d tempest-VolumesGetTest-720293127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:29:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6cd6b3c8-ff47-470e-aca4-69115c02b58d tempest-VolumesGetTest-720293127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:29:24 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-6cd6b3c8-ff47-470e-aca4-69115c02b58d tempest-VolumesGetTest-720293127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:29:24 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-6cd6b3c8-ff47-470e-aca4-69115c02b58d tempest-VolumesGetTest-720293127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:29:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6cd6b3c8-ff47-470e-aca4-69115c02b58d tempest-VolumesGetTest-720293127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:29:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6cd6b3c8-ff47-470e-aca4-69115c02b58d tempest-VolumesGetTest-720293127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:25 devstack sudo[102180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:29:25 devstack sudo[102180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:25 devstack sudo[102178]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-79a3c87d-f9ec-48a6-ba4e-1ea4ffb5ad5a tempest-SnapshotDependencyTests-1553893050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083" returned: 0 in 0.402s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:25 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-79a3c87d-f9ec-48a6-ba4e-1ea4ffb5ad5a tempest-SnapshotDependencyTests-1553893050 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:29:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-79a3c87d-f9ec-48a6-ba4e-1ea4ffb5ad5a tempest-SnapshotDependencyTests-1553893050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:29:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-79a3c87d-f9ec-48a6-ba4e-1ea4ffb5ad5a tempest-SnapshotDependencyTests-1553893050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be53d2cb-9a5f-4dc7-851c-9cbb4ec8c19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-79a3c87d-f9ec-48a6-ba4e-1ea4ffb5ad5a tempest-SnapshotDependencyTests-1553893050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c07569b-e6e2-4bfd-b210-9529c046f4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:25 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-79a3c87d-f9ec-48a6-ba4e-1ea4ffb5ad5a tempest-SnapshotDependencyTests-1553893050 None] Volume volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083 (0ad1a0be-ddb9-48ad-98b6-e69905a92083): created successfully Jul 16 23:29:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-79a3c87d-f9ec-48a6-ba4e-1ea4ffb5ad5a tempest-SnapshotDependencyTests-1553893050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c07569b-e6e2-4bfd-b210-9529c046f4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-79a3c87d-f9ec-48a6-ba4e-1ea4ffb5ad5a tempest-SnapshotDependencyTests-1553893050 None] Flow 'volume_create_manager' (836d3085-f1cd-42eb-9202-ba2ca278e551) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:29:25 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-79a3c87d-f9ec-48a6-ba4e-1ea4ffb5ad5a tempest-SnapshotDependencyTests-1553893050 None] Created volume successfully. Jul 16 23:29:25 devstack sudo[102180]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6cd6b3c8-ff47-470e-aca4-69115c02b58d tempest-VolumesGetTest-720293127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.407s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:25 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-6cd6b3c8-ff47-470e-aca4-69115c02b58d tempest-VolumesGetTest-720293127 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:29:25 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-6cd6b3c8-ff47-470e-aca4-69115c02b58d tempest-VolumesGetTest-720293127 None] Deleted volume successfully. Jul 16 23:29:25 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6cd6b3c8-ff47-470e-aca4-69115c02b58d tempest-VolumesGetTest-720293127 None] Lock "cinder-5c5cb573-2a5d-48d2-acc0-762078854218-delete_volume" released by "delete_volume" :: held 2.163s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:29:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-2ebee02f-5f40-43cf-80ad-1c5f88625e36 tempest-SnapshotDependencyTests-1553893050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:29:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-2ebee02f-5f40-43cf-80ad-1c5f88625e36 tempest-SnapshotDependencyTests-1553893050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:29:26 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-2ebee02f-5f40-43cf-80ad-1c5f88625e36 tempest-SnapshotDependencyTests-1553893050 None] Creating offline snapshot d538992d-e347-4e44-88b0-9fa9d4b785d7 of volume 0ad1a0be-ddb9-48ad-98b6-e69905a92083 {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:29:26 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[d778784a-a5b6-4c16-a8d5-a26a91c48a43]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:29:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2ebee02f-5f40-43cf-80ad-1c5f88625e36 tempest-SnapshotDependencyTests-1553893050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:26 devstack sudo[102185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083 Jul 16 23:29:26 devstack sudo[102185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:26 devstack sudo[102185]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2ebee02f-5f40-43cf-80ad-1c5f88625e36 tempest-SnapshotDependencyTests-1553893050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083" returned: 0 in 0.643s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2ebee02f-5f40-43cf-80ad-1c5f88625e36 tempest-SnapshotDependencyTests-1553893050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083.d538992d-e347-4e44-88b0-9fa9d4b785d7 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:26 devstack sudo[102190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083.d538992d-e347-4e44-88b0-9fa9d4b785d7 1G Jul 16 23:29:26 devstack sudo[102190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:27 devstack sudo[102190]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2ebee02f-5f40-43cf-80ad-1c5f88625e36 tempest-SnapshotDependencyTests-1553893050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083.d538992d-e347-4e44-88b0-9fa9d4b785d7 1G" returned: 0 in 0.674s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2ebee02f-5f40-43cf-80ad-1c5f88625e36 tempest-SnapshotDependencyTests-1553893050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083.d538992d-e347-4e44-88b0-9fa9d4b785d7 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:27 devstack sudo[102195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083.d538992d-e347-4e44-88b0-9fa9d4b785d7 Jul 16 23:29:27 devstack sudo[102195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:28 devstack sudo[102195]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2ebee02f-5f40-43cf-80ad-1c5f88625e36 tempest-SnapshotDependencyTests-1553893050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083.d538992d-e347-4e44-88b0-9fa9d4b785d7" returned: 0 in 0.478s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:28 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-2ebee02f-5f40-43cf-80ad-1c5f88625e36 tempest-SnapshotDependencyTests-1553893050 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083.d538992d-e347-4e44-88b0-9fa9d4b785d7 is being set with open permissions: ugo+rw Jul 16 23:29:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2ebee02f-5f40-43cf-80ad-1c5f88625e36 tempest-SnapshotDependencyTests-1553893050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083.d538992d-e347-4e44-88b0-9fa9d4b785d7 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:28 devstack sudo[102201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083.d538992d-e347-4e44-88b0-9fa9d4b785d7 Jul 16 23:29:28 devstack sudo[102201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:28 devstack sudo[102201]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2ebee02f-5f40-43cf-80ad-1c5f88625e36 tempest-SnapshotDependencyTests-1553893050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083.d538992d-e347-4e44-88b0-9fa9d4b785d7" returned: 0 in 0.337s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2ebee02f-5f40-43cf-80ad-1c5f88625e36 tempest-SnapshotDependencyTests-1553893050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:28 devstack sudo[102204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083.info Jul 16 23:29:28 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:28 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2ebee02f-5f40-43cf-80ad-1c5f88625e36 tempest-SnapshotDependencyTests-1553893050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083.info" returned: 0 in 0.344s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:28 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-2ebee02f-5f40-43cf-80ad-1c5f88625e36 tempest-SnapshotDependencyTests-1553893050 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083.info is being set with open permissions: ugo+rw Jul 16 23:29:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2ebee02f-5f40-43cf-80ad-1c5f88625e36 tempest-SnapshotDependencyTests-1553893050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:28 devstack sudo[102207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083.info Jul 16 23:29:28 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:29 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2ebee02f-5f40-43cf-80ad-1c5f88625e36 tempest-SnapshotDependencyTests-1553893050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083.info" returned: 0 in 0.331s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-2ebee02f-5f40-43cf-80ad-1c5f88625e36 tempest-SnapshotDependencyTests-1553893050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.958s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:29:29 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-2ebee02f-5f40-43cf-80ad-1c5f88625e36 tempest-SnapshotDependencyTests-1553893050 None] Create snapshot completed successfully Jul 16 23:29:29 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d2a3141-df3d-42cd-b21c-a041fddc5eb6 tempest-VolumesListTestJSON-255654901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:29:29 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6d2a3141-df3d-42cd-b21c-a041fddc5eb6 tempest-VolumesListTestJSON-255654901 None] Flow 'volume_create_manager' (ec78a2bc-bfd5-4c61-a821-b75ce150a8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:29:29 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6d2a3141-df3d-42cd-b21c-a041fddc5eb6 tempest-VolumesListTestJSON-255654901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84334f88-45bb-4bdc-8c5d-8a1e36403902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:29 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6d2a3141-df3d-42cd-b21c-a041fddc5eb6 tempest-VolumesListTestJSON-255654901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84334f88-45bb-4bdc-8c5d-8a1e36403902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:29:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1189228118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbd884a2-f8ec-4b57-8940-4249fb74358d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3f4d7eb13f6042a6b3fce919204067c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:29:30Z,use_quota=True,user_id='c516775447594e309e7c0ea47424b462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:29 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6d2a3141-df3d-42cd-b21c-a041fddc5eb6 tempest-VolumesListTestJSON-255654901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b15a1e9-2074-45bd-9bbd-c0e6eda0ba08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:29 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6d2a3141-df3d-42cd-b21c-a041fddc5eb6 tempest-VolumesListTestJSON-255654901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b15a1e9-2074-45bd-9bbd-c0e6eda0ba08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:29 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6d2a3141-df3d-42cd-b21c-a041fddc5eb6 tempest-VolumesListTestJSON-255654901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef3576fa-f79a-45c2-b2ec-48c72ac061f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:29 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6d2a3141-df3d-42cd-b21c-a041fddc5eb6 tempest-VolumesListTestJSON-255654901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef3576fa-f79a-45c2-b2ec-48c72ac061f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbd884a2-f8ec-4b57-8940-4249fb74358d', 'volume_name': 'volume-dbd884a2-f8ec-4b57-8940-4249fb74358d', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:29 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6d2a3141-df3d-42cd-b21c-a041fddc5eb6 tempest-VolumesListTestJSON-255654901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db64a984-3fe4-4083-b6fd-d2a7cd95a0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:29 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6d2a3141-df3d-42cd-b21c-a041fddc5eb6 tempest-VolumesListTestJSON-255654901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db64a984-3fe4-4083-b6fd-d2a7cd95a0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:29 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6d2a3141-df3d-42cd-b21c-a041fddc5eb6 tempest-VolumesListTestJSON-255654901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18b8b002-0b79-4f6f-8d68-4af280d12b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:29 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-6d2a3141-df3d-42cd-b21c-a041fddc5eb6 tempest-VolumesListTestJSON-255654901 None] Volume dbd884a2-f8ec-4b57-8940-4249fb74358d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbd884a2-f8ec-4b57-8940-4249fb74358d', 'volume_size': 1} Jul 16 23:29:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6d2a3141-df3d-42cd-b21c-a041fddc5eb6 tempest-VolumesListTestJSON-255654901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:29:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6d2a3141-df3d-42cd-b21c-a041fddc5eb6 tempest-VolumesListTestJSON-255654901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:29:29 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-6d2a3141-df3d-42cd-b21c-a041fddc5eb6 tempest-VolumesListTestJSON-255654901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:29:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1189228118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbd884a2-f8ec-4b57-8940-4249fb74358d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3f4d7eb13f6042a6b3fce919204067c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:29:30Z,use_quota=True,user_id='c516775447594e309e7c0ea47424b462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:29:29 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-6d2a3141-df3d-42cd-b21c-a041fddc5eb6 tempest-VolumesListTestJSON-255654901 None] Creating volume dbd884a2-f8ec-4b57-8940-4249fb74358d {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:29:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6d2a3141-df3d-42cd-b21c-a041fddc5eb6 tempest-VolumesListTestJSON-255654901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:29:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6d2a3141-df3d-42cd-b21c-a041fddc5eb6 tempest-VolumesListTestJSON-255654901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:29:29 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-6d2a3141-df3d-42cd-b21c-a041fddc5eb6 tempest-VolumesListTestJSON-255654901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:29:29 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-6d2a3141-df3d-42cd-b21c-a041fddc5eb6 tempest-VolumesListTestJSON-255654901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:29:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6d2a3141-df3d-42cd-b21c-a041fddc5eb6 tempest-VolumesListTestJSON-255654901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:29:29 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-6d2a3141-df3d-42cd-b21c-a041fddc5eb6 tempest-VolumesListTestJSON-255654901 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:29:29 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-6d2a3141-df3d-42cd-b21c-a041fddc5eb6 tempest-VolumesListTestJSON-255654901 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:29:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6d2a3141-df3d-42cd-b21c-a041fddc5eb6 tempest-VolumesListTestJSON-255654901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-dbd884a2-f8ec-4b57-8940-4249fb74358d 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:29 devstack sudo[102211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-dbd884a2-f8ec-4b57-8940-4249fb74358d 1073741824 Jul 16 23:29:29 devstack sudo[102211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:30 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:29:30 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Flow 'volume_create_manager' (b097afaa-b2a5-40e1-bb74-51885264d89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:29:30 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d87e6f08-d73c-4279-8f4f-a1d93b9d1c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:30 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d87e6f08-d73c-4279-8f4f-a1d93b9d1c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=138353c0-29d0-4df5-9e4e-2bbd6b573987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae8bf7c8456e40c4b5d77f71e7bf3e1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d538992d-e347-4e44-88b0-9fa9d4b785d7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:29:30Z,use_quota=True,user_id='28fc6b2a5d7f429ca05fd61cf5d9d851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:30 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05700100-bd33-41a9-a305-31ad736e9445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:30 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05700100-bd33-41a9-a305-31ad736e9445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:30 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (829f24a1-dbbc-4d52-8247-20a6d72bc250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:30 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (829f24a1-dbbc-4d52-8247-20a6d72bc250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '138353c0-29d0-4df5-9e4e-2bbd6b573987', 'volume_name': 'volume-138353c0-29d0-4df5-9e4e-2bbd6b573987', 'volume_size': 1, 'snapshot_id': 'd538992d-e347-4e44-88b0-9fa9d4b785d7'}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:30 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a04fb0c0-449f-478a-ae7e-1f4bfe6a175f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:30 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a04fb0c0-449f-478a-ae7e-1f4bfe6a175f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:30 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87b934aa-8520-44d7-b655-3aa493d22c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:30 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Volume 138353c0-29d0-4df5-9e4e-2bbd6b573987: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-138353c0-29d0-4df5-9e4e-2bbd6b573987', 'volume_size': 1, 'snapshot_id': 'd538992d-e347-4e44-88b0-9fa9d4b785d7'} Jul 16 23:29:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:29:30 devstack sudo[102211]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6d2a3141-df3d-42cd-b21c-a041fddc5eb6 tempest-VolumesListTestJSON-255654901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-dbd884a2-f8ec-4b57-8940-4249fb74358d 1073741824" returned: 0 in 0.614s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6d2a3141-df3d-42cd-b21c-a041fddc5eb6 tempest-VolumesListTestJSON-255654901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-dbd884a2-f8ec-4b57-8940-4249fb74358d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:30 devstack sudo[102217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-dbd884a2-f8ec-4b57-8940-4249fb74358d Jul 16 23:29:30 devstack sudo[102217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:30 devstack sudo[102217]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6d2a3141-df3d-42cd-b21c-a041fddc5eb6 tempest-VolumesListTestJSON-255654901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-dbd884a2-f8ec-4b57-8940-4249fb74358d" returned: 0 in 0.280s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:30 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-6d2a3141-df3d-42cd-b21c-a041fddc5eb6 tempest-VolumesListTestJSON-255654901 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:29:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6d2a3141-df3d-42cd-b21c-a041fddc5eb6 tempest-VolumesListTestJSON-255654901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:29:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.362s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:29:30 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Acquiring lock "cinder-quobyte-d538992d-e347-4e44-88b0-9fa9d4b785d7-138353c0-29d0-4df5-9e4e-2bbd6b573987" by "_create_volume_from_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:29:30 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6d2a3141-df3d-42cd-b21c-a041fddc5eb6 tempest-VolumesListTestJSON-255654901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18b8b002-0b79-4f6f-8d68-4af280d12b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbd884a2-f8ec-4b57-8940-4249fb74358d', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:30 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6d2a3141-df3d-42cd-b21c-a041fddc5eb6 tempest-VolumesListTestJSON-255654901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4a5326a-c337-45ee-bb3e-845f9322e069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:30 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Lock "cinder-quobyte-d538992d-e347-4e44-88b0-9fa9d4b785d7-138353c0-29d0-4df5-9e4e-2bbd6b573987" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:29:30 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Creating volume 138353c0-29d0-4df5-9e4e-2bbd6b573987 from snapshot d538992d-e347-4e44-88b0-9fa9d4b785d7 {{(pid=87607) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 16 23:29:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:29:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:29:30 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:29:30 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:29:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:29:30 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:29:30 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Acquiring lock "cinder-quobyte-138353c0-29d0-4df5-9e4e-2bbd6b573987" by "_copy_volume_from_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:29:30 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-6d2a3141-df3d-42cd-b21c-a041fddc5eb6 tempest-VolumesListTestJSON-255654901 None] Volume volume-dbd884a2-f8ec-4b57-8940-4249fb74358d (dbd884a2-f8ec-4b57-8940-4249fb74358d): created successfully Jul 16 23:29:30 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6d2a3141-df3d-42cd-b21c-a041fddc5eb6 tempest-VolumesListTestJSON-255654901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4a5326a-c337-45ee-bb3e-845f9322e069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:30 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6d2a3141-df3d-42cd-b21c-a041fddc5eb6 tempest-VolumesListTestJSON-255654901 None] Flow 'volume_create_manager' (ec78a2bc-bfd5-4c61-a821-b75ce150a8c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:29:30 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Lock "cinder-quobyte-138353c0-29d0-4df5-9e4e-2bbd6b573987" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:29:30 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] snapshot: d538992d-e347-4e44-88b0-9fa9d4b785d7, volume: 138353c0-29d0-4df5-9e4e-2bbd6b573987, {{(pid=87607) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 16 23:29:30 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-6d2a3141-df3d-42cd-b21c-a041fddc5eb6 tempest-VolumesListTestJSON-255654901 None] Created volume successfully. Jul 16 23:29:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:29:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:29:31 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:29:31 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:29:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:29:31 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f923b9e-a8b1-433b-bb9c-5fbd6e3cfda6]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:29:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083.d538992d-e347-4e44-88b0-9fa9d4b785d7 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:31 devstack sudo[102220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083.d538992d-e347-4e44-88b0-9fa9d4b785d7 Jul 16 23:29:31 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:31 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083.d538992d-e347-4e44-88b0-9fa9d4b785d7" returned: 0 in 0.428s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:31 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:29:31 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083 {{(pid=87607) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 16 23:29:31 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Creating direct copy from snapshot {{(pid=87607) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 16 23:29:31 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccddfd0-7222-4d88-bedf-8af24fbce9cf]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:29:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:31 devstack sudo[102227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083 Jul 16 23:29:31 devstack sudo[102227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:31 devstack sudo[102227]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083" returned: 0 in 0.429s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:31 devstack cinder-volume[87607]: DEBUG cinder.utils [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Path /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-138353c0-29d0-4df5-9e4e-2bbd6b573987 not found in is_blk_device check {{(pid=87607) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 16 23:29:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-138353c0-29d0-4df5-9e4e-2bbd6b573987 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:31 devstack sudo[102235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-138353c0-29d0-4df5-9e4e-2bbd6b573987 Jul 16 23:29:31 devstack sudo[102235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:32 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee86eb21-647f-4c31-b8ad-653823cc47c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:29:32 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ee86eb21-647f-4c31-b8ad-653823cc47c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Flow 'volume_create_manager' (a7e13152-20cf-47a3-99e9-68c0347b9217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:29:32 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ee86eb21-647f-4c31-b8ad-653823cc47c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd124564-ff00-4843-90db-3c052c7e381d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:32 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ee86eb21-647f-4c31-b8ad-653823cc47c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd124564-ff00-4843-90db-3c052c7e381d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-287275303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4ac9824-96a3-4b49-88eb-5fc2556675db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f21b8a847c1b42cf957af6a9dd4ed364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:29:33Z,use_quota=True,user_id='c5eb7b5fcff448f6b112e9c73507015b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:32 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ee86eb21-647f-4c31-b8ad-653823cc47c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7b1ba8b-1a17-4ca9-b9ab-4c592f4c44c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:32 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ee86eb21-647f-4c31-b8ad-653823cc47c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7b1ba8b-1a17-4ca9-b9ab-4c592f4c44c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:33 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ee86eb21-647f-4c31-b8ad-653823cc47c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (836a3487-33e2-4c99-8169-16447a7df2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:33 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ee86eb21-647f-4c31-b8ad-653823cc47c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (836a3487-33e2-4c99-8169-16447a7df2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4ac9824-96a3-4b49-88eb-5fc2556675db', 'volume_name': 'volume-f4ac9824-96a3-4b49-88eb-5fc2556675db', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:33 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ee86eb21-647f-4c31-b8ad-653823cc47c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61ee9292-d274-4185-b836-1fa5334e0677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:33 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ee86eb21-647f-4c31-b8ad-653823cc47c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61ee9292-d274-4185-b836-1fa5334e0677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:33 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ee86eb21-647f-4c31-b8ad-653823cc47c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd08d4fb-47aa-49bf-b948-e7492d4ae75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:33 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-ee86eb21-647f-4c31-b8ad-653823cc47c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Volume f4ac9824-96a3-4b49-88eb-5fc2556675db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4ac9824-96a3-4b49-88eb-5fc2556675db', 'volume_size': 1} Jul 16 23:29:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ee86eb21-647f-4c31-b8ad-653823cc47c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:29:33 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-09d9f9da-ea12-4400-b3c9-6dc692c524cd tempest-VolumesListTestJSON-255654901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:29:33 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-09d9f9da-ea12-4400-b3c9-6dc692c524cd tempest-VolumesListTestJSON-255654901 None] Flow 'volume_create_manager' (2695ae88-2022-4a22-9aa0-a8aa89d3dda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:29:33 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-09d9f9da-ea12-4400-b3c9-6dc692c524cd tempest-VolumesListTestJSON-255654901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da2e370d-b7c1-46c0-a597-5cf134dda67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:33 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-09d9f9da-ea12-4400-b3c9-6dc692c524cd tempest-VolumesListTestJSON-255654901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da2e370d-b7c1-46c0-a597-5cf134dda67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-642787820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d6422d2-8652-457e-8fff-ba446b2025dc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3f4d7eb13f6042a6b3fce919204067c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:29:33Z,use_quota=True,user_id='c516775447594e309e7c0ea47424b462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:33 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-09d9f9da-ea12-4400-b3c9-6dc692c524cd tempest-VolumesListTestJSON-255654901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8ff299c-00c2-49bf-93a4-5f099d614614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:33 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-09d9f9da-ea12-4400-b3c9-6dc692c524cd tempest-VolumesListTestJSON-255654901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8ff299c-00c2-49bf-93a4-5f099d614614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:33 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-09d9f9da-ea12-4400-b3c9-6dc692c524cd tempest-VolumesListTestJSON-255654901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fee73b5-340d-4ca2-9cd1-f939765c46bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:33 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-09d9f9da-ea12-4400-b3c9-6dc692c524cd tempest-VolumesListTestJSON-255654901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fee73b5-340d-4ca2-9cd1-f939765c46bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d6422d2-8652-457e-8fff-ba446b2025dc', 'volume_name': 'volume-4d6422d2-8652-457e-8fff-ba446b2025dc', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:33 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-09d9f9da-ea12-4400-b3c9-6dc692c524cd tempest-VolumesListTestJSON-255654901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13c8af38-8b1c-482c-8059-e43cd1bc653d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:33 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-09d9f9da-ea12-4400-b3c9-6dc692c524cd tempest-VolumesListTestJSON-255654901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13c8af38-8b1c-482c-8059-e43cd1bc653d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:33 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-09d9f9da-ea12-4400-b3c9-6dc692c524cd tempest-VolumesListTestJSON-255654901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (739064f9-ed18-49ca-a9e5-6b10b2ff9eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:33 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-09d9f9da-ea12-4400-b3c9-6dc692c524cd tempest-VolumesListTestJSON-255654901 None] Volume 4d6422d2-8652-457e-8fff-ba446b2025dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d6422d2-8652-457e-8fff-ba446b2025dc', 'volume_size': 1} Jul 16 23:29:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-09d9f9da-ea12-4400-b3c9-6dc692c524cd tempest-VolumesListTestJSON-255654901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:29:36 devstack sudo[102235]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-138353c0-29d0-4df5-9e4e-2bbd6b573987" returned: 0 in 4.860s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:36 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[48870b56-847e-44e8-a03c-7119f47ac0fe]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:29:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:36 devstack sudo[102282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083 Jul 16 23:29:36 devstack sudo[102282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:37 devstack sudo[102282]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083" returned: 0 in 0.533s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:37 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Image conversion details: src /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083, size 1024.00 MB, duration 4.86 sec, destination /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-138353c0-29d0-4df5-9e4e-2bbd6b573987 {{(pid=87607) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 23:29:37 devstack cinder-volume[87607]: INFO cinder.image.image_utils [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Converted 1024.00 MB image at 210.66 MB/s Jul 16 23:29:37 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-138353c0-29d0-4df5-9e4e-2bbd6b573987 is being set with open permissions: ugo+rw Jul 16 23:29:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-138353c0-29d0-4df5-9e4e-2bbd6b573987 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:37 devstack sudo[102287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-138353c0-29d0-4df5-9e4e-2bbd6b573987 Jul 16 23:29:37 devstack sudo[102287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:37 devstack sudo[102287]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-138353c0-29d0-4df5-9e4e-2bbd6b573987" returned: 0 in 0.242s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:37 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Lock "cinder-quobyte-138353c0-29d0-4df5-9e4e-2bbd6b573987" released by "_copy_volume_from_snapshot" :: held 6.586s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:29:37 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Lock "cinder-quobyte-d538992d-e347-4e44-88b0-9fa9d4b785d7-138353c0-29d0-4df5-9e4e-2bbd6b573987" released by "_create_volume_from_snapshot" :: held 6.641s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:29:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.675s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:29:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ee86eb21-647f-4c31-b8ad-653823cc47c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.521s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:29:37 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ee86eb21-647f-4c31-b8ad-653823cc47c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-287275303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4ac9824-96a3-4b49-88eb-5fc2556675db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f21b8a847c1b42cf957af6a9dd4ed364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:29:33Z,use_quota=True,user_id='c5eb7b5fcff448f6b112e9c73507015b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:29:37 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-ee86eb21-647f-4c31-b8ad-653823cc47c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Creating volume f4ac9824-96a3-4b49-88eb-5fc2556675db {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:29:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ee86eb21-647f-4c31-b8ad-653823cc47c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:29:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ee86eb21-647f-4c31-b8ad-653823cc47c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:29:37 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ee86eb21-647f-4c31-b8ad-653823cc47c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:29:37 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ee86eb21-647f-4c31-b8ad-653823cc47c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:29:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ee86eb21-647f-4c31-b8ad-653823cc47c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:29:37 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ee86eb21-647f-4c31-b8ad-653823cc47c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:29:37 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-ee86eb21-647f-4c31-b8ad-653823cc47c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:29:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ee86eb21-647f-4c31-b8ad-653823cc47c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:37 devstack sudo[102290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db 1073741824 Jul 16 23:29:37 devstack sudo[102290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:37 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87b934aa-8520-44d7-b655-3aa493d22c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-138353c0-29d0-4df5-9e4e-2bbd6b573987', 'volume_size': 1, 'snapshot_id': 'd538992d-e347-4e44-88b0-9fa9d4b785d7'}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:37 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e522417a-a0f6-4c8f-8f60-e4e1661f4357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:37 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Volume volume-138353c0-29d0-4df5-9e4e-2bbd6b573987 (138353c0-29d0-4df5-9e4e-2bbd6b573987): created successfully Jul 16 23:29:37 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e522417a-a0f6-4c8f-8f60-e4e1661f4357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:37 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Flow 'volume_create_manager' (b097afaa-b2a5-40e1-bb74-51885264d89b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:29:37 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-e352072d-36b2-450d-8236-a7f0d3e10c54 tempest-SnapshotDependencyTests-1553893050 None] Created volume successfully. Jul 16 23:29:38 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fdd03b16-5083-45d2-b7c4-6059b6866edb tempest-SnapshotDependencyTests-1553893050 None] Acquiring lock "cinder-d538992d-e347-4e44-88b0-9fa9d4b785d7-delete_snapshot" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:29:38 devstack sudo[102290]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:38 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fdd03b16-5083-45d2-b7c4-6059b6866edb tempest-SnapshotDependencyTests-1553893050 None] Lock "cinder-d538992d-e347-4e44-88b0-9fa9d4b785d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:29:38 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fdd03b16-5083-45d2-b7c4-6059b6866edb tempest-SnapshotDependencyTests-1553893050 None] Acquiring lock "cinder-quobyte-0ad1a0be-ddb9-48ad-98b6-e69905a92083" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:29:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ee86eb21-647f-4c31-b8ad-653823cc47c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db 1073741824" returned: 0 in 0.511s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:38 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fdd03b16-5083-45d2-b7c4-6059b6866edb tempest-SnapshotDependencyTests-1553893050 None] Lock "cinder-quobyte-0ad1a0be-ddb9-48ad-98b6-e69905a92083" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:29:38 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fdd03b16-5083-45d2-b7c4-6059b6866edb tempest-SnapshotDependencyTests-1553893050 None] Acquiring lock "cinder-quobyte-d538992d-e347-4e44-88b0-9fa9d4b785d7" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:29:38 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fdd03b16-5083-45d2-b7c4-6059b6866edb tempest-SnapshotDependencyTests-1553893050 None] Lock "cinder-quobyte-d538992d-e347-4e44-88b0-9fa9d4b785d7" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:29:38 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-fdd03b16-5083-45d2-b7c4-6059b6866edb tempest-SnapshotDependencyTests-1553893050 None] Deleting offline snapshot d538992d-e347-4e44-88b0-9fa9d4b785d7 of volume 0ad1a0be-ddb9-48ad-98b6-e69905a92083 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:29:38 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-fdd03b16-5083-45d2-b7c4-6059b6866edb tempest-SnapshotDependencyTests-1553893050 None] snapshot_file for this snap is: volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083.d538992d-e347-4e44-88b0-9fa9d4b785d7 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:29:38 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb74963-53aa-4102-9b96-d1b83ef14702]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:29:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fdd03b16-5083-45d2-b7c4-6059b6866edb tempest-SnapshotDependencyTests-1553893050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083.d538992d-e347-4e44-88b0-9fa9d4b785d7 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ee86eb21-647f-4c31-b8ad-653823cc47c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:38 devstack sudo[102333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db Jul 16 23:29:38 devstack sudo[102333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:38 devstack sudo[102332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083.d538992d-e347-4e44-88b0-9fa9d4b785d7 Jul 16 23:29:38 devstack sudo[102332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:38 devstack sudo[102333]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ee86eb21-647f-4c31-b8ad-653823cc47c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db" returned: 0 in 0.238s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:38 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ee86eb21-647f-4c31-b8ad-653823cc47c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:29:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ee86eb21-647f-4c31-b8ad-653823cc47c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:29:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-09d9f9da-ea12-4400-b3c9-6dc692c524cd tempest-VolumesListTestJSON-255654901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.133s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:29:38 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-09d9f9da-ea12-4400-b3c9-6dc692c524cd tempest-VolumesListTestJSON-255654901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-642787820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d6422d2-8652-457e-8fff-ba446b2025dc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3f4d7eb13f6042a6b3fce919204067c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:29:33Z,use_quota=True,user_id='c516775447594e309e7c0ea47424b462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:29:38 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-09d9f9da-ea12-4400-b3c9-6dc692c524cd tempest-VolumesListTestJSON-255654901 None] Creating volume 4d6422d2-8652-457e-8fff-ba446b2025dc {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:29:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-09d9f9da-ea12-4400-b3c9-6dc692c524cd tempest-VolumesListTestJSON-255654901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:29:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-09d9f9da-ea12-4400-b3c9-6dc692c524cd tempest-VolumesListTestJSON-255654901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:29:38 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-09d9f9da-ea12-4400-b3c9-6dc692c524cd tempest-VolumesListTestJSON-255654901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:29:38 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-09d9f9da-ea12-4400-b3c9-6dc692c524cd tempest-VolumesListTestJSON-255654901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:29:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-09d9f9da-ea12-4400-b3c9-6dc692c524cd tempest-VolumesListTestJSON-255654901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:29:38 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-09d9f9da-ea12-4400-b3c9-6dc692c524cd tempest-VolumesListTestJSON-255654901 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:29:38 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-09d9f9da-ea12-4400-b3c9-6dc692c524cd tempest-VolumesListTestJSON-255654901 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:29:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-09d9f9da-ea12-4400-b3c9-6dc692c524cd tempest-VolumesListTestJSON-255654901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4d6422d2-8652-457e-8fff-ba446b2025dc 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ee86eb21-647f-4c31-b8ad-653823cc47c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd08d4fb-47aa-49bf-b948-e7492d4ae75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4ac9824-96a3-4b49-88eb-5fc2556675db', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:38 devstack sudo[102337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4d6422d2-8652-457e-8fff-ba446b2025dc 1073741824 Jul 16 23:29:38 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ee86eb21-647f-4c31-b8ad-653823cc47c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (873c4a46-4996-4263-84d0-f87a9f6d0c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:38 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-ee86eb21-647f-4c31-b8ad-653823cc47c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Volume volume-f4ac9824-96a3-4b49-88eb-5fc2556675db (f4ac9824-96a3-4b49-88eb-5fc2556675db): created successfully Jul 16 23:29:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ee86eb21-647f-4c31-b8ad-653823cc47c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (873c4a46-4996-4263-84d0-f87a9f6d0c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ee86eb21-647f-4c31-b8ad-653823cc47c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Flow 'volume_create_manager' (a7e13152-20cf-47a3-99e9-68c0347b9217) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:29:38 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-ee86eb21-647f-4c31-b8ad-653823cc47c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Created volume successfully. Jul 16 23:29:38 devstack sudo[102332]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fdd03b16-5083-45d2-b7c4-6059b6866edb tempest-SnapshotDependencyTests-1553893050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083.d538992d-e347-4e44-88b0-9fa9d4b785d7" returned: 0 in 0.374s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:38 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-fdd03b16-5083-45d2-b7c4-6059b6866edb tempest-SnapshotDependencyTests-1553893050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:29:38 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[6805ae66-caa8-4211-b118-5a574c1f0e6e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:29:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fdd03b16-5083-45d2-b7c4-6059b6866edb tempest-SnapshotDependencyTests-1553893050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:38 devstack sudo[102344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083 Jul 16 23:29:38 devstack sudo[102344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:38 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-09d9f9da-ea12-4400-b3c9-6dc692c524cd tempest-VolumesListTestJSON-255654901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4d6422d2-8652-457e-8fff-ba446b2025dc 1073741824" returned: 0 in 0.422s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-09d9f9da-ea12-4400-b3c9-6dc692c524cd tempest-VolumesListTestJSON-255654901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4d6422d2-8652-457e-8fff-ba446b2025dc {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:38 devstack sudo[102351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4d6422d2-8652-457e-8fff-ba446b2025dc Jul 16 23:29:38 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:38 devstack sudo[102344]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fdd03b16-5083-45d2-b7c4-6059b6866edb tempest-SnapshotDependencyTests-1553893050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083" returned: 0 in 0.399s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fdd03b16-5083-45d2-b7c4-6059b6866edb tempest-SnapshotDependencyTests-1553893050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083.d538992d-e347-4e44-88b0-9fa9d4b785d7 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:38 devstack sudo[102355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083.d538992d-e347-4e44-88b0-9fa9d4b785d7 Jul 16 23:29:38 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:39 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-09d9f9da-ea12-4400-b3c9-6dc692c524cd tempest-VolumesListTestJSON-255654901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4d6422d2-8652-457e-8fff-ba446b2025dc" returned: 0 in 0.289s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-09d9f9da-ea12-4400-b3c9-6dc692c524cd tempest-VolumesListTestJSON-255654901 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:29:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-09d9f9da-ea12-4400-b3c9-6dc692c524cd tempest-VolumesListTestJSON-255654901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:29:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-09d9f9da-ea12-4400-b3c9-6dc692c524cd tempest-VolumesListTestJSON-255654901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (739064f9-ed18-49ca-a9e5-6b10b2ff9eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d6422d2-8652-457e-8fff-ba446b2025dc', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-09d9f9da-ea12-4400-b3c9-6dc692c524cd tempest-VolumesListTestJSON-255654901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36bb8c70-85d0-495e-803b-a3a010d1ff7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:39 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-09d9f9da-ea12-4400-b3c9-6dc692c524cd tempest-VolumesListTestJSON-255654901 None] Volume volume-4d6422d2-8652-457e-8fff-ba446b2025dc (4d6422d2-8652-457e-8fff-ba446b2025dc): created successfully Jul 16 23:29:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-09d9f9da-ea12-4400-b3c9-6dc692c524cd tempest-VolumesListTestJSON-255654901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36bb8c70-85d0-495e-803b-a3a010d1ff7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-09d9f9da-ea12-4400-b3c9-6dc692c524cd tempest-VolumesListTestJSON-255654901 None] Flow 'volume_create_manager' (2695ae88-2022-4a22-9aa0-a8aa89d3dda5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:29:39 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-09d9f9da-ea12-4400-b3c9-6dc692c524cd tempest-VolumesListTestJSON-255654901 None] Created volume successfully. Jul 16 23:29:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0e5f0b7d-7c97-4d42-a86c-1dd733514611 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:29:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0e5f0b7d-7c97-4d42-a86c-1dd733514611 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:29:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-0e5f0b7d-7c97-4d42-a86c-1dd733514611 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Creating offline snapshot ae26f448-c0f8-4cc0-9bf0-3be73e3e2f0b of volume f4ac9824-96a3-4b49-88eb-5fc2556675db {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:29:39 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[e362d552-8e60-49e8-9412-198ea1cec984]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:29:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0e5f0b7d-7c97-4d42-a86c-1dd733514611 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:39 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fdd03b16-5083-45d2-b7c4-6059b6866edb tempest-SnapshotDependencyTests-1553893050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083.d538992d-e347-4e44-88b0-9fa9d4b785d7" returned: 0 in 0.413s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fdd03b16-5083-45d2-b7c4-6059b6866edb tempest-SnapshotDependencyTests-1553893050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083.d538992d-e347-4e44-88b0-9fa9d4b785d7 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:39 devstack sudo[102364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083.d538992d-e347-4e44-88b0-9fa9d4b785d7 Jul 16 23:29:39 devstack sudo[102364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:39 devstack sudo[102363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db Jul 16 23:29:39 devstack cinder-volume[87607]: DEBUG oslo_service.periodic_task [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:29:39 devstack sudo[102363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:29:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:29:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:29:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:29:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:29:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:39 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:29:39 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:39 devstack sudo[102364]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fdd03b16-5083-45d2-b7c4-6059b6866edb tempest-SnapshotDependencyTests-1553893050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083.d538992d-e347-4e44-88b0-9fa9d4b785d7" returned: 0 in 0.255s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:39 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fdd03b16-5083-45d2-b7c4-6059b6866edb tempest-SnapshotDependencyTests-1553893050 None] Lock "cinder-quobyte-d538992d-e347-4e44-88b0-9fa9d4b785d7" released by "_delete_snapshot" :: held 1.535s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:29:39 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fdd03b16-5083-45d2-b7c4-6059b6866edb tempest-SnapshotDependencyTests-1553893050 None] Lock "cinder-quobyte-0ad1a0be-ddb9-48ad-98b6-e69905a92083" released by "delete_snapshot" :: held 1.562s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:29:39 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.271s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:39 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:29:39 devstack cinder-volume[87607]: DEBUG oslo_service.periodic_task [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running periodic task VolumeManager._thread_info {{(pid=87607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:29:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] thread count: 28 {{(pid=87607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 23:29:39 devstack sudo[102363]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] thread info: [<_MainThread(MainThread, started 139090403627136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 23:29:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0e5f0b7d-7c97-4d42-a86c-1dd733514611 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db" returned: 0 in 0.426s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0e5f0b7d-7c97-4d42-a86c-1dd733514611 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db.ae26f448-c0f8-4cc0-9bf0-3be73e3e2f0b 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:39 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-fdd03b16-5083-45d2-b7c4-6059b6866edb tempest-SnapshotDependencyTests-1553893050 None] Created reservations ['e009f7c4-0bbf-4313-bbae-7067c8e94d1f', 'd77c01a1-1547-4ed1-ace2-788d9d6d0cee', '2e944f28-141f-4a6e-b139-2310cf23a3ef', 'ae23bc18-a598-47a6-b5e3-21096fe950f3'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:29:39 devstack sudo[102374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db.ae26f448-c0f8-4cc0-9bf0-3be73e3e2f0b 1G Jul 16 23:29:39 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:39 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-fdd03b16-5083-45d2-b7c4-6059b6866edb tempest-SnapshotDependencyTests-1553893050 None] Delete snapshot completed successfully. Jul 16 23:29:39 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fdd03b16-5083-45d2-b7c4-6059b6866edb tempest-SnapshotDependencyTests-1553893050 None] Lock "cinder-d538992d-e347-4e44-88b0-9fa9d4b785d7-delete_snapshot" released by "delete_snapshot" :: held 1.791s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:29:40 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0e5f0b7d-7c97-4d42-a86c-1dd733514611 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db.ae26f448-c0f8-4cc0-9bf0-3be73e3e2f0b 1G" returned: 0 in 0.416s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0e5f0b7d-7c97-4d42-a86c-1dd733514611 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4ac9824-96a3-4b49-88eb-5fc2556675db -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db.ae26f448-c0f8-4cc0-9bf0-3be73e3e2f0b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:40 devstack sudo[102379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4ac9824-96a3-4b49-88eb-5fc2556675db -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db.ae26f448-c0f8-4cc0-9bf0-3be73e3e2f0b Jul 16 23:29:40 devstack sudo[102379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:40 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-a363e717-5adb-4646-92da-49c68a901a0e tempest-SnapshotDependencyTests-1553893050 None] Acquiring lock "cinder-0ad1a0be-ddb9-48ad-98b6-e69905a92083-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:29:40 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-a363e717-5adb-4646-92da-49c68a901a0e tempest-SnapshotDependencyTests-1553893050 None] Lock "cinder-0ad1a0be-ddb9-48ad-98b6-e69905a92083-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:29:40 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-a363e717-5adb-4646-92da-49c68a901a0e tempest-SnapshotDependencyTests-1553893050 None] Acquiring lock "cinder-quobyte-0ad1a0be-ddb9-48ad-98b6-e69905a92083" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:29:40 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-a363e717-5adb-4646-92da-49c68a901a0e tempest-SnapshotDependencyTests-1553893050 None] Lock "cinder-quobyte-0ad1a0be-ddb9-48ad-98b6-e69905a92083" acquired by "delete_volume" :: waited 0.020s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:29:40 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e5822f-b84e-45a1-a577-0424830f64b2]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:29:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a363e717-5adb-4646-92da-49c68a901a0e tempest-SnapshotDependencyTests-1553893050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:40 devstack sudo[102381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083 Jul 16 23:29:40 devstack sudo[102381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:40 devstack sudo[102379]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0e5f0b7d-7c97-4d42-a86c-1dd733514611 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4ac9824-96a3-4b49-88eb-5fc2556675db -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db.ae26f448-c0f8-4cc0-9bf0-3be73e3e2f0b" returned: 0 in 0.341s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:40 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-0e5f0b7d-7c97-4d42-a86c-1dd733514611 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db.ae26f448-c0f8-4cc0-9bf0-3be73e3e2f0b is being set with open permissions: ugo+rw Jul 16 23:29:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0e5f0b7d-7c97-4d42-a86c-1dd733514611 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db.ae26f448-c0f8-4cc0-9bf0-3be73e3e2f0b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:40 devstack sudo[102386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db.ae26f448-c0f8-4cc0-9bf0-3be73e3e2f0b Jul 16 23:29:40 devstack sudo[102386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:40 devstack sudo[102381]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a363e717-5adb-4646-92da-49c68a901a0e tempest-SnapshotDependencyTests-1553893050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083" returned: 0 in 0.401s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a363e717-5adb-4646-92da-49c68a901a0e tempest-SnapshotDependencyTests-1553893050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:40 devstack sudo[102392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083 Jul 16 23:29:40 devstack sudo[102392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:40 devstack sudo[102386]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0e5f0b7d-7c97-4d42-a86c-1dd733514611 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db.ae26f448-c0f8-4cc0-9bf0-3be73e3e2f0b" returned: 0 in 0.303s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:40 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-958d216d-e883-40d9-bcc4-52c3512aa341 tempest-VolumesListTestJSON-255654901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:29:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-958d216d-e883-40d9-bcc4-52c3512aa341 tempest-VolumesListTestJSON-255654901 None] Flow 'volume_create_manager' (4448097e-4a6c-4ef8-9d45-1730b5108bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:29:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-958d216d-e883-40d9-bcc4-52c3512aa341 tempest-VolumesListTestJSON-255654901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83451611-4a98-463c-b788-a5d3055e2458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-958d216d-e883-40d9-bcc4-52c3512aa341 tempest-VolumesListTestJSON-255654901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83451611-4a98-463c-b788-a5d3055e2458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-780649150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc9135f7-0afd-499d-a6e5-adb6ac07bb9c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3f4d7eb13f6042a6b3fce919204067c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:29:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:29:41Z,use_quota=True,user_id='c516775447594e309e7c0ea47424b462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-958d216d-e883-40d9-bcc4-52c3512aa341 tempest-VolumesListTestJSON-255654901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e9583a-5110-46fc-b06e-af2b73d3c67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-958d216d-e883-40d9-bcc4-52c3512aa341 tempest-VolumesListTestJSON-255654901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e9583a-5110-46fc-b06e-af2b73d3c67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-958d216d-e883-40d9-bcc4-52c3512aa341 tempest-VolumesListTestJSON-255654901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f37504d6-e423-4167-a5cf-0c5efa6cf427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-958d216d-e883-40d9-bcc4-52c3512aa341 tempest-VolumesListTestJSON-255654901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f37504d6-e423-4167-a5cf-0c5efa6cf427) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc9135f7-0afd-499d-a6e5-adb6ac07bb9c', 'volume_name': 'volume-dc9135f7-0afd-499d-a6e5-adb6ac07bb9c', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-958d216d-e883-40d9-bcc4-52c3512aa341 tempest-VolumesListTestJSON-255654901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e01da116-939f-454c-a0b6-5da098d77f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-958d216d-e883-40d9-bcc4-52c3512aa341 tempest-VolumesListTestJSON-255654901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e01da116-939f-454c-a0b6-5da098d77f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-958d216d-e883-40d9-bcc4-52c3512aa341 tempest-VolumesListTestJSON-255654901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c850a5eb-6bec-4f51-8038-68c17caca102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:40 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-958d216d-e883-40d9-bcc4-52c3512aa341 tempest-VolumesListTestJSON-255654901 None] Volume dc9135f7-0afd-499d-a6e5-adb6ac07bb9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc9135f7-0afd-499d-a6e5-adb6ac07bb9c', 'volume_size': 1} Jul 16 23:29:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-958d216d-e883-40d9-bcc4-52c3512aa341 tempest-VolumesListTestJSON-255654901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:29:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0e5f0b7d-7c97-4d42-a86c-1dd733514611 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:40 devstack sudo[102394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db.info Jul 16 23:29:40 devstack sudo[102394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:41 devstack sudo[102392]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a363e717-5adb-4646-92da-49c68a901a0e tempest-SnapshotDependencyTests-1553893050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0ad1a0be-ddb9-48ad-98b6-e69905a92083" returned: 0 in 0.305s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:41 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-a363e717-5adb-4646-92da-49c68a901a0e tempest-SnapshotDependencyTests-1553893050 None] Lock "cinder-quobyte-0ad1a0be-ddb9-48ad-98b6-e69905a92083" released by "delete_volume" :: held 0.781s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:29:41 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-a363e717-5adb-4646-92da-49c68a901a0e tempest-SnapshotDependencyTests-1553893050 None] Created reservations ['390219ee-af33-4333-bbac-1a84c7513a7d', 'b3a8f2cd-64a2-43f2-a6cf-69f76da24c2b', '64e531ed-d7b0-4d06-8fbe-99ed463a9b3a', '9733fded-53a9-462a-8c4f-2d6ac8efc7da'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:29:41 devstack sudo[102394]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0e5f0b7d-7c97-4d42-a86c-1dd733514611 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db.info" returned: 0 in 0.263s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:41 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-0e5f0b7d-7c97-4d42-a86c-1dd733514611 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db.info is being set with open permissions: ugo+rw Jul 16 23:29:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0e5f0b7d-7c97-4d42-a86c-1dd733514611 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:41 devstack sudo[102398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db.info Jul 16 23:29:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a363e717-5adb-4646-92da-49c68a901a0e tempest-SnapshotDependencyTests-1553893050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:29:41 devstack sudo[102398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a363e717-5adb-4646-92da-49c68a901a0e tempest-SnapshotDependencyTests-1553893050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:29:41 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a363e717-5adb-4646-92da-49c68a901a0e tempest-SnapshotDependencyTests-1553893050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:29:41 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a363e717-5adb-4646-92da-49c68a901a0e tempest-SnapshotDependencyTests-1553893050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:29:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a363e717-5adb-4646-92da-49c68a901a0e tempest-SnapshotDependencyTests-1553893050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:29:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a363e717-5adb-4646-92da-49c68a901a0e tempest-SnapshotDependencyTests-1553893050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:41 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:29:41 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:41 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-47465b46-6d08-44ba-9607-f39e4217daaf tempest-SnapshotDependencyTests-1553893050 None] Acquiring lock "cinder-138353c0-29d0-4df5-9e4e-2bbd6b573987-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:29:41 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-47465b46-6d08-44ba-9607-f39e4217daaf tempest-SnapshotDependencyTests-1553893050 None] Lock "cinder-138353c0-29d0-4df5-9e4e-2bbd6b573987-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:29:41 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a363e717-5adb-4646-92da-49c68a901a0e tempest-SnapshotDependencyTests-1553893050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.278s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:41 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-a363e717-5adb-4646-92da-49c68a901a0e tempest-SnapshotDependencyTests-1553893050 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:29:41 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-a363e717-5adb-4646-92da-49c68a901a0e tempest-SnapshotDependencyTests-1553893050 None] Deleted volume successfully. Jul 16 23:29:41 devstack sudo[102398]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0e5f0b7d-7c97-4d42-a86c-1dd733514611 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db.info" returned: 0 in 0.351s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0e5f0b7d-7c97-4d42-a86c-1dd733514611 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.281s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:29:41 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-a363e717-5adb-4646-92da-49c68a901a0e tempest-SnapshotDependencyTests-1553893050 None] Lock "cinder-0ad1a0be-ddb9-48ad-98b6-e69905a92083-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:29:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-958d216d-e883-40d9-bcc4-52c3512aa341 tempest-VolumesListTestJSON-255654901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.656s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:29:41 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-958d216d-e883-40d9-bcc4-52c3512aa341 tempest-VolumesListTestJSON-255654901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-780649150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc9135f7-0afd-499d-a6e5-adb6ac07bb9c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3f4d7eb13f6042a6b3fce919204067c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:29:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:29:41Z,use_quota=True,user_id='c516775447594e309e7c0ea47424b462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:29:41 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-958d216d-e883-40d9-bcc4-52c3512aa341 tempest-VolumesListTestJSON-255654901 None] Creating volume dc9135f7-0afd-499d-a6e5-adb6ac07bb9c {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:29:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-958d216d-e883-40d9-bcc4-52c3512aa341 tempest-VolumesListTestJSON-255654901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:29:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-958d216d-e883-40d9-bcc4-52c3512aa341 tempest-VolumesListTestJSON-255654901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:29:41 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-958d216d-e883-40d9-bcc4-52c3512aa341 tempest-VolumesListTestJSON-255654901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:29:41 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-958d216d-e883-40d9-bcc4-52c3512aa341 tempest-VolumesListTestJSON-255654901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:29:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-958d216d-e883-40d9-bcc4-52c3512aa341 tempest-VolumesListTestJSON-255654901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:29:41 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-958d216d-e883-40d9-bcc4-52c3512aa341 tempest-VolumesListTestJSON-255654901 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:29:41 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-958d216d-e883-40d9-bcc4-52c3512aa341 tempest-VolumesListTestJSON-255654901 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:29:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-958d216d-e883-40d9-bcc4-52c3512aa341 tempest-VolumesListTestJSON-255654901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-dc9135f7-0afd-499d-a6e5-adb6ac07bb9c 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:41 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-47465b46-6d08-44ba-9607-f39e4217daaf tempest-SnapshotDependencyTests-1553893050 None] Acquiring lock "cinder-quobyte-138353c0-29d0-4df5-9e4e-2bbd6b573987" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:29:41 devstack sudo[102404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-dc9135f7-0afd-499d-a6e5-adb6ac07bb9c 1073741824 Jul 16 23:29:41 devstack sudo[102404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:41 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-0e5f0b7d-7c97-4d42-a86c-1dd733514611 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Create snapshot completed successfully Jul 16 23:29:41 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-47465b46-6d08-44ba-9607-f39e4217daaf tempest-SnapshotDependencyTests-1553893050 None] Lock "cinder-quobyte-138353c0-29d0-4df5-9e4e-2bbd6b573987" acquired by "delete_volume" :: waited 0.031s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:29:41 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fa3b2d-ba73-43e4-b116-c29dd0168318]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:29:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-47465b46-6d08-44ba-9607-f39e4217daaf tempest-SnapshotDependencyTests-1553893050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-138353c0-29d0-4df5-9e4e-2bbd6b573987 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:41 devstack sudo[102406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-138353c0-29d0-4df5-9e4e-2bbd6b573987 Jul 16 23:29:41 devstack sudo[102406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:42 devstack sudo[102406]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-47465b46-6d08-44ba-9607-f39e4217daaf tempest-SnapshotDependencyTests-1553893050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-138353c0-29d0-4df5-9e4e-2bbd6b573987" returned: 0 in 0.437s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-47465b46-6d08-44ba-9607-f39e4217daaf tempest-SnapshotDependencyTests-1553893050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-138353c0-29d0-4df5-9e4e-2bbd6b573987 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:42 devstack sudo[102404]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-958d216d-e883-40d9-bcc4-52c3512aa341 tempest-VolumesListTestJSON-255654901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-dc9135f7-0afd-499d-a6e5-adb6ac07bb9c 1073741824" returned: 0 in 0.564s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:42 devstack sudo[102415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-138353c0-29d0-4df5-9e4e-2bbd6b573987 Jul 16 23:29:42 devstack sudo[102415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-958d216d-e883-40d9-bcc4-52c3512aa341 tempest-VolumesListTestJSON-255654901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-dc9135f7-0afd-499d-a6e5-adb6ac07bb9c {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:42 devstack sudo[102417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-dc9135f7-0afd-499d-a6e5-adb6ac07bb9c Jul 16 23:29:42 devstack sudo[102417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:42 devstack sudo[102415]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-47465b46-6d08-44ba-9607-f39e4217daaf tempest-SnapshotDependencyTests-1553893050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-138353c0-29d0-4df5-9e4e-2bbd6b573987" returned: 0 in 0.261s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:42 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-47465b46-6d08-44ba-9607-f39e4217daaf tempest-SnapshotDependencyTests-1553893050 None] Lock "cinder-quobyte-138353c0-29d0-4df5-9e4e-2bbd6b573987" released by "delete_volume" :: held 0.770s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:29:42 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-47465b46-6d08-44ba-9607-f39e4217daaf tempest-SnapshotDependencyTests-1553893050 None] Created reservations ['f785ce22-9669-4932-95aa-4d0e4108297a', '56d4822a-b4ba-48d8-8b95-f8521df71fb7', '98d8cb95-bbc1-407d-be56-566814cca1f3', '7590ccd6-e860-4a2e-a415-c9df67391cfc'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:29:42 devstack sudo[102417]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-958d216d-e883-40d9-bcc4-52c3512aa341 tempest-VolumesListTestJSON-255654901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-dc9135f7-0afd-499d-a6e5-adb6ac07bb9c" returned: 0 in 0.331s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:42 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-958d216d-e883-40d9-bcc4-52c3512aa341 tempest-VolumesListTestJSON-255654901 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:29:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-958d216d-e883-40d9-bcc4-52c3512aa341 tempest-VolumesListTestJSON-255654901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:29:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-958d216d-e883-40d9-bcc4-52c3512aa341 tempest-VolumesListTestJSON-255654901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c850a5eb-6bec-4f51-8038-68c17caca102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc9135f7-0afd-499d-a6e5-adb6ac07bb9c', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-958d216d-e883-40d9-bcc4-52c3512aa341 tempest-VolumesListTestJSON-255654901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (618fe971-6fb0-4b16-8233-35abddceda7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:29:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-47465b46-6d08-44ba-9607-f39e4217daaf tempest-SnapshotDependencyTests-1553893050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:29:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-47465b46-6d08-44ba-9607-f39e4217daaf tempest-SnapshotDependencyTests-1553893050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:29:42 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-47465b46-6d08-44ba-9607-f39e4217daaf tempest-SnapshotDependencyTests-1553893050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:29:42 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-47465b46-6d08-44ba-9607-f39e4217daaf tempest-SnapshotDependencyTests-1553893050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:29:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-47465b46-6d08-44ba-9607-f39e4217daaf tempest-SnapshotDependencyTests-1553893050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:29:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-47465b46-6d08-44ba-9607-f39e4217daaf tempest-SnapshotDependencyTests-1553893050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:42 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-958d216d-e883-40d9-bcc4-52c3512aa341 tempest-VolumesListTestJSON-255654901 None] Volume volume-dc9135f7-0afd-499d-a6e5-adb6ac07bb9c (dc9135f7-0afd-499d-a6e5-adb6ac07bb9c): created successfully Jul 16 23:29:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-958d216d-e883-40d9-bcc4-52c3512aa341 tempest-VolumesListTestJSON-255654901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (618fe971-6fb0-4b16-8233-35abddceda7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:29:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-958d216d-e883-40d9-bcc4-52c3512aa341 tempest-VolumesListTestJSON-255654901 None] Flow 'volume_create_manager' (4448097e-4a6c-4ef8-9d45-1730b5108bfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:29:42 devstack sudo[102421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:29:42 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-958d216d-e883-40d9-bcc4-52c3512aa341 tempest-VolumesListTestJSON-255654901 None] Created volume successfully. Jul 16 23:29:42 devstack sudo[102421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:43 devstack sudo[102421]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-47465b46-6d08-44ba-9607-f39e4217daaf tempest-SnapshotDependencyTests-1553893050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.422s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:43 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-47465b46-6d08-44ba-9607-f39e4217daaf tempest-SnapshotDependencyTests-1553893050 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:29:43 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-47465b46-6d08-44ba-9607-f39e4217daaf tempest-SnapshotDependencyTests-1553893050 None] Deleted volume successfully. Jul 16 23:29:43 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-47465b46-6d08-44ba-9607-f39e4217daaf tempest-SnapshotDependencyTests-1553893050 None] Lock "cinder-138353c0-29d0-4df5-9e4e-2bbd6b573987-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:29:43 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d83d260e-ac4f-4f35-916e-34070cc041ee tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Acquiring lock "cinder-ae26f448-c0f8-4cc0-9bf0-3be73e3e2f0b-delete_snapshot" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:29:43 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d83d260e-ac4f-4f35-916e-34070cc041ee tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Lock "cinder-ae26f448-c0f8-4cc0-9bf0-3be73e3e2f0b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:29:43 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d83d260e-ac4f-4f35-916e-34070cc041ee tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Acquiring lock "cinder-quobyte-f4ac9824-96a3-4b49-88eb-5fc2556675db" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:29:43 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d83d260e-ac4f-4f35-916e-34070cc041ee tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Lock "cinder-quobyte-f4ac9824-96a3-4b49-88eb-5fc2556675db" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:29:43 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d83d260e-ac4f-4f35-916e-34070cc041ee tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Acquiring lock "cinder-quobyte-ae26f448-c0f8-4cc0-9bf0-3be73e3e2f0b" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:29:43 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d83d260e-ac4f-4f35-916e-34070cc041ee tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Lock "cinder-quobyte-ae26f448-c0f8-4cc0-9bf0-3be73e3e2f0b" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:29:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-d83d260e-ac4f-4f35-916e-34070cc041ee tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Deleting offline snapshot ae26f448-c0f8-4cc0-9bf0-3be73e3e2f0b of volume f4ac9824-96a3-4b49-88eb-5fc2556675db {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:29:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-d83d260e-ac4f-4f35-916e-34070cc041ee tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] snapshot_file for this snap is: volume-f4ac9824-96a3-4b49-88eb-5fc2556675db.ae26f448-c0f8-4cc0-9bf0-3be73e3e2f0b {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:29:43 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a3a709-4193-49ae-8017-f6edb89bf6e0]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:29:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d83d260e-ac4f-4f35-916e-34070cc041ee tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db.ae26f448-c0f8-4cc0-9bf0-3be73e3e2f0b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:43 devstack sudo[102424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db.ae26f448-c0f8-4cc0-9bf0-3be73e3e2f0b Jul 16 23:29:43 devstack sudo[102424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:43 devstack sudo[102424]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d83d260e-ac4f-4f35-916e-34070cc041ee tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db.ae26f448-c0f8-4cc0-9bf0-3be73e3e2f0b" returned: 0 in 0.469s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-d83d260e-ac4f-4f35-916e-34070cc041ee tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4ac9824-96a3-4b49-88eb-5fc2556675db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:29:43 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[269ed795-ab5b-43b8-a47e-a43186b209de]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:29:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d83d260e-ac4f-4f35-916e-34070cc041ee tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:43 devstack sudo[102439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db Jul 16 23:29:43 devstack sudo[102439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:44 devstack sudo[102439]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d83d260e-ac4f-4f35-916e-34070cc041ee tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db" returned: 0 in 0.525s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d83d260e-ac4f-4f35-916e-34070cc041ee tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db.ae26f448-c0f8-4cc0-9bf0-3be73e3e2f0b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:44 devstack sudo[102445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db.ae26f448-c0f8-4cc0-9bf0-3be73e3e2f0b Jul 16 23:29:44 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:44 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d83d260e-ac4f-4f35-916e-34070cc041ee tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db.ae26f448-c0f8-4cc0-9bf0-3be73e3e2f0b" returned: 0 in 0.378s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d83d260e-ac4f-4f35-916e-34070cc041ee tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db.ae26f448-c0f8-4cc0-9bf0-3be73e3e2f0b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:44 devstack sudo[102451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db.ae26f448-c0f8-4cc0-9bf0-3be73e3e2f0b Jul 16 23:29:44 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:44 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d83d260e-ac4f-4f35-916e-34070cc041ee tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db.ae26f448-c0f8-4cc0-9bf0-3be73e3e2f0b" returned: 0 in 0.292s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:45 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d83d260e-ac4f-4f35-916e-34070cc041ee tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Lock "cinder-quobyte-ae26f448-c0f8-4cc0-9bf0-3be73e3e2f0b" released by "_delete_snapshot" :: held 1.852s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:29:45 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d83d260e-ac4f-4f35-916e-34070cc041ee tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Lock "cinder-quobyte-f4ac9824-96a3-4b49-88eb-5fc2556675db" released by "delete_snapshot" :: held 1.887s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:29:45 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-d83d260e-ac4f-4f35-916e-34070cc041ee tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Created reservations ['b334c65f-32b3-4d4a-9ac9-e45cb8729234', '6ef5a1dd-9113-422d-b951-6d487b330835', '761046e3-acb5-4b5f-868a-38af6e1e13a6', 'a681dc57-dd39-48a2-9ede-0c9f1f06e669'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:29:45 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-d83d260e-ac4f-4f35-916e-34070cc041ee tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Delete snapshot completed successfully. Jul 16 23:29:45 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d83d260e-ac4f-4f35-916e-34070cc041ee tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Lock "cinder-ae26f448-c0f8-4cc0-9bf0-3be73e3e2f0b-delete_snapshot" released by "delete_snapshot" :: held 2.087s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:29:45 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-24e9a764-03c6-4a35-a8a3-38262a8ce4c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Acquiring lock "cinder-f4ac9824-96a3-4b49-88eb-5fc2556675db-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:29:45 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f2e4c46d-66bd-475d-8673-d109b68ff613 tempest-VolumesListTestJSON-255654901 None] Acquiring lock "cinder-dc9135f7-0afd-499d-a6e5-adb6ac07bb9c-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:29:45 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-24e9a764-03c6-4a35-a8a3-38262a8ce4c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Lock "cinder-f4ac9824-96a3-4b49-88eb-5fc2556675db-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:29:45 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f2e4c46d-66bd-475d-8673-d109b68ff613 tempest-VolumesListTestJSON-255654901 None] Lock "cinder-dc9135f7-0afd-499d-a6e5-adb6ac07bb9c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:29:45 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-24e9a764-03c6-4a35-a8a3-38262a8ce4c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Acquiring lock "cinder-quobyte-f4ac9824-96a3-4b49-88eb-5fc2556675db" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:29:45 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f2e4c46d-66bd-475d-8673-d109b68ff613 tempest-VolumesListTestJSON-255654901 None] Acquiring lock "cinder-quobyte-dc9135f7-0afd-499d-a6e5-adb6ac07bb9c" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:29:45 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-24e9a764-03c6-4a35-a8a3-38262a8ce4c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Lock "cinder-quobyte-f4ac9824-96a3-4b49-88eb-5fc2556675db" acquired by "delete_volume" :: waited 0.029s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:29:45 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f98058-737c-4575-a67d-d94a703519fb]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:29:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-24e9a764-03c6-4a35-a8a3-38262a8ce4c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:45 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f2e4c46d-66bd-475d-8673-d109b68ff613 tempest-VolumesListTestJSON-255654901 None] Lock "cinder-quobyte-dc9135f7-0afd-499d-a6e5-adb6ac07bb9c" acquired by "delete_volume" :: waited 0.092s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:29:45 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f66b74f-04a5-4a55-ab24-1fec33539005]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:29:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f2e4c46d-66bd-475d-8673-d109b68ff613 tempest-VolumesListTestJSON-255654901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-dc9135f7-0afd-499d-a6e5-adb6ac07bb9c {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:45 devstack sudo[102460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db Jul 16 23:29:45 devstack sudo[102460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:45 devstack sudo[102461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-dc9135f7-0afd-499d-a6e5-adb6ac07bb9c Jul 16 23:29:45 devstack sudo[102461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:46 devstack sudo[102460]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-24e9a764-03c6-4a35-a8a3-38262a8ce4c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db" returned: 0 in 0.593s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-24e9a764-03c6-4a35-a8a3-38262a8ce4c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:46 devstack sudo[102471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db Jul 16 23:29:46 devstack sudo[102471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:46 devstack sudo[102461]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f2e4c46d-66bd-475d-8673-d109b68ff613 tempest-VolumesListTestJSON-255654901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-dc9135f7-0afd-499d-a6e5-adb6ac07bb9c" returned: 0 in 0.656s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f2e4c46d-66bd-475d-8673-d109b68ff613 tempest-VolumesListTestJSON-255654901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-dc9135f7-0afd-499d-a6e5-adb6ac07bb9c {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:46 devstack sudo[102478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-dc9135f7-0afd-499d-a6e5-adb6ac07bb9c Jul 16 23:29:46 devstack sudo[102478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:46 devstack sudo[102471]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-24e9a764-03c6-4a35-a8a3-38262a8ce4c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f4ac9824-96a3-4b49-88eb-5fc2556675db" returned: 0 in 0.434s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:46 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-24e9a764-03c6-4a35-a8a3-38262a8ce4c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Lock "cinder-quobyte-f4ac9824-96a3-4b49-88eb-5fc2556675db" released by "delete_volume" :: held 1.139s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:29:46 devstack sudo[102478]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f2e4c46d-66bd-475d-8673-d109b68ff613 tempest-VolumesListTestJSON-255654901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-dc9135f7-0afd-499d-a6e5-adb6ac07bb9c" returned: 0 in 0.421s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:46 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f2e4c46d-66bd-475d-8673-d109b68ff613 tempest-VolumesListTestJSON-255654901 None] Lock "cinder-quobyte-dc9135f7-0afd-499d-a6e5-adb6ac07bb9c" released by "delete_volume" :: held 1.139s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:29:46 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-24e9a764-03c6-4a35-a8a3-38262a8ce4c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Created reservations ['14315a7e-bcec-4722-af39-53f1328ce115', '85f8651e-eeed-44f9-8fb9-ca684820b211', '761d4da1-9b05-471f-9cb7-bf15254c2594', 'ee0675f0-e3a7-4ec7-90a1-192a3eaea2b7'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:29:46 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-f2e4c46d-66bd-475d-8673-d109b68ff613 tempest-VolumesListTestJSON-255654901 None] Created reservations ['78b47941-f111-4328-b3f3-126e53ce635b', '9dfb3d43-993b-4e73-b1e2-85bf9ea023b7', 'dbfa0c38-55bd-4cc1-aed2-d35b2b7e0790', '50dd9c33-a3aa-4a36-88a3-3ada05131a15'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:29:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-24e9a764-03c6-4a35-a8a3-38262a8ce4c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:29:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-24e9a764-03c6-4a35-a8a3-38262a8ce4c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:29:46 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-24e9a764-03c6-4a35-a8a3-38262a8ce4c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:29:46 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-24e9a764-03c6-4a35-a8a3-38262a8ce4c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:29:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-24e9a764-03c6-4a35-a8a3-38262a8ce4c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:29:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-24e9a764-03c6-4a35-a8a3-38262a8ce4c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:47 devstack sudo[102482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:29:47 devstack sudo[102482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f2e4c46d-66bd-475d-8673-d109b68ff613 tempest-VolumesListTestJSON-255654901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:29:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f2e4c46d-66bd-475d-8673-d109b68ff613 tempest-VolumesListTestJSON-255654901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:29:47 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f2e4c46d-66bd-475d-8673-d109b68ff613 tempest-VolumesListTestJSON-255654901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:29:47 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f2e4c46d-66bd-475d-8673-d109b68ff613 tempest-VolumesListTestJSON-255654901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:29:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f2e4c46d-66bd-475d-8673-d109b68ff613 tempest-VolumesListTestJSON-255654901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:29:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f2e4c46d-66bd-475d-8673-d109b68ff613 tempest-VolumesListTestJSON-255654901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:47 devstack sudo[102484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:29:47 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:47 devstack sudo[102482]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-24e9a764-03c6-4a35-a8a3-38262a8ce4c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.281s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:47 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-24e9a764-03c6-4a35-a8a3-38262a8ce4c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:29:47 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-24e9a764-03c6-4a35-a8a3-38262a8ce4c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Deleted volume successfully. Jul 16 23:29:47 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-24e9a764-03c6-4a35-a8a3-38262a8ce4c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-565354391 None] Lock "cinder-f4ac9824-96a3-4b49-88eb-5fc2556675db-delete_volume" released by "delete_volume" :: held 1.854s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:29:47 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f2e4c46d-66bd-475d-8673-d109b68ff613 tempest-VolumesListTestJSON-255654901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.310s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:47 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-f2e4c46d-66bd-475d-8673-d109b68ff613 tempest-VolumesListTestJSON-255654901 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:29:47 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-f2e4c46d-66bd-475d-8673-d109b68ff613 tempest-VolumesListTestJSON-255654901 None] Deleted volume successfully. Jul 16 23:29:47 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f2e4c46d-66bd-475d-8673-d109b68ff613 tempest-VolumesListTestJSON-255654901 None] Lock "cinder-dc9135f7-0afd-499d-a6e5-adb6ac07bb9c-delete_volume" released by "delete_volume" :: held 1.917s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:29:47 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0fd4e4f7-f71d-471a-9a70-211579e9f067 tempest-VolumesListTestJSON-255654901 None] Acquiring lock "cinder-4d6422d2-8652-457e-8fff-ba446b2025dc-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:29:48 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0fd4e4f7-f71d-471a-9a70-211579e9f067 tempest-VolumesListTestJSON-255654901 None] Lock "cinder-4d6422d2-8652-457e-8fff-ba446b2025dc-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:29:48 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0fd4e4f7-f71d-471a-9a70-211579e9f067 tempest-VolumesListTestJSON-255654901 None] Acquiring lock "cinder-quobyte-4d6422d2-8652-457e-8fff-ba446b2025dc" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:29:48 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0fd4e4f7-f71d-471a-9a70-211579e9f067 tempest-VolumesListTestJSON-255654901 None] Lock "cinder-quobyte-4d6422d2-8652-457e-8fff-ba446b2025dc" acquired by "delete_volume" :: waited 0.044s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:29:48 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f83f19e-ae98-44f4-97b8-fc59d2246495]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:29:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0fd4e4f7-f71d-471a-9a70-211579e9f067 tempest-VolumesListTestJSON-255654901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4d6422d2-8652-457e-8fff-ba446b2025dc {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:48 devstack sudo[102504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4d6422d2-8652-457e-8fff-ba446b2025dc Jul 16 23:29:48 devstack sudo[102504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:48 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-42821d64-b7a2-43b8-9d62-5c9ddd5071fd req-1927bd4f-b786-43c9-bcc5-cde7fe907e7c tempest-TestShelveInstance-125276292 None] Terminate volume connection completed successfully. Jul 16 23:29:48 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-42821d64-b7a2-43b8-9d62-5c9ddd5071fd req-1927bd4f-b786-43c9-bcc5-cde7fe907e7c tempest-TestShelveInstance-125276292 None] Deleting attachment 8a641d46-e11c-4d6e-a21b-5cb43603e952. {{(pid=87607) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 23:29:48 devstack sudo[102504]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0fd4e4f7-f71d-471a-9a70-211579e9f067 tempest-VolumesListTestJSON-255654901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4d6422d2-8652-457e-8fff-ba446b2025dc" returned: 0 in 0.466s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0fd4e4f7-f71d-471a-9a70-211579e9f067 tempest-VolumesListTestJSON-255654901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4d6422d2-8652-457e-8fff-ba446b2025dc {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:48 devstack sudo[102514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4d6422d2-8652-457e-8fff-ba446b2025dc Jul 16 23:29:48 devstack sudo[102514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:49 devstack sudo[102514]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0fd4e4f7-f71d-471a-9a70-211579e9f067 tempest-VolumesListTestJSON-255654901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4d6422d2-8652-457e-8fff-ba446b2025dc" returned: 0 in 0.352s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:49 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0fd4e4f7-f71d-471a-9a70-211579e9f067 tempest-VolumesListTestJSON-255654901 None] Lock "cinder-quobyte-4d6422d2-8652-457e-8fff-ba446b2025dc" released by "delete_volume" :: held 0.895s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:29:49 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-0fd4e4f7-f71d-471a-9a70-211579e9f067 tempest-VolumesListTestJSON-255654901 None] Created reservations ['1f530e5d-08c3-44f3-b5a5-198c8ff22788', '4fff75c9-313b-411d-ad5b-8b99e4b7fe0b', '27ec6ea2-8529-47f3-bd8d-ce5e2c890874', '3ff4e532-91f9-4a06-ab10-083c70a26eb2'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:29:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0fd4e4f7-f71d-471a-9a70-211579e9f067 tempest-VolumesListTestJSON-255654901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:29:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0fd4e4f7-f71d-471a-9a70-211579e9f067 tempest-VolumesListTestJSON-255654901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:29:49 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0fd4e4f7-f71d-471a-9a70-211579e9f067 tempest-VolumesListTestJSON-255654901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:29:49 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0fd4e4f7-f71d-471a-9a70-211579e9f067 tempest-VolumesListTestJSON-255654901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:29:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0fd4e4f7-f71d-471a-9a70-211579e9f067 tempest-VolumesListTestJSON-255654901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:29:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0fd4e4f7-f71d-471a-9a70-211579e9f067 tempest-VolumesListTestJSON-255654901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:49 devstack sudo[102518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:29:49 devstack sudo[102518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:49 devstack sudo[102518]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0fd4e4f7-f71d-471a-9a70-211579e9f067 tempest-VolumesListTestJSON-255654901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.282s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:49 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-0fd4e4f7-f71d-471a-9a70-211579e9f067 tempest-VolumesListTestJSON-255654901 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:29:49 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-0fd4e4f7-f71d-471a-9a70-211579e9f067 tempest-VolumesListTestJSON-255654901 None] Deleted volume successfully. Jul 16 23:29:49 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0fd4e4f7-f71d-471a-9a70-211579e9f067 tempest-VolumesListTestJSON-255654901 None] Lock "cinder-4d6422d2-8652-457e-8fff-ba446b2025dc-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:29:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0d7914b3-1fe6-4cfd-9f0c-98566d52fde9 tempest-VolumesListTestJSON-255654901 None] Acquiring lock "cinder-dbd884a2-f8ec-4b57-8940-4249fb74358d-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:29:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0d7914b3-1fe6-4cfd-9f0c-98566d52fde9 tempest-VolumesListTestJSON-255654901 None] Lock "cinder-dbd884a2-f8ec-4b57-8940-4249fb74358d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:29:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0d7914b3-1fe6-4cfd-9f0c-98566d52fde9 tempest-VolumesListTestJSON-255654901 None] Acquiring lock "cinder-quobyte-dbd884a2-f8ec-4b57-8940-4249fb74358d" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:29:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0d7914b3-1fe6-4cfd-9f0c-98566d52fde9 tempest-VolumesListTestJSON-255654901 None] Lock "cinder-quobyte-dbd884a2-f8ec-4b57-8940-4249fb74358d" acquired by "delete_volume" :: waited 0.038s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:29:50 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29116da-afe9-415b-9615-51aa57ebc7c4]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:29:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0d7914b3-1fe6-4cfd-9f0c-98566d52fde9 tempest-VolumesListTestJSON-255654901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-dbd884a2-f8ec-4b57-8940-4249fb74358d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:50 devstack sudo[102528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-dbd884a2-f8ec-4b57-8940-4249fb74358d Jul 16 23:29:50 devstack sudo[102528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:51 devstack sudo[102528]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0d7914b3-1fe6-4cfd-9f0c-98566d52fde9 tempest-VolumesListTestJSON-255654901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-dbd884a2-f8ec-4b57-8940-4249fb74358d" returned: 0 in 0.462s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0d7914b3-1fe6-4cfd-9f0c-98566d52fde9 tempest-VolumesListTestJSON-255654901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-dbd884a2-f8ec-4b57-8940-4249fb74358d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:51 devstack sudo[102534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-dbd884a2-f8ec-4b57-8940-4249fb74358d Jul 16 23:29:51 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:51 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0d7914b3-1fe6-4cfd-9f0c-98566d52fde9 tempest-VolumesListTestJSON-255654901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-dbd884a2-f8ec-4b57-8940-4249fb74358d" returned: 0 in 0.292s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:51 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0d7914b3-1fe6-4cfd-9f0c-98566d52fde9 tempest-VolumesListTestJSON-255654901 None] Lock "cinder-quobyte-dbd884a2-f8ec-4b57-8940-4249fb74358d" released by "delete_volume" :: held 0.804s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:29:51 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-0d7914b3-1fe6-4cfd-9f0c-98566d52fde9 tempest-VolumesListTestJSON-255654901 None] Created reservations ['80adcffe-0d32-49ed-95fa-7cec32786a5e', 'c06b961c-4d75-479b-b22a-65a360620723', 'ca780886-6e4f-4b57-952a-4c530e4a894e', '5301aed2-c52e-4748-8143-e9c06f75cd37'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:29:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0d7914b3-1fe6-4cfd-9f0c-98566d52fde9 tempest-VolumesListTestJSON-255654901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:29:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0d7914b3-1fe6-4cfd-9f0c-98566d52fde9 tempest-VolumesListTestJSON-255654901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:29:51 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0d7914b3-1fe6-4cfd-9f0c-98566d52fde9 tempest-VolumesListTestJSON-255654901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:29:51 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0d7914b3-1fe6-4cfd-9f0c-98566d52fde9 tempest-VolumesListTestJSON-255654901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:29:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0d7914b3-1fe6-4cfd-9f0c-98566d52fde9 tempest-VolumesListTestJSON-255654901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:29:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0d7914b3-1fe6-4cfd-9f0c-98566d52fde9 tempest-VolumesListTestJSON-255654901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:29:51 devstack sudo[102539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:29:51 devstack sudo[102539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:29:51 devstack sudo[102539]: pam_unix(sudo:session): session closed for user root Jul 16 23:29:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0d7914b3-1fe6-4cfd-9f0c-98566d52fde9 tempest-VolumesListTestJSON-255654901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.389s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:29:51 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-0d7914b3-1fe6-4cfd-9f0c-98566d52fde9 tempest-VolumesListTestJSON-255654901 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:29:51 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-0d7914b3-1fe6-4cfd-9f0c-98566d52fde9 tempest-VolumesListTestJSON-255654901 None] Deleted volume successfully. Jul 16 23:29:51 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0d7914b3-1fe6-4cfd-9f0c-98566d52fde9 tempest-VolumesListTestJSON-255654901 None] Lock "cinder-dbd884a2-f8ec-4b57-8940-4249fb74358d-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:29:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-e3c93446-0fc6-4219-9cf1-d6d07fdc7b5c req-84bd5dfe-c625-40ec-b9eb-a9ba9e5738ed tempest-TestShelveInstance-125276292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:29:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-e3c93446-0fc6-4219-9cf1-d6d07fdc7b5c req-84bd5dfe-c625-40ec-b9eb-a9ba9e5738ed tempest-TestShelveInstance-125276292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:29:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-e3c93446-0fc6-4219-9cf1-d6d07fdc7b5c req-84bd5dfe-c625-40ec-b9eb-a9ba9e5738ed tempest-TestShelveInstance-125276292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:29:53 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-e3c93446-0fc6-4219-9cf1-d6d07fdc7b5c req-84bd5dfe-c625-40ec-b9eb-a9ba9e5738ed tempest-TestShelveInstance-125276292 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72', 'name': 'volume-173ebabb-fafd-45ec-b706-db6173da5b83', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '91d10f72-8a51-4344-97fe-2ab96ae1af6e', 'enforce_multipath': True} {{(pid=87607) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 23:29:53 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-e3c93446-0fc6-4219-9cf1-d6d07fdc7b5c req-84bd5dfe-c625-40ec-b9eb-a9ba9e5738ed tempest-TestShelveInstance-125276292 None] attachment_update completed successfully. Jul 16 23:30:02 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-60740db9-c5b9-455c-85f6-b634b738546a tempest-SnapshotMetadataTestJSON-946036074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:30:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-60740db9-c5b9-455c-85f6-b634b738546a tempest-SnapshotMetadataTestJSON-946036074 None] Flow 'volume_create_manager' (9494aa21-8e4b-49c5-9fb7-9ca85566c27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:30:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-60740db9-c5b9-455c-85f6-b634b738546a tempest-SnapshotMetadataTestJSON-946036074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96cb0daf-ec77-46de-b5f4-17750dac1df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-60740db9-c5b9-455c-85f6-b634b738546a tempest-SnapshotMetadataTestJSON-946036074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96cb0daf-ec77-46de-b5f4-17750dac1df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:30:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-553851490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb53baf6-a079-4ad2-9a4f-53af3d0dacb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49c0c01de4bc4a4098a75d6f1321c78c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:30:03Z,use_quota=True,user_id='f4fc17d10e32463ab6afe95a830836d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-60740db9-c5b9-455c-85f6-b634b738546a tempest-SnapshotMetadataTestJSON-946036074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32c889fc-422f-4793-bb80-7504cb1af89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-60740db9-c5b9-455c-85f6-b634b738546a tempest-SnapshotMetadataTestJSON-946036074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32c889fc-422f-4793-bb80-7504cb1af89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-60740db9-c5b9-455c-85f6-b634b738546a tempest-SnapshotMetadataTestJSON-946036074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bdd5be2-298a-4b14-b7cc-90ee8274f16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-60740db9-c5b9-455c-85f6-b634b738546a tempest-SnapshotMetadataTestJSON-946036074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bdd5be2-298a-4b14-b7cc-90ee8274f16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb53baf6-a079-4ad2-9a4f-53af3d0dacb9', 'volume_name': 'volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-60740db9-c5b9-455c-85f6-b634b738546a tempest-SnapshotMetadataTestJSON-946036074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79ffa92d-0f3d-40d2-825b-554f110170a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-60740db9-c5b9-455c-85f6-b634b738546a tempest-SnapshotMetadataTestJSON-946036074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79ffa92d-0f3d-40d2-825b-554f110170a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-60740db9-c5b9-455c-85f6-b634b738546a tempest-SnapshotMetadataTestJSON-946036074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b7c22da-7666-40d6-a664-487f8ebd40af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:02 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-60740db9-c5b9-455c-85f6-b634b738546a tempest-SnapshotMetadataTestJSON-946036074 None] Volume bb53baf6-a079-4ad2-9a4f-53af3d0dacb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9', 'volume_size': 1} Jul 16 23:30:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-60740db9-c5b9-455c-85f6-b634b738546a tempest-SnapshotMetadataTestJSON-946036074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:30:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-60740db9-c5b9-455c-85f6-b634b738546a tempest-SnapshotMetadataTestJSON-946036074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:30:02 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-60740db9-c5b9-455c-85f6-b634b738546a tempest-SnapshotMetadataTestJSON-946036074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:30:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-553851490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb53baf6-a079-4ad2-9a4f-53af3d0dacb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49c0c01de4bc4a4098a75d6f1321c78c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:30:03Z,use_quota=True,user_id='f4fc17d10e32463ab6afe95a830836d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:30:02 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-60740db9-c5b9-455c-85f6-b634b738546a tempest-SnapshotMetadataTestJSON-946036074 None] Creating volume bb53baf6-a079-4ad2-9a4f-53af3d0dacb9 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:30:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-60740db9-c5b9-455c-85f6-b634b738546a tempest-SnapshotMetadataTestJSON-946036074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:30:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-60740db9-c5b9-455c-85f6-b634b738546a tempest-SnapshotMetadataTestJSON-946036074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:30:02 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-60740db9-c5b9-455c-85f6-b634b738546a tempest-SnapshotMetadataTestJSON-946036074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:30:02 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-60740db9-c5b9-455c-85f6-b634b738546a tempest-SnapshotMetadataTestJSON-946036074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:30:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-60740db9-c5b9-455c-85f6-b634b738546a tempest-SnapshotMetadataTestJSON-946036074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:30:02 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-60740db9-c5b9-455c-85f6-b634b738546a tempest-SnapshotMetadataTestJSON-946036074 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:30:02 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-60740db9-c5b9-455c-85f6-b634b738546a tempest-SnapshotMetadataTestJSON-946036074 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:30:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-60740db9-c5b9-455c-85f6-b634b738546a tempest-SnapshotMetadataTestJSON-946036074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:03 devstack sudo[103005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9 1073741824 Jul 16 23:30:03 devstack sudo[103005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:03 devstack sudo[103005]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-60740db9-c5b9-455c-85f6-b634b738546a tempest-SnapshotMetadataTestJSON-946036074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9 1073741824" returned: 0 in 0.536s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-60740db9-c5b9-455c-85f6-b634b738546a tempest-SnapshotMetadataTestJSON-946036074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:03 devstack sudo[103011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9 Jul 16 23:30:03 devstack sudo[103011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:03 devstack sudo[103011]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-60740db9-c5b9-455c-85f6-b634b738546a tempest-SnapshotMetadataTestJSON-946036074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9" returned: 0 in 0.396s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:03 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-60740db9-c5b9-455c-85f6-b634b738546a tempest-SnapshotMetadataTestJSON-946036074 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:30:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-60740db9-c5b9-455c-85f6-b634b738546a tempest-SnapshotMetadataTestJSON-946036074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:30:04 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-60740db9-c5b9-455c-85f6-b634b738546a tempest-SnapshotMetadataTestJSON-946036074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b7c22da-7666-40d6-a664-487f8ebd40af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:04 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-60740db9-c5b9-455c-85f6-b634b738546a tempest-SnapshotMetadataTestJSON-946036074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6fa55ab-7035-4271-8f67-9f5869b9751e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:04 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-60740db9-c5b9-455c-85f6-b634b738546a tempest-SnapshotMetadataTestJSON-946036074 None] Volume volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9 (bb53baf6-a079-4ad2-9a4f-53af3d0dacb9): created successfully Jul 16 23:30:04 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-60740db9-c5b9-455c-85f6-b634b738546a tempest-SnapshotMetadataTestJSON-946036074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6fa55ab-7035-4271-8f67-9f5869b9751e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:04 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-60740db9-c5b9-455c-85f6-b634b738546a tempest-SnapshotMetadataTestJSON-946036074 None] Flow 'volume_create_manager' (9494aa21-8e4b-49c5-9fb7-9ca85566c27b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:30:04 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-60740db9-c5b9-455c-85f6-b634b738546a tempest-SnapshotMetadataTestJSON-946036074 None] Created volume successfully. Jul 16 23:30:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-da9986a4-92b6-4f23-8f54-72dbbae44db9 tempest-SnapshotMetadataTestJSON-946036074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:30:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-da9986a4-92b6-4f23-8f54-72dbbae44db9 tempest-SnapshotMetadataTestJSON-946036074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:30:05 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-da9986a4-92b6-4f23-8f54-72dbbae44db9 tempest-SnapshotMetadataTestJSON-946036074 None] Creating offline snapshot 337a8011-61e9-426e-9dec-a58a77e45b24 of volume bb53baf6-a079-4ad2-9a4f-53af3d0dacb9 {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:30:05 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a5ec5d-191c-4679-88bf-c539b4bb2d67]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:30:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-da9986a4-92b6-4f23-8f54-72dbbae44db9 tempest-SnapshotMetadataTestJSON-946036074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:05 devstack sudo[103014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9 Jul 16 23:30:05 devstack sudo[103014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:05 devstack sudo[103014]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-da9986a4-92b6-4f23-8f54-72dbbae44db9 tempest-SnapshotMetadataTestJSON-946036074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9" returned: 0 in 0.513s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-da9986a4-92b6-4f23-8f54-72dbbae44db9 tempest-SnapshotMetadataTestJSON-946036074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9.337a8011-61e9-426e-9dec-a58a77e45b24 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:05 devstack sudo[103019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9.337a8011-61e9-426e-9dec-a58a77e45b24 1G Jul 16 23:30:05 devstack sudo[103019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:06 devstack sudo[103019]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-da9986a4-92b6-4f23-8f54-72dbbae44db9 tempest-SnapshotMetadataTestJSON-946036074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9.337a8011-61e9-426e-9dec-a58a77e45b24 1G" returned: 0 in 0.522s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-da9986a4-92b6-4f23-8f54-72dbbae44db9 tempest-SnapshotMetadataTestJSON-946036074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9.337a8011-61e9-426e-9dec-a58a77e45b24 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:06 devstack sudo[103025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9.337a8011-61e9-426e-9dec-a58a77e45b24 Jul 16 23:30:06 devstack sudo[103025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:06 devstack sudo[103025]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-da9986a4-92b6-4f23-8f54-72dbbae44db9 tempest-SnapshotMetadataTestJSON-946036074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9.337a8011-61e9-426e-9dec-a58a77e45b24" returned: 0 in 0.319s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:06 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-da9986a4-92b6-4f23-8f54-72dbbae44db9 tempest-SnapshotMetadataTestJSON-946036074 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9.337a8011-61e9-426e-9dec-a58a77e45b24 is being set with open permissions: ugo+rw Jul 16 23:30:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-da9986a4-92b6-4f23-8f54-72dbbae44db9 tempest-SnapshotMetadataTestJSON-946036074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9.337a8011-61e9-426e-9dec-a58a77e45b24 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:06 devstack sudo[103030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9.337a8011-61e9-426e-9dec-a58a77e45b24 Jul 16 23:30:06 devstack sudo[103030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:06 devstack sudo[103030]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-da9986a4-92b6-4f23-8f54-72dbbae44db9 tempest-SnapshotMetadataTestJSON-946036074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9.337a8011-61e9-426e-9dec-a58a77e45b24" returned: 0 in 0.427s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-da9986a4-92b6-4f23-8f54-72dbbae44db9 tempest-SnapshotMetadataTestJSON-946036074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:07 devstack sudo[103033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9.info Jul 16 23:30:07 devstack sudo[103033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:07 devstack sudo[103033]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-da9986a4-92b6-4f23-8f54-72dbbae44db9 tempest-SnapshotMetadataTestJSON-946036074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9.info" returned: 0 in 0.393s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:07 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-da9986a4-92b6-4f23-8f54-72dbbae44db9 tempest-SnapshotMetadataTestJSON-946036074 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9.info is being set with open permissions: ugo+rw Jul 16 23:30:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-da9986a4-92b6-4f23-8f54-72dbbae44db9 tempest-SnapshotMetadataTestJSON-946036074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:07 devstack sudo[103036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9.info Jul 16 23:30:07 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:07 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-da9986a4-92b6-4f23-8f54-72dbbae44db9 tempest-SnapshotMetadataTestJSON-946036074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9.info" returned: 0 in 0.302s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-da9986a4-92b6-4f23-8f54-72dbbae44db9 tempest-SnapshotMetadataTestJSON-946036074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.604s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:30:07 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-da9986a4-92b6-4f23-8f54-72dbbae44db9 tempest-SnapshotMetadataTestJSON-946036074 None] Create snapshot completed successfully Jul 16 23:30:09 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-83155be8-7f76-4a15-9c6c-c516e8d35c21 tempest-SnapshotMetadataTestJSON-946036074 None] Acquiring lock "cinder-337a8011-61e9-426e-9dec-a58a77e45b24-delete_snapshot" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:30:09 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-83155be8-7f76-4a15-9c6c-c516e8d35c21 tempest-SnapshotMetadataTestJSON-946036074 None] Lock "cinder-337a8011-61e9-426e-9dec-a58a77e45b24-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:30:09 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-83155be8-7f76-4a15-9c6c-c516e8d35c21 tempest-SnapshotMetadataTestJSON-946036074 None] Acquiring lock "cinder-quobyte-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:30:09 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-83155be8-7f76-4a15-9c6c-c516e8d35c21 tempest-SnapshotMetadataTestJSON-946036074 None] Lock "cinder-quobyte-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:30:09 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-83155be8-7f76-4a15-9c6c-c516e8d35c21 tempest-SnapshotMetadataTestJSON-946036074 None] Acquiring lock "cinder-quobyte-337a8011-61e9-426e-9dec-a58a77e45b24" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:30:09 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-83155be8-7f76-4a15-9c6c-c516e8d35c21 tempest-SnapshotMetadataTestJSON-946036074 None] Lock "cinder-quobyte-337a8011-61e9-426e-9dec-a58a77e45b24" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:30:09 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-83155be8-7f76-4a15-9c6c-c516e8d35c21 tempest-SnapshotMetadataTestJSON-946036074 None] Deleting offline snapshot 337a8011-61e9-426e-9dec-a58a77e45b24 of volume bb53baf6-a079-4ad2-9a4f-53af3d0dacb9 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:30:09 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-83155be8-7f76-4a15-9c6c-c516e8d35c21 tempest-SnapshotMetadataTestJSON-946036074 None] snapshot_file for this snap is: volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9.337a8011-61e9-426e-9dec-a58a77e45b24 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:30:09 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ece7252-aa50-4384-ae69-e08967365bff]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:30:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-83155be8-7f76-4a15-9c6c-c516e8d35c21 tempest-SnapshotMetadataTestJSON-946036074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9.337a8011-61e9-426e-9dec-a58a77e45b24 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:09 devstack sudo[103040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9.337a8011-61e9-426e-9dec-a58a77e45b24 Jul 16 23:30:09 devstack sudo[103040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:09 devstack sudo[103040]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-83155be8-7f76-4a15-9c6c-c516e8d35c21 tempest-SnapshotMetadataTestJSON-946036074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9.337a8011-61e9-426e-9dec-a58a77e45b24" returned: 0 in 0.433s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:09 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-83155be8-7f76-4a15-9c6c-c516e8d35c21 tempest-SnapshotMetadataTestJSON-946036074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:30:09 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e34071-3999-4e31-97ee-65ab4a470316]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:30:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-83155be8-7f76-4a15-9c6c-c516e8d35c21 tempest-SnapshotMetadataTestJSON-946036074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:09 devstack sudo[103045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9 Jul 16 23:30:09 devstack sudo[103045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:10 devstack sudo[103045]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-83155be8-7f76-4a15-9c6c-c516e8d35c21 tempest-SnapshotMetadataTestJSON-946036074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9" returned: 0 in 0.401s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-83155be8-7f76-4a15-9c6c-c516e8d35c21 tempest-SnapshotMetadataTestJSON-946036074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9.337a8011-61e9-426e-9dec-a58a77e45b24 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:10 devstack sudo[103050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9.337a8011-61e9-426e-9dec-a58a77e45b24 Jul 16 23:30:10 devstack sudo[103050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:10 devstack sudo[103050]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-83155be8-7f76-4a15-9c6c-c516e8d35c21 tempest-SnapshotMetadataTestJSON-946036074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9.337a8011-61e9-426e-9dec-a58a77e45b24" returned: 0 in 0.387s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-83155be8-7f76-4a15-9c6c-c516e8d35c21 tempest-SnapshotMetadataTestJSON-946036074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9.337a8011-61e9-426e-9dec-a58a77e45b24 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:10 devstack sudo[103056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9.337a8011-61e9-426e-9dec-a58a77e45b24 Jul 16 23:30:10 devstack sudo[103056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:10 devstack sudo[103056]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-83155be8-7f76-4a15-9c6c-c516e8d35c21 tempest-SnapshotMetadataTestJSON-946036074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9.337a8011-61e9-426e-9dec-a58a77e45b24" returned: 0 in 0.271s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:10 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-83155be8-7f76-4a15-9c6c-c516e8d35c21 tempest-SnapshotMetadataTestJSON-946036074 None] Lock "cinder-quobyte-337a8011-61e9-426e-9dec-a58a77e45b24" released by "_delete_snapshot" :: held 1.614s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:30:10 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-83155be8-7f76-4a15-9c6c-c516e8d35c21 tempest-SnapshotMetadataTestJSON-946036074 None] Lock "cinder-quobyte-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9" released by "delete_snapshot" :: held 1.647s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:30:10 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-83155be8-7f76-4a15-9c6c-c516e8d35c21 tempest-SnapshotMetadataTestJSON-946036074 None] Created reservations ['51d0752b-91da-4bca-b649-8ff49f2290c5', '739b4f08-7d2b-4749-83a2-5ca375b33473', '48778cac-0bc9-486f-a177-81ae9bd6dc6d', '2f347a68-abb0-4be3-99fd-6b29af95a5fb'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:30:10 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-83155be8-7f76-4a15-9c6c-c516e8d35c21 tempest-SnapshotMetadataTestJSON-946036074 None] Delete snapshot completed successfully. Jul 16 23:30:10 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-83155be8-7f76-4a15-9c6c-c516e8d35c21 tempest-SnapshotMetadataTestJSON-946036074 None] Lock "cinder-337a8011-61e9-426e-9dec-a58a77e45b24-delete_snapshot" released by "delete_snapshot" :: held 1.808s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:30:11 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c27ddded-a625-4f4d-a078-1a01953f41b4 tempest-SnapshotMetadataTestJSON-946036074 None] Acquiring lock "cinder-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:30:11 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c27ddded-a625-4f4d-a078-1a01953f41b4 tempest-SnapshotMetadataTestJSON-946036074 None] Lock "cinder-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:30:11 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c27ddded-a625-4f4d-a078-1a01953f41b4 tempest-SnapshotMetadataTestJSON-946036074 None] Acquiring lock "cinder-quobyte-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:30:11 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c27ddded-a625-4f4d-a078-1a01953f41b4 tempest-SnapshotMetadataTestJSON-946036074 None] Lock "cinder-quobyte-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9" acquired by "delete_volume" :: waited 0.017s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:30:11 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33378b0-a182-4279-82b7-818b18cc9e9a]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:30:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c27ddded-a625-4f4d-a078-1a01953f41b4 tempest-SnapshotMetadataTestJSON-946036074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:11 devstack sudo[103059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9 Jul 16 23:30:11 devstack sudo[103059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:11 devstack sudo[103059]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c27ddded-a625-4f4d-a078-1a01953f41b4 tempest-SnapshotMetadataTestJSON-946036074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9" returned: 0 in 0.425s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c27ddded-a625-4f4d-a078-1a01953f41b4 tempest-SnapshotMetadataTestJSON-946036074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:11 devstack sudo[103064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9 Jul 16 23:30:11 devstack sudo[103064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:12 devstack sudo[103064]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c27ddded-a625-4f4d-a078-1a01953f41b4 tempest-SnapshotMetadataTestJSON-946036074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9" returned: 0 in 0.284s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:12 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c27ddded-a625-4f4d-a078-1a01953f41b4 tempest-SnapshotMetadataTestJSON-946036074 None] Lock "cinder-quobyte-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9" released by "delete_volume" :: held 0.769s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:30:12 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-c27ddded-a625-4f4d-a078-1a01953f41b4 tempest-SnapshotMetadataTestJSON-946036074 None] Created reservations ['0e8cf0b4-9f32-446b-b6f9-a1e0e79ddbe8', '78866a88-6554-4147-b9ae-97ad5e7260dc', '16d8c01a-f529-4e35-9e34-574c264ebde4', '8ce729b8-4916-4a0e-86f6-9b976e704086'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:30:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c27ddded-a625-4f4d-a078-1a01953f41b4 tempest-SnapshotMetadataTestJSON-946036074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:30:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c27ddded-a625-4f4d-a078-1a01953f41b4 tempest-SnapshotMetadataTestJSON-946036074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:30:12 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-c27ddded-a625-4f4d-a078-1a01953f41b4 tempest-SnapshotMetadataTestJSON-946036074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:30:12 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-c27ddded-a625-4f4d-a078-1a01953f41b4 tempest-SnapshotMetadataTestJSON-946036074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:30:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c27ddded-a625-4f4d-a078-1a01953f41b4 tempest-SnapshotMetadataTestJSON-946036074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:30:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c27ddded-a625-4f4d-a078-1a01953f41b4 tempest-SnapshotMetadataTestJSON-946036074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:12 devstack sudo[103067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:30:12 devstack sudo[103067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:12 devstack sudo[103067]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c27ddded-a625-4f4d-a078-1a01953f41b4 tempest-SnapshotMetadataTestJSON-946036074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.286s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:12 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-c27ddded-a625-4f4d-a078-1a01953f41b4 tempest-SnapshotMetadataTestJSON-946036074 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:30:12 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-c27ddded-a625-4f4d-a078-1a01953f41b4 tempest-SnapshotMetadataTestJSON-946036074 None] Deleted volume successfully. Jul 16 23:30:12 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c27ddded-a625-4f4d-a078-1a01953f41b4 tempest-SnapshotMetadataTestJSON-946036074 None] Lock "cinder-bb53baf6-a079-4ad2-9a4f-53af3d0dacb9-delete_volume" released by "delete_volume" :: held 1.299s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:30:16 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a12a56f-3b53-41d6-8073-c2b0c2d0a832 tempest-AbsoluteLimitsTests-213947209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:30:16 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7a12a56f-3b53-41d6-8073-c2b0c2d0a832 tempest-AbsoluteLimitsTests-213947209 None] Flow 'volume_create_manager' (016fb7e4-c944-4b87-a448-52025d608b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:30:16 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7a12a56f-3b53-41d6-8073-c2b0c2d0a832 tempest-AbsoluteLimitsTests-213947209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11ea2701-ac1e-426b-9c3a-a4081d043cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:16 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7a12a56f-3b53-41d6-8073-c2b0c2d0a832 tempest-AbsoluteLimitsTests-213947209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11ea2701-ac1e-426b-9c3a-a4081d043cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1550476456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8595d44a-0415-44d0-8b8d-b92e28a70799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b900d96b2c8c490e839d8fbc542215a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:30:17Z,use_quota=True,user_id='273159f00dcc4ac0b2d03d1f7ddf9480',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:16 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7a12a56f-3b53-41d6-8073-c2b0c2d0a832 tempest-AbsoluteLimitsTests-213947209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c8f8fb7-774f-4760-b100-40aeed147a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:16 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7a12a56f-3b53-41d6-8073-c2b0c2d0a832 tempest-AbsoluteLimitsTests-213947209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c8f8fb7-774f-4760-b100-40aeed147a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:16 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7a12a56f-3b53-41d6-8073-c2b0c2d0a832 tempest-AbsoluteLimitsTests-213947209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80d5cc03-a8da-4abc-a88b-18b83a01b5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:16 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7a12a56f-3b53-41d6-8073-c2b0c2d0a832 tempest-AbsoluteLimitsTests-213947209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80d5cc03-a8da-4abc-a88b-18b83a01b5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8595d44a-0415-44d0-8b8d-b92e28a70799', 'volume_name': 'volume-8595d44a-0415-44d0-8b8d-b92e28a70799', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:16 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7a12a56f-3b53-41d6-8073-c2b0c2d0a832 tempest-AbsoluteLimitsTests-213947209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb308f2-cd74-499e-acd8-3778608c7858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:16 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7a12a56f-3b53-41d6-8073-c2b0c2d0a832 tempest-AbsoluteLimitsTests-213947209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb308f2-cd74-499e-acd8-3778608c7858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:16 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7a12a56f-3b53-41d6-8073-c2b0c2d0a832 tempest-AbsoluteLimitsTests-213947209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24892433-d5f9-4d45-a5bd-c75c5cd05261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:16 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-7a12a56f-3b53-41d6-8073-c2b0c2d0a832 tempest-AbsoluteLimitsTests-213947209 None] Volume 8595d44a-0415-44d0-8b8d-b92e28a70799: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8595d44a-0415-44d0-8b8d-b92e28a70799', 'volume_size': 1} Jul 16 23:30:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7a12a56f-3b53-41d6-8073-c2b0c2d0a832 tempest-AbsoluteLimitsTests-213947209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:30:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7a12a56f-3b53-41d6-8073-c2b0c2d0a832 tempest-AbsoluteLimitsTests-213947209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:30:16 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-7a12a56f-3b53-41d6-8073-c2b0c2d0a832 tempest-AbsoluteLimitsTests-213947209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1550476456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8595d44a-0415-44d0-8b8d-b92e28a70799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b900d96b2c8c490e839d8fbc542215a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:30:17Z,use_quota=True,user_id='273159f00dcc4ac0b2d03d1f7ddf9480',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:30:16 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-7a12a56f-3b53-41d6-8073-c2b0c2d0a832 tempest-AbsoluteLimitsTests-213947209 None] Creating volume 8595d44a-0415-44d0-8b8d-b92e28a70799 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:30:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7a12a56f-3b53-41d6-8073-c2b0c2d0a832 tempest-AbsoluteLimitsTests-213947209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:30:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7a12a56f-3b53-41d6-8073-c2b0c2d0a832 tempest-AbsoluteLimitsTests-213947209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:30:16 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-7a12a56f-3b53-41d6-8073-c2b0c2d0a832 tempest-AbsoluteLimitsTests-213947209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:30:16 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-7a12a56f-3b53-41d6-8073-c2b0c2d0a832 tempest-AbsoluteLimitsTests-213947209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:30:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7a12a56f-3b53-41d6-8073-c2b0c2d0a832 tempest-AbsoluteLimitsTests-213947209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:30:16 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-7a12a56f-3b53-41d6-8073-c2b0c2d0a832 tempest-AbsoluteLimitsTests-213947209 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:30:16 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-7a12a56f-3b53-41d6-8073-c2b0c2d0a832 tempest-AbsoluteLimitsTests-213947209 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:30:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7a12a56f-3b53-41d6-8073-c2b0c2d0a832 tempest-AbsoluteLimitsTests-213947209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8595d44a-0415-44d0-8b8d-b92e28a70799 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:16 devstack sudo[103084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8595d44a-0415-44d0-8b8d-b92e28a70799 1073741824 Jul 16 23:30:16 devstack sudo[103084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:17 devstack sudo[103084]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:17 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7a12a56f-3b53-41d6-8073-c2b0c2d0a832 tempest-AbsoluteLimitsTests-213947209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8595d44a-0415-44d0-8b8d-b92e28a70799 1073741824" returned: 0 in 0.494s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:17 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7a12a56f-3b53-41d6-8073-c2b0c2d0a832 tempest-AbsoluteLimitsTests-213947209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8595d44a-0415-44d0-8b8d-b92e28a70799 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:17 devstack sudo[103114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8595d44a-0415-44d0-8b8d-b92e28a70799 Jul 16 23:30:17 devstack sudo[103114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:17 devstack sudo[103114]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:17 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7a12a56f-3b53-41d6-8073-c2b0c2d0a832 tempest-AbsoluteLimitsTests-213947209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8595d44a-0415-44d0-8b8d-b92e28a70799" returned: 0 in 0.264s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:17 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-7a12a56f-3b53-41d6-8073-c2b0c2d0a832 tempest-AbsoluteLimitsTests-213947209 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:30:17 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7a12a56f-3b53-41d6-8073-c2b0c2d0a832 tempest-AbsoluteLimitsTests-213947209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:30:17 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7a12a56f-3b53-41d6-8073-c2b0c2d0a832 tempest-AbsoluteLimitsTests-213947209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24892433-d5f9-4d45-a5bd-c75c5cd05261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8595d44a-0415-44d0-8b8d-b92e28a70799', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:17 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7a12a56f-3b53-41d6-8073-c2b0c2d0a832 tempest-AbsoluteLimitsTests-213947209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a109d396-200e-4cf0-b00e-fd260e61f364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:17 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-7a12a56f-3b53-41d6-8073-c2b0c2d0a832 tempest-AbsoluteLimitsTests-213947209 None] Volume volume-8595d44a-0415-44d0-8b8d-b92e28a70799 (8595d44a-0415-44d0-8b8d-b92e28a70799): created successfully Jul 16 23:30:17 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7a12a56f-3b53-41d6-8073-c2b0c2d0a832 tempest-AbsoluteLimitsTests-213947209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a109d396-200e-4cf0-b00e-fd260e61f364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:17 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7a12a56f-3b53-41d6-8073-c2b0c2d0a832 tempest-AbsoluteLimitsTests-213947209 None] Flow 'volume_create_manager' (016fb7e4-c944-4b87-a448-52025d608b67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:30:17 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-7a12a56f-3b53-41d6-8073-c2b0c2d0a832 tempest-AbsoluteLimitsTests-213947209 None] Created volume successfully. Jul 16 23:30:19 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f194ff79-7225-44cd-8649-35d59e8e3299 tempest-AbsoluteLimitsTests-213947209 None] Acquiring lock "cinder-8595d44a-0415-44d0-8b8d-b92e28a70799-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:30:19 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f194ff79-7225-44cd-8649-35d59e8e3299 tempest-AbsoluteLimitsTests-213947209 None] Lock "cinder-8595d44a-0415-44d0-8b8d-b92e28a70799-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:30:19 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f194ff79-7225-44cd-8649-35d59e8e3299 tempest-AbsoluteLimitsTests-213947209 None] Acquiring lock "cinder-quobyte-8595d44a-0415-44d0-8b8d-b92e28a70799" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:30:19 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f194ff79-7225-44cd-8649-35d59e8e3299 tempest-AbsoluteLimitsTests-213947209 None] Lock "cinder-quobyte-8595d44a-0415-44d0-8b8d-b92e28a70799" acquired by "delete_volume" :: waited 0.018s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:30:19 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4ee0b5-5808-4f16-bbe2-d07734238043]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:30:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f194ff79-7225-44cd-8649-35d59e8e3299 tempest-AbsoluteLimitsTests-213947209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8595d44a-0415-44d0-8b8d-b92e28a70799 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:19 devstack sudo[103118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8595d44a-0415-44d0-8b8d-b92e28a70799 Jul 16 23:30:19 devstack sudo[103118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:19 devstack sudo[103118]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f194ff79-7225-44cd-8649-35d59e8e3299 tempest-AbsoluteLimitsTests-213947209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8595d44a-0415-44d0-8b8d-b92e28a70799" returned: 0 in 0.380s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f194ff79-7225-44cd-8649-35d59e8e3299 tempest-AbsoluteLimitsTests-213947209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8595d44a-0415-44d0-8b8d-b92e28a70799 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:19 devstack sudo[103123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8595d44a-0415-44d0-8b8d-b92e28a70799 Jul 16 23:30:19 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:19 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f194ff79-7225-44cd-8649-35d59e8e3299 tempest-AbsoluteLimitsTests-213947209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8595d44a-0415-44d0-8b8d-b92e28a70799" returned: 0 in 0.262s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:19 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f194ff79-7225-44cd-8649-35d59e8e3299 tempest-AbsoluteLimitsTests-213947209 None] Lock "cinder-quobyte-8595d44a-0415-44d0-8b8d-b92e28a70799" released by "delete_volume" :: held 0.693s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:30:19 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-f194ff79-7225-44cd-8649-35d59e8e3299 tempest-AbsoluteLimitsTests-213947209 None] Created reservations ['0683d42e-abf4-48da-b073-9ee79e83d1c9', '8d3a98f9-8463-42bd-b244-33555e36ec4d', '51976eea-ad9f-4306-b4dd-ededc1966379', 'ca57d9ff-abd5-451f-89bf-366a99fc8457'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:30:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f194ff79-7225-44cd-8649-35d59e8e3299 tempest-AbsoluteLimitsTests-213947209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:30:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f194ff79-7225-44cd-8649-35d59e8e3299 tempest-AbsoluteLimitsTests-213947209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:30:20 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f194ff79-7225-44cd-8649-35d59e8e3299 tempest-AbsoluteLimitsTests-213947209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:30:20 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f194ff79-7225-44cd-8649-35d59e8e3299 tempest-AbsoluteLimitsTests-213947209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:30:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f194ff79-7225-44cd-8649-35d59e8e3299 tempest-AbsoluteLimitsTests-213947209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:30:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f194ff79-7225-44cd-8649-35d59e8e3299 tempest-AbsoluteLimitsTests-213947209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:20 devstack sudo[103126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:30:20 devstack sudo[103126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:20 devstack sudo[103126]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f194ff79-7225-44cd-8649-35d59e8e3299 tempest-AbsoluteLimitsTests-213947209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.308s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:20 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-f194ff79-7225-44cd-8649-35d59e8e3299 tempest-AbsoluteLimitsTests-213947209 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:30:20 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-f194ff79-7225-44cd-8649-35d59e8e3299 tempest-AbsoluteLimitsTests-213947209 None] Deleted volume successfully. Jul 16 23:30:20 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f194ff79-7225-44cd-8649-35d59e8e3299 tempest-AbsoluteLimitsTests-213947209 None] Lock "cinder-8595d44a-0415-44d0-8b8d-b92e28a70799-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:30:26 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:UPDATE=110,cinder:SELECT=107,cinder:INSERT=38,cinder:DELETE=12 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:30:26 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:UPDATE=126,cinder:SELECT=85,cinder:INSERT=20,cinder:DELETE=8 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:30:26 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-1539e6cd-c083-4d68-9b2f-b65507a59a6a tempest-VolumesTransfersV355Test-778599549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:30:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1539e6cd-c083-4d68-9b2f-b65507a59a6a tempest-VolumesTransfersV355Test-778599549 None] Flow 'volume_create_manager' (74a5c7d0-c9b8-4f90-803e-f696224aff90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:30:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1539e6cd-c083-4d68-9b2f-b65507a59a6a tempest-VolumesTransfersV355Test-778599549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a16f6cb2-e0f2-4640-9462-30118d070d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1539e6cd-c083-4d68-9b2f-b65507a59a6a tempest-VolumesTransfersV355Test-778599549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a16f6cb2-e0f2-4640-9462-30118d070d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:30:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1447896053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ac70c42-e47f-4c38-b411-8d0f76435ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92a6c42e5e3245babb96ed897c32c819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:30:27Z,use_quota=True,user_id='d539a922a4e34ea2830905d9803a18c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1539e6cd-c083-4d68-9b2f-b65507a59a6a tempest-VolumesTransfersV355Test-778599549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (471c5f2b-0a52-49bb-ab73-e24de0a7af27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1539e6cd-c083-4d68-9b2f-b65507a59a6a tempest-VolumesTransfersV355Test-778599549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (471c5f2b-0a52-49bb-ab73-e24de0a7af27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1539e6cd-c083-4d68-9b2f-b65507a59a6a tempest-VolumesTransfersV355Test-778599549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03f7116c-712b-43dc-a42f-f0ab9a5ba0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1539e6cd-c083-4d68-9b2f-b65507a59a6a tempest-VolumesTransfersV355Test-778599549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03f7116c-712b-43dc-a42f-f0ab9a5ba0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ac70c42-e47f-4c38-b411-8d0f76435ed0', 'volume_name': 'volume-6ac70c42-e47f-4c38-b411-8d0f76435ed0', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1539e6cd-c083-4d68-9b2f-b65507a59a6a tempest-VolumesTransfersV355Test-778599549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b54baf8-3a7d-4ccd-93f7-61885a5023ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1539e6cd-c083-4d68-9b2f-b65507a59a6a tempest-VolumesTransfersV355Test-778599549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b54baf8-3a7d-4ccd-93f7-61885a5023ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1539e6cd-c083-4d68-9b2f-b65507a59a6a tempest-VolumesTransfersV355Test-778599549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eb40ce7-b328-4cb2-8f57-2726584c518e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:26 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-1539e6cd-c083-4d68-9b2f-b65507a59a6a tempest-VolumesTransfersV355Test-778599549 None] Volume 6ac70c42-e47f-4c38-b411-8d0f76435ed0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ac70c42-e47f-4c38-b411-8d0f76435ed0', 'volume_size': 1} Jul 16 23:30:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1539e6cd-c083-4d68-9b2f-b65507a59a6a tempest-VolumesTransfersV355Test-778599549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:30:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1539e6cd-c083-4d68-9b2f-b65507a59a6a tempest-VolumesTransfersV355Test-778599549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:30:26 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1539e6cd-c083-4d68-9b2f-b65507a59a6a tempest-VolumesTransfersV355Test-778599549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:30:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1447896053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ac70c42-e47f-4c38-b411-8d0f76435ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92a6c42e5e3245babb96ed897c32c819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:30:27Z,use_quota=True,user_id='d539a922a4e34ea2830905d9803a18c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:30:26 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-1539e6cd-c083-4d68-9b2f-b65507a59a6a tempest-VolumesTransfersV355Test-778599549 None] Creating volume 6ac70c42-e47f-4c38-b411-8d0f76435ed0 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:30:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1539e6cd-c083-4d68-9b2f-b65507a59a6a tempest-VolumesTransfersV355Test-778599549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:30:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1539e6cd-c083-4d68-9b2f-b65507a59a6a tempest-VolumesTransfersV355Test-778599549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:30:26 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1539e6cd-c083-4d68-9b2f-b65507a59a6a tempest-VolumesTransfersV355Test-778599549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:30:26 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1539e6cd-c083-4d68-9b2f-b65507a59a6a tempest-VolumesTransfersV355Test-778599549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:30:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1539e6cd-c083-4d68-9b2f-b65507a59a6a tempest-VolumesTransfersV355Test-778599549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:30:26 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1539e6cd-c083-4d68-9b2f-b65507a59a6a tempest-VolumesTransfersV355Test-778599549 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:30:26 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-1539e6cd-c083-4d68-9b2f-b65507a59a6a tempest-VolumesTransfersV355Test-778599549 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:30:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1539e6cd-c083-4d68-9b2f-b65507a59a6a tempest-VolumesTransfersV355Test-778599549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6ac70c42-e47f-4c38-b411-8d0f76435ed0 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:26 devstack sudo[103134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6ac70c42-e47f-4c38-b411-8d0f76435ed0 1073741824 Jul 16 23:30:26 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:27 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1539e6cd-c083-4d68-9b2f-b65507a59a6a tempest-VolumesTransfersV355Test-778599549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6ac70c42-e47f-4c38-b411-8d0f76435ed0 1073741824" returned: 0 in 0.548s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1539e6cd-c083-4d68-9b2f-b65507a59a6a tempest-VolumesTransfersV355Test-778599549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6ac70c42-e47f-4c38-b411-8d0f76435ed0 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:27 devstack sudo[103140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6ac70c42-e47f-4c38-b411-8d0f76435ed0 Jul 16 23:30:27 devstack sudo[103140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:27 devstack sudo[103140]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1539e6cd-c083-4d68-9b2f-b65507a59a6a tempest-VolumesTransfersV355Test-778599549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6ac70c42-e47f-4c38-b411-8d0f76435ed0" returned: 0 in 0.322s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:27 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1539e6cd-c083-4d68-9b2f-b65507a59a6a tempest-VolumesTransfersV355Test-778599549 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:30:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1539e6cd-c083-4d68-9b2f-b65507a59a6a tempest-VolumesTransfersV355Test-778599549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:30:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1539e6cd-c083-4d68-9b2f-b65507a59a6a tempest-VolumesTransfersV355Test-778599549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eb40ce7-b328-4cb2-8f57-2726584c518e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ac70c42-e47f-4c38-b411-8d0f76435ed0', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1539e6cd-c083-4d68-9b2f-b65507a59a6a tempest-VolumesTransfersV355Test-778599549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfd4e72a-51de-4fcc-96fe-25b584041dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:27 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-1539e6cd-c083-4d68-9b2f-b65507a59a6a tempest-VolumesTransfersV355Test-778599549 None] Volume volume-6ac70c42-e47f-4c38-b411-8d0f76435ed0 (6ac70c42-e47f-4c38-b411-8d0f76435ed0): created successfully Jul 16 23:30:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1539e6cd-c083-4d68-9b2f-b65507a59a6a tempest-VolumesTransfersV355Test-778599549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfd4e72a-51de-4fcc-96fe-25b584041dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1539e6cd-c083-4d68-9b2f-b65507a59a6a tempest-VolumesTransfersV355Test-778599549 None] Flow 'volume_create_manager' (74a5c7d0-c9b8-4f90-803e-f696224aff90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:30:27 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-1539e6cd-c083-4d68-9b2f-b65507a59a6a tempest-VolumesTransfersV355Test-778599549 None] Created volume successfully. Jul 16 23:30:29 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-b9c4ad54-161e-4826-be8e-7836bb8a88ff tempest-VolumesTransfersV355Test-946310896 None] Transfer volume completed successfully. Jul 16 23:30:30 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d63d7416-31e6-45c4-964f-3e9139270027 tempest-VolumesTransfersV355Test-414438661 None] Acquiring lock "cinder-6ac70c42-e47f-4c38-b411-8d0f76435ed0-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:30:30 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d63d7416-31e6-45c4-964f-3e9139270027 tempest-VolumesTransfersV355Test-414438661 None] Lock "cinder-6ac70c42-e47f-4c38-b411-8d0f76435ed0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:30:30 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d63d7416-31e6-45c4-964f-3e9139270027 tempest-VolumesTransfersV355Test-414438661 None] Acquiring lock "cinder-quobyte-6ac70c42-e47f-4c38-b411-8d0f76435ed0" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:30:30 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d63d7416-31e6-45c4-964f-3e9139270027 tempest-VolumesTransfersV355Test-414438661 None] Lock "cinder-quobyte-6ac70c42-e47f-4c38-b411-8d0f76435ed0" acquired by "delete_volume" :: waited 0.015s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:30:30 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae802e7-1416-40eb-aad1-72ae7146d808]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:30:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d63d7416-31e6-45c4-964f-3e9139270027 tempest-VolumesTransfersV355Test-414438661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6ac70c42-e47f-4c38-b411-8d0f76435ed0 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:30 devstack sudo[103240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6ac70c42-e47f-4c38-b411-8d0f76435ed0 Jul 16 23:30:30 devstack sudo[103240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:31 devstack sudo[103240]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d63d7416-31e6-45c4-964f-3e9139270027 tempest-VolumesTransfersV355Test-414438661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6ac70c42-e47f-4c38-b411-8d0f76435ed0" returned: 0 in 0.461s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d63d7416-31e6-45c4-964f-3e9139270027 tempest-VolumesTransfersV355Test-414438661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6ac70c42-e47f-4c38-b411-8d0f76435ed0 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:31 devstack sudo[103247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6ac70c42-e47f-4c38-b411-8d0f76435ed0 Jul 16 23:30:31 devstack sudo[103247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:31 devstack sudo[103247]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d63d7416-31e6-45c4-964f-3e9139270027 tempest-VolumesTransfersV355Test-414438661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6ac70c42-e47f-4c38-b411-8d0f76435ed0" returned: 0 in 0.272s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:31 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d63d7416-31e6-45c4-964f-3e9139270027 tempest-VolumesTransfersV355Test-414438661 None] Lock "cinder-quobyte-6ac70c42-e47f-4c38-b411-8d0f76435ed0" released by "delete_volume" :: held 0.780s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:30:31 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-d63d7416-31e6-45c4-964f-3e9139270027 tempest-VolumesTransfersV355Test-414438661 None] Created reservations ['3a2d1452-c4c2-4d09-b525-72c2386e5686', 'cbcd477e-6a63-4385-9a7f-00a0a72e79eb', 'c4be94be-9fd4-43b3-881e-d1797893e579', 'cfb44907-bc49-4211-a5a6-fe3e13872966'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:30:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-d63d7416-31e6-45c4-964f-3e9139270027 tempest-VolumesTransfersV355Test-414438661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:30:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-d63d7416-31e6-45c4-964f-3e9139270027 tempest-VolumesTransfersV355Test-414438661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:30:31 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-d63d7416-31e6-45c4-964f-3e9139270027 tempest-VolumesTransfersV355Test-414438661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:30:31 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-d63d7416-31e6-45c4-964f-3e9139270027 tempest-VolumesTransfersV355Test-414438661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:30:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-d63d7416-31e6-45c4-964f-3e9139270027 tempest-VolumesTransfersV355Test-414438661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:30:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d63d7416-31e6-45c4-964f-3e9139270027 tempest-VolumesTransfersV355Test-414438661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:31 devstack sudo[103250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:30:31 devstack sudo[103250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:31 devstack sudo[103250]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d63d7416-31e6-45c4-964f-3e9139270027 tempest-VolumesTransfersV355Test-414438661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.350s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:31 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-d63d7416-31e6-45c4-964f-3e9139270027 tempest-VolumesTransfersV355Test-414438661 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:30:31 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-d63d7416-31e6-45c4-964f-3e9139270027 tempest-VolumesTransfersV355Test-414438661 None] Deleted volume successfully. Jul 16 23:30:31 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d63d7416-31e6-45c4-964f-3e9139270027 tempest-VolumesTransfersV355Test-414438661 None] Lock "cinder-6ac70c42-e47f-4c38-b411-8d0f76435ed0-delete_volume" released by "delete_volume" :: held 1.352s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:30:32 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-20999830-e4c5-472d-9431-4898148e3c1a tempest-VolumesTransfersV355Test-778599549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:30:32 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-20999830-e4c5-472d-9431-4898148e3c1a tempest-VolumesTransfersV355Test-778599549 None] Flow 'volume_create_manager' (3e525cac-e1ef-4793-b362-d0a549cf3a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:30:32 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-20999830-e4c5-472d-9431-4898148e3c1a tempest-VolumesTransfersV355Test-778599549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a7a1682-7dd5-4c57-8a3b-562a6262ca44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:32 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-20999830-e4c5-472d-9431-4898148e3c1a tempest-VolumesTransfersV355Test-778599549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a7a1682-7dd5-4c57-8a3b-562a6262ca44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1466759136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e4339fc-4f7f-4937-a513-b13be240906b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92a6c42e5e3245babb96ed897c32c819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:30:33Z,use_quota=True,user_id='d539a922a4e34ea2830905d9803a18c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:32 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-20999830-e4c5-472d-9431-4898148e3c1a tempest-VolumesTransfersV355Test-778599549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e5bc76-bfd9-4a45-9d62-e8b423fbf690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:32 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-20999830-e4c5-472d-9431-4898148e3c1a tempest-VolumesTransfersV355Test-778599549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e5bc76-bfd9-4a45-9d62-e8b423fbf690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:32 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-20999830-e4c5-472d-9431-4898148e3c1a tempest-VolumesTransfersV355Test-778599549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b10ea621-6ae2-4ad5-b1ee-afc623d760f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:32 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-20999830-e4c5-472d-9431-4898148e3c1a tempest-VolumesTransfersV355Test-778599549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b10ea621-6ae2-4ad5-b1ee-afc623d760f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e4339fc-4f7f-4937-a513-b13be240906b', 'volume_name': 'volume-2e4339fc-4f7f-4937-a513-b13be240906b', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:32 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-20999830-e4c5-472d-9431-4898148e3c1a tempest-VolumesTransfersV355Test-778599549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57c98bd3-c2e7-4e0c-80f5-e8a82cf46842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:32 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-20999830-e4c5-472d-9431-4898148e3c1a tempest-VolumesTransfersV355Test-778599549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57c98bd3-c2e7-4e0c-80f5-e8a82cf46842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:32 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-20999830-e4c5-472d-9431-4898148e3c1a tempest-VolumesTransfersV355Test-778599549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cbc1ade-53a4-42ed-af9a-9f2046b2b2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:32 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-20999830-e4c5-472d-9431-4898148e3c1a tempest-VolumesTransfersV355Test-778599549 None] Volume 2e4339fc-4f7f-4937-a513-b13be240906b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e4339fc-4f7f-4937-a513-b13be240906b', 'volume_size': 1} Jul 16 23:30:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-20999830-e4c5-472d-9431-4898148e3c1a tempest-VolumesTransfersV355Test-778599549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:30:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-20999830-e4c5-472d-9431-4898148e3c1a tempest-VolumesTransfersV355Test-778599549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:30:32 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-20999830-e4c5-472d-9431-4898148e3c1a tempest-VolumesTransfersV355Test-778599549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1466759136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e4339fc-4f7f-4937-a513-b13be240906b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92a6c42e5e3245babb96ed897c32c819',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:30:33Z,use_quota=True,user_id='d539a922a4e34ea2830905d9803a18c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:30:32 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-20999830-e4c5-472d-9431-4898148e3c1a tempest-VolumesTransfersV355Test-778599549 None] Creating volume 2e4339fc-4f7f-4937-a513-b13be240906b {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:30:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-20999830-e4c5-472d-9431-4898148e3c1a tempest-VolumesTransfersV355Test-778599549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:30:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-20999830-e4c5-472d-9431-4898148e3c1a tempest-VolumesTransfersV355Test-778599549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:30:32 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-20999830-e4c5-472d-9431-4898148e3c1a tempest-VolumesTransfersV355Test-778599549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:30:32 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-20999830-e4c5-472d-9431-4898148e3c1a tempest-VolumesTransfersV355Test-778599549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:30:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-20999830-e4c5-472d-9431-4898148e3c1a tempest-VolumesTransfersV355Test-778599549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:30:32 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-20999830-e4c5-472d-9431-4898148e3c1a tempest-VolumesTransfersV355Test-778599549 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:30:32 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-20999830-e4c5-472d-9431-4898148e3c1a tempest-VolumesTransfersV355Test-778599549 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:30:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-20999830-e4c5-472d-9431-4898148e3c1a tempest-VolumesTransfersV355Test-778599549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e4339fc-4f7f-4937-a513-b13be240906b 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:32 devstack sudo[103253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e4339fc-4f7f-4937-a513-b13be240906b 1073741824 Jul 16 23:30:32 devstack sudo[103253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:33 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-d51c96d8-a4f6-4e13-a14b-fa4bca82bb8f tempest-TestMinimumBasicScenario-1153042250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:30:33 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d51c96d8-a4f6-4e13-a14b-fa4bca82bb8f tempest-TestMinimumBasicScenario-1153042250 None] Flow 'volume_create_manager' (a5461110-88f5-422d-ab80-b35d78e42aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:30:33 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d51c96d8-a4f6-4e13-a14b-fa4bca82bb8f tempest-TestMinimumBasicScenario-1153042250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e61b5d6f-5769-4708-a0df-d13e8db4f0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:33 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d51c96d8-a4f6-4e13-a14b-fa4bca82bb8f tempest-TestMinimumBasicScenario-1153042250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e61b5d6f-5769-4708-a0df-d13e8db4f0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1227147146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3790e7a-807b-4f80-af39-068cc199748e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e8d0588d9cf4831855e743e26f8f2d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:30:33Z,use_quota=True,user_id='1da88f594110480bb65766eb90e3c8c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:33 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d51c96d8-a4f6-4e13-a14b-fa4bca82bb8f tempest-TestMinimumBasicScenario-1153042250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (219fac51-2494-4130-9615-4353ce87edd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:33 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d51c96d8-a4f6-4e13-a14b-fa4bca82bb8f tempest-TestMinimumBasicScenario-1153042250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (219fac51-2494-4130-9615-4353ce87edd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:33 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d51c96d8-a4f6-4e13-a14b-fa4bca82bb8f tempest-TestMinimumBasicScenario-1153042250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bf4e73a-b5c4-4046-9553-64319d166a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:33 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d51c96d8-a4f6-4e13-a14b-fa4bca82bb8f tempest-TestMinimumBasicScenario-1153042250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bf4e73a-b5c4-4046-9553-64319d166a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3790e7a-807b-4f80-af39-068cc199748e', 'volume_name': 'volume-a3790e7a-807b-4f80-af39-068cc199748e', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:33 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d51c96d8-a4f6-4e13-a14b-fa4bca82bb8f tempest-TestMinimumBasicScenario-1153042250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22c715c8-f4a7-4031-b5a3-3d840f0abf38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:33 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d51c96d8-a4f6-4e13-a14b-fa4bca82bb8f tempest-TestMinimumBasicScenario-1153042250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22c715c8-f4a7-4031-b5a3-3d840f0abf38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:33 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d51c96d8-a4f6-4e13-a14b-fa4bca82bb8f tempest-TestMinimumBasicScenario-1153042250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f9f5678-140d-4f22-99da-1ab51694f696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:33 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-d51c96d8-a4f6-4e13-a14b-fa4bca82bb8f tempest-TestMinimumBasicScenario-1153042250 None] Volume a3790e7a-807b-4f80-af39-068cc199748e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3790e7a-807b-4f80-af39-068cc199748e', 'volume_size': 1} Jul 16 23:30:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-d51c96d8-a4f6-4e13-a14b-fa4bca82bb8f tempest-TestMinimumBasicScenario-1153042250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:30:33 devstack sudo[103253]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-20999830-e4c5-472d-9431-4898148e3c1a tempest-VolumesTransfersV355Test-778599549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e4339fc-4f7f-4937-a513-b13be240906b 1073741824" returned: 0 in 0.518s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-20999830-e4c5-472d-9431-4898148e3c1a tempest-VolumesTransfersV355Test-778599549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e4339fc-4f7f-4937-a513-b13be240906b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:33 devstack sudo[103260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e4339fc-4f7f-4937-a513-b13be240906b Jul 16 23:30:33 devstack sudo[103260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:33 devstack sudo[103260]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-20999830-e4c5-472d-9431-4898148e3c1a tempest-VolumesTransfersV355Test-778599549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e4339fc-4f7f-4937-a513-b13be240906b" returned: 0 in 0.266s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:33 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-20999830-e4c5-472d-9431-4898148e3c1a tempest-VolumesTransfersV355Test-778599549 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:30:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-20999830-e4c5-472d-9431-4898148e3c1a tempest-VolumesTransfersV355Test-778599549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:30:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-d51c96d8-a4f6-4e13-a14b-fa4bca82bb8f tempest-TestMinimumBasicScenario-1153042250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.392s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:30:33 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-d51c96d8-a4f6-4e13-a14b-fa4bca82bb8f tempest-TestMinimumBasicScenario-1153042250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1227147146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3790e7a-807b-4f80-af39-068cc199748e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e8d0588d9cf4831855e743e26f8f2d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:30:33Z,use_quota=True,user_id='1da88f594110480bb65766eb90e3c8c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:30:33 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-d51c96d8-a4f6-4e13-a14b-fa4bca82bb8f tempest-TestMinimumBasicScenario-1153042250 None] Creating volume a3790e7a-807b-4f80-af39-068cc199748e {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:30:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-d51c96d8-a4f6-4e13-a14b-fa4bca82bb8f tempest-TestMinimumBasicScenario-1153042250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:30:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-d51c96d8-a4f6-4e13-a14b-fa4bca82bb8f tempest-TestMinimumBasicScenario-1153042250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:30:33 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-d51c96d8-a4f6-4e13-a14b-fa4bca82bb8f tempest-TestMinimumBasicScenario-1153042250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:30:33 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-d51c96d8-a4f6-4e13-a14b-fa4bca82bb8f tempest-TestMinimumBasicScenario-1153042250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:30:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-d51c96d8-a4f6-4e13-a14b-fa4bca82bb8f tempest-TestMinimumBasicScenario-1153042250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:30:33 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-d51c96d8-a4f6-4e13-a14b-fa4bca82bb8f tempest-TestMinimumBasicScenario-1153042250 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:30:33 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-d51c96d8-a4f6-4e13-a14b-fa4bca82bb8f tempest-TestMinimumBasicScenario-1153042250 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:30:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d51c96d8-a4f6-4e13-a14b-fa4bca82bb8f tempest-TestMinimumBasicScenario-1153042250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a3790e7a-807b-4f80-af39-068cc199748e 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:33 devstack sudo[103263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a3790e7a-807b-4f80-af39-068cc199748e 1073741824 Jul 16 23:30:33 devstack sudo[103263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:33 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-20999830-e4c5-472d-9431-4898148e3c1a tempest-VolumesTransfersV355Test-778599549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cbc1ade-53a4-42ed-af9a-9f2046b2b2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e4339fc-4f7f-4937-a513-b13be240906b', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:33 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-20999830-e4c5-472d-9431-4898148e3c1a tempest-VolumesTransfersV355Test-778599549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5918b91a-6ff9-4157-9687-db630d9d4219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:33 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-20999830-e4c5-472d-9431-4898148e3c1a tempest-VolumesTransfersV355Test-778599549 None] Volume volume-2e4339fc-4f7f-4937-a513-b13be240906b (2e4339fc-4f7f-4937-a513-b13be240906b): created successfully Jul 16 23:30:33 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-20999830-e4c5-472d-9431-4898148e3c1a tempest-VolumesTransfersV355Test-778599549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5918b91a-6ff9-4157-9687-db630d9d4219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:33 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-20999830-e4c5-472d-9431-4898148e3c1a tempest-VolumesTransfersV355Test-778599549 None] Flow 'volume_create_manager' (3e525cac-e1ef-4793-b362-d0a549cf3a51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:30:33 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-20999830-e4c5-472d-9431-4898148e3c1a tempest-VolumesTransfersV355Test-778599549 None] Created volume successfully. Jul 16 23:30:34 devstack sudo[103263]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:34 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d51c96d8-a4f6-4e13-a14b-fa4bca82bb8f tempest-TestMinimumBasicScenario-1153042250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a3790e7a-807b-4f80-af39-068cc199748e 1073741824" returned: 0 in 0.473s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:34 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d51c96d8-a4f6-4e13-a14b-fa4bca82bb8f tempest-TestMinimumBasicScenario-1153042250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a3790e7a-807b-4f80-af39-068cc199748e {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:34 devstack sudo[103268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a3790e7a-807b-4f80-af39-068cc199748e Jul 16 23:30:34 devstack sudo[103268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:34 devstack sudo[103268]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:34 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d51c96d8-a4f6-4e13-a14b-fa4bca82bb8f tempest-TestMinimumBasicScenario-1153042250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a3790e7a-807b-4f80-af39-068cc199748e" returned: 0 in 0.251s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:34 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-d51c96d8-a4f6-4e13-a14b-fa4bca82bb8f tempest-TestMinimumBasicScenario-1153042250 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:30:34 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-d51c96d8-a4f6-4e13-a14b-fa4bca82bb8f tempest-TestMinimumBasicScenario-1153042250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:30:34 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d51c96d8-a4f6-4e13-a14b-fa4bca82bb8f tempest-TestMinimumBasicScenario-1153042250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f9f5678-140d-4f22-99da-1ab51694f696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3790e7a-807b-4f80-af39-068cc199748e', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:34 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d51c96d8-a4f6-4e13-a14b-fa4bca82bb8f tempest-TestMinimumBasicScenario-1153042250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2e3711b-a88e-4a12-a346-742c1696129b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:34 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-d51c96d8-a4f6-4e13-a14b-fa4bca82bb8f tempest-TestMinimumBasicScenario-1153042250 None] Volume volume-a3790e7a-807b-4f80-af39-068cc199748e (a3790e7a-807b-4f80-af39-068cc199748e): created successfully Jul 16 23:30:34 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d51c96d8-a4f6-4e13-a14b-fa4bca82bb8f tempest-TestMinimumBasicScenario-1153042250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2e3711b-a88e-4a12-a346-742c1696129b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:34 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d51c96d8-a4f6-4e13-a14b-fa4bca82bb8f tempest-TestMinimumBasicScenario-1153042250 None] Flow 'volume_create_manager' (a5461110-88f5-422d-ab80-b35d78e42aaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:30:34 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-d51c96d8-a4f6-4e13-a14b-fa4bca82bb8f tempest-TestMinimumBasicScenario-1153042250 None] Created volume successfully. Jul 16 23:30:34 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-800d1a49-0e02-49d7-aa5b-c32fe97cc431 tempest-VolumesTransfersV355Test-414438661 None] Acquiring lock "cinder-2e4339fc-4f7f-4937-a513-b13be240906b-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:30:34 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-800d1a49-0e02-49d7-aa5b-c32fe97cc431 tempest-VolumesTransfersV355Test-414438661 None] Lock "cinder-2e4339fc-4f7f-4937-a513-b13be240906b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:30:34 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-800d1a49-0e02-49d7-aa5b-c32fe97cc431 tempest-VolumesTransfersV355Test-414438661 None] Acquiring lock "cinder-quobyte-2e4339fc-4f7f-4937-a513-b13be240906b" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:30:34 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-800d1a49-0e02-49d7-aa5b-c32fe97cc431 tempest-VolumesTransfersV355Test-414438661 None] Lock "cinder-quobyte-2e4339fc-4f7f-4937-a513-b13be240906b" acquired by "delete_volume" :: waited 0.017s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:30:34 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c9bd1b-b5a5-456d-9801-d3b3a1d274c4]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:30:34 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-800d1a49-0e02-49d7-aa5b-c32fe97cc431 tempest-VolumesTransfersV355Test-414438661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e4339fc-4f7f-4937-a513-b13be240906b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:35 devstack sudo[103271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e4339fc-4f7f-4937-a513-b13be240906b Jul 16 23:30:35 devstack sudo[103271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:35 devstack sudo[103271]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-800d1a49-0e02-49d7-aa5b-c32fe97cc431 tempest-VolumesTransfersV355Test-414438661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e4339fc-4f7f-4937-a513-b13be240906b" returned: 0 in 0.427s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-800d1a49-0e02-49d7-aa5b-c32fe97cc431 tempest-VolumesTransfersV355Test-414438661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e4339fc-4f7f-4937-a513-b13be240906b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:35 devstack sudo[103276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e4339fc-4f7f-4937-a513-b13be240906b Jul 16 23:30:35 devstack sudo[103276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:35 devstack sudo[103276]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-800d1a49-0e02-49d7-aa5b-c32fe97cc431 tempest-VolumesTransfersV355Test-414438661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2e4339fc-4f7f-4937-a513-b13be240906b" returned: 0 in 0.316s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:35 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-800d1a49-0e02-49d7-aa5b-c32fe97cc431 tempest-VolumesTransfersV355Test-414438661 None] Lock "cinder-quobyte-2e4339fc-4f7f-4937-a513-b13be240906b" released by "delete_volume" :: held 0.788s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:30:35 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-800d1a49-0e02-49d7-aa5b-c32fe97cc431 tempest-VolumesTransfersV355Test-414438661 None] Created reservations ['a6a018bd-459a-4c45-8321-6b97c82b73cb', 'ae22073b-13ba-4287-a5bd-c6f0b90565ad', '9e297819-24c1-4dc3-8bad-cb6d044ff432', '0b6f1608-de9b-4b9d-9d5d-01e37bc233b5'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:30:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-800d1a49-0e02-49d7-aa5b-c32fe97cc431 tempest-VolumesTransfersV355Test-414438661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:30:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-800d1a49-0e02-49d7-aa5b-c32fe97cc431 tempest-VolumesTransfersV355Test-414438661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:30:35 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-800d1a49-0e02-49d7-aa5b-c32fe97cc431 tempest-VolumesTransfersV355Test-414438661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:30:35 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-800d1a49-0e02-49d7-aa5b-c32fe97cc431 tempest-VolumesTransfersV355Test-414438661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:30:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-800d1a49-0e02-49d7-aa5b-c32fe97cc431 tempest-VolumesTransfersV355Test-414438661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:30:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-800d1a49-0e02-49d7-aa5b-c32fe97cc431 tempest-VolumesTransfersV355Test-414438661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:35 devstack sudo[103282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:30:35 devstack sudo[103282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:36 devstack sudo[103282]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-800d1a49-0e02-49d7-aa5b-c32fe97cc431 tempest-VolumesTransfersV355Test-414438661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.319s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:36 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-800d1a49-0e02-49d7-aa5b-c32fe97cc431 tempest-VolumesTransfersV355Test-414438661 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:30:36 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-800d1a49-0e02-49d7-aa5b-c32fe97cc431 tempest-VolumesTransfersV355Test-414438661 None] Deleted volume successfully. Jul 16 23:30:36 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-800d1a49-0e02-49d7-aa5b-c32fe97cc431 tempest-VolumesTransfersV355Test-414438661 None] Lock "cinder-2e4339fc-4f7f-4937-a513-b13be240906b-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:30:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-9571c01e-dae9-4cc6-8ef7-7d47be7b3b11 req-6231986f-b498-452e-8858-1448befd56bd tempest-TestMinimumBasicScenario-1153042250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:30:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-9571c01e-dae9-4cc6-8ef7-7d47be7b3b11 req-6231986f-b498-452e-8858-1448befd56bd tempest-TestMinimumBasicScenario-1153042250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:30:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-9571c01e-dae9-4cc6-8ef7-7d47be7b3b11 req-6231986f-b498-452e-8858-1448befd56bd tempest-TestMinimumBasicScenario-1153042250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:30:36 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-9571c01e-dae9-4cc6-8ef7-7d47be7b3b11 req-6231986f-b498-452e-8858-1448befd56bd tempest-TestMinimumBasicScenario-1153042250 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72', 'name': 'volume-a3790e7a-807b-4f80-af39-068cc199748e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a58454b4-f434-46d4-a5e9-1d780287370a', 'enforce_multipath': True} {{(pid=87607) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 23:30:36 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-9571c01e-dae9-4cc6-8ef7-7d47be7b3b11 req-6231986f-b498-452e-8858-1448befd56bd tempest-TestMinimumBasicScenario-1153042250 None] attachment_update completed successfully. Jul 16 23:30:39 devstack cinder-volume[87607]: DEBUG oslo_service.periodic_task [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:30:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:30:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:30:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:30:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:30:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:30:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:39 devstack sudo[103360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:30:39 devstack sudo[103360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:39 devstack sudo[103360]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.397s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:39 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:30:39 devstack cinder-volume[87607]: DEBUG oslo_service.periodic_task [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running periodic task VolumeManager._thread_info {{(pid=87607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:30:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] thread count: 28 {{(pid=87607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 23:30:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] thread info: [<_MainThread(MainThread, started 139090403627136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 23:30:40 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-140a3a14-8c49-494c-a890-4fbd0d29c5d5 req-5c53e6ab-1d1b-4961-9cc9-f344b2c89ad5 tempest-TestShelveInstance-125276292 None] Terminate volume connection completed successfully. Jul 16 23:30:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-140a3a14-8c49-494c-a890-4fbd0d29c5d5 req-5c53e6ab-1d1b-4961-9cc9-f344b2c89ad5 tempest-TestShelveInstance-125276292 None] Deleting attachment 91d10f72-8a51-4344-97fe-2ab96ae1af6e. {{(pid=87607) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 23:30:40 devstack cinder-volume[87607]: DEBUG cinder.coordination [req-140a3a14-8c49-494c-a890-4fbd0d29c5d5 req-8a238431-80ab-4983-87f8-07d9b62a1278 tempest-TestShelveInstance-125276292 None] Acquiring lock "cinder-173ebabb-fafd-45ec-b706-db6173da5b83-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:30:40 devstack cinder-volume[87607]: DEBUG cinder.coordination [req-140a3a14-8c49-494c-a890-4fbd0d29c5d5 req-8a238431-80ab-4983-87f8-07d9b62a1278 tempest-TestShelveInstance-125276292 None] Lock "cinder-173ebabb-fafd-45ec-b706-db6173da5b83-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:30:40 devstack cinder-volume[87607]: DEBUG cinder.coordination [req-140a3a14-8c49-494c-a890-4fbd0d29c5d5 req-8a238431-80ab-4983-87f8-07d9b62a1278 tempest-TestShelveInstance-125276292 None] Acquiring lock "cinder-quobyte-173ebabb-fafd-45ec-b706-db6173da5b83" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:30:40 devstack cinder-volume[87607]: DEBUG cinder.coordination [req-140a3a14-8c49-494c-a890-4fbd0d29c5d5 req-8a238431-80ab-4983-87f8-07d9b62a1278 tempest-TestShelveInstance-125276292 None] Lock "cinder-quobyte-173ebabb-fafd-45ec-b706-db6173da5b83" acquired by "delete_volume" :: waited 0.024s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:30:40 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c4b830-f3ac-40b4-9f5e-bcb320997f23]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:30:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-140a3a14-8c49-494c-a890-4fbd0d29c5d5 req-8a238431-80ab-4983-87f8-07d9b62a1278 tempest-TestShelveInstance-125276292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-173ebabb-fafd-45ec-b706-db6173da5b83 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:40 devstack sudo[103365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-173ebabb-fafd-45ec-b706-db6173da5b83 Jul 16 23:30:40 devstack sudo[103365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:41 devstack sudo[103365]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-140a3a14-8c49-494c-a890-4fbd0d29c5d5 req-8a238431-80ab-4983-87f8-07d9b62a1278 tempest-TestShelveInstance-125276292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-173ebabb-fafd-45ec-b706-db6173da5b83" returned: 0 in 0.583s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-140a3a14-8c49-494c-a890-4fbd0d29c5d5 req-8a238431-80ab-4983-87f8-07d9b62a1278 tempest-TestShelveInstance-125276292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-173ebabb-fafd-45ec-b706-db6173da5b83 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:41 devstack sudo[103370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-173ebabb-fafd-45ec-b706-db6173da5b83 Jul 16 23:30:41 devstack sudo[103370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:41 devstack sudo[103370]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-140a3a14-8c49-494c-a890-4fbd0d29c5d5 req-8a238431-80ab-4983-87f8-07d9b62a1278 tempest-TestShelveInstance-125276292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-173ebabb-fafd-45ec-b706-db6173da5b83" returned: 0 in 0.332s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:41 devstack cinder-volume[87607]: DEBUG cinder.coordination [req-140a3a14-8c49-494c-a890-4fbd0d29c5d5 req-8a238431-80ab-4983-87f8-07d9b62a1278 tempest-TestShelveInstance-125276292 None] Lock "cinder-quobyte-173ebabb-fafd-45ec-b706-db6173da5b83" released by "delete_volume" :: held 0.981s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:30:41 devstack cinder-volume[87607]: DEBUG cinder.quota [req-140a3a14-8c49-494c-a890-4fbd0d29c5d5 req-8a238431-80ab-4983-87f8-07d9b62a1278 tempest-TestShelveInstance-125276292 None] Created reservations ['51a0fbd6-fef3-442f-90e0-104eec71203f', '2ca40145-bcc5-4b15-878c-91dbf9bf9542', 'fee46cb6-13fd-4573-89e5-fe4fda637770', '19eab441-73a0-47d2-9adc-bba25b3a4135'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:30:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-140a3a14-8c49-494c-a890-4fbd0d29c5d5 req-8a238431-80ab-4983-87f8-07d9b62a1278 tempest-TestShelveInstance-125276292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:30:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-140a3a14-8c49-494c-a890-4fbd0d29c5d5 req-8a238431-80ab-4983-87f8-07d9b62a1278 tempest-TestShelveInstance-125276292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:30:41 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [req-140a3a14-8c49-494c-a890-4fbd0d29c5d5 req-8a238431-80ab-4983-87f8-07d9b62a1278 tempest-TestShelveInstance-125276292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:30:41 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [req-140a3a14-8c49-494c-a890-4fbd0d29c5d5 req-8a238431-80ab-4983-87f8-07d9b62a1278 tempest-TestShelveInstance-125276292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:30:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-140a3a14-8c49-494c-a890-4fbd0d29c5d5 req-8a238431-80ab-4983-87f8-07d9b62a1278 tempest-TestShelveInstance-125276292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:30:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-140a3a14-8c49-494c-a890-4fbd0d29c5d5 req-8a238431-80ab-4983-87f8-07d9b62a1278 tempest-TestShelveInstance-125276292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:42 devstack sudo[103373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:30:42 devstack sudo[103373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:42 devstack sudo[103373]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [req-140a3a14-8c49-494c-a890-4fbd0d29c5d5 req-8a238431-80ab-4983-87f8-07d9b62a1278 tempest-TestShelveInstance-125276292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.386s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:42 devstack cinder-volume[87607]: DEBUG cinder.manager [req-140a3a14-8c49-494c-a890-4fbd0d29c5d5 req-8a238431-80ab-4983-87f8-07d9b62a1278 tempest-TestShelveInstance-125276292 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:30:42 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-140a3a14-8c49-494c-a890-4fbd0d29c5d5 req-8a238431-80ab-4983-87f8-07d9b62a1278 tempest-TestShelveInstance-125276292 None] Deleted volume successfully. Jul 16 23:30:42 devstack cinder-volume[87607]: DEBUG cinder.coordination [req-140a3a14-8c49-494c-a890-4fbd0d29c5d5 req-8a238431-80ab-4983-87f8-07d9b62a1278 tempest-TestShelveInstance-125276292 None] Lock "cinder-173ebabb-fafd-45ec-b706-db6173da5b83-delete_volume" released by "delete_volume" :: held 1.869s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:30:46 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-040edb29-a200-4180-b72d-62ff3defdb97 tempest-VolumesCloneNegativeTest-910872178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:30:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-040edb29-a200-4180-b72d-62ff3defdb97 tempest-VolumesCloneNegativeTest-910872178 None] Flow 'volume_create_manager' (1fdba087-1f69-4991-a7a6-d686b64c83cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:30:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-040edb29-a200-4180-b72d-62ff3defdb97 tempest-VolumesCloneNegativeTest-910872178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (327b158a-e76a-4353-bb50-18bb5a043b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-040edb29-a200-4180-b72d-62ff3defdb97 tempest-VolumesCloneNegativeTest-910872178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (327b158a-e76a-4353-bb50-18bb5a043b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1103399573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6830a2d2-fae4-4083-9630-0fd360c1098a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa370c76258841fcb295fd2c23e5ff76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:30:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:30:47Z,use_quota=True,user_id='e9a4eb945974485bbf57cfbe65499fda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-040edb29-a200-4180-b72d-62ff3defdb97 tempest-VolumesCloneNegativeTest-910872178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4afc6906-f27b-413f-90da-2aad4dd204cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-040edb29-a200-4180-b72d-62ff3defdb97 tempest-VolumesCloneNegativeTest-910872178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4afc6906-f27b-413f-90da-2aad4dd204cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-040edb29-a200-4180-b72d-62ff3defdb97 tempest-VolumesCloneNegativeTest-910872178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f5211f3-a2dd-4d5e-8d79-4394f5d93518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-040edb29-a200-4180-b72d-62ff3defdb97 tempest-VolumesCloneNegativeTest-910872178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f5211f3-a2dd-4d5e-8d79-4394f5d93518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6830a2d2-fae4-4083-9630-0fd360c1098a', 'volume_name': 'volume-6830a2d2-fae4-4083-9630-0fd360c1098a', 'volume_size': 2}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-040edb29-a200-4180-b72d-62ff3defdb97 tempest-VolumesCloneNegativeTest-910872178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a17065c-947f-45a7-a34b-5603260c3794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-040edb29-a200-4180-b72d-62ff3defdb97 tempest-VolumesCloneNegativeTest-910872178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a17065c-947f-45a7-a34b-5603260c3794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-040edb29-a200-4180-b72d-62ff3defdb97 tempest-VolumesCloneNegativeTest-910872178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0791c90b-de9e-4a45-9cdb-a2ee0df23921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:46 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-040edb29-a200-4180-b72d-62ff3defdb97 tempest-VolumesCloneNegativeTest-910872178 None] Volume 6830a2d2-fae4-4083-9630-0fd360c1098a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6830a2d2-fae4-4083-9630-0fd360c1098a', 'volume_size': 2} Jul 16 23:30:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-040edb29-a200-4180-b72d-62ff3defdb97 tempest-VolumesCloneNegativeTest-910872178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:30:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-040edb29-a200-4180-b72d-62ff3defdb97 tempest-VolumesCloneNegativeTest-910872178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:30:46 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-040edb29-a200-4180-b72d-62ff3defdb97 tempest-VolumesCloneNegativeTest-910872178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1103399573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6830a2d2-fae4-4083-9630-0fd360c1098a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa370c76258841fcb295fd2c23e5ff76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:30:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:30:47Z,use_quota=True,user_id='e9a4eb945974485bbf57cfbe65499fda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:30:46 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-040edb29-a200-4180-b72d-62ff3defdb97 tempest-VolumesCloneNegativeTest-910872178 None] Creating volume 6830a2d2-fae4-4083-9630-0fd360c1098a {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:30:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-040edb29-a200-4180-b72d-62ff3defdb97 tempest-VolumesCloneNegativeTest-910872178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:30:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-040edb29-a200-4180-b72d-62ff3defdb97 tempest-VolumesCloneNegativeTest-910872178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:30:46 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-040edb29-a200-4180-b72d-62ff3defdb97 tempest-VolumesCloneNegativeTest-910872178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:30:46 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-040edb29-a200-4180-b72d-62ff3defdb97 tempest-VolumesCloneNegativeTest-910872178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:30:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-040edb29-a200-4180-b72d-62ff3defdb97 tempest-VolumesCloneNegativeTest-910872178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:30:46 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-040edb29-a200-4180-b72d-62ff3defdb97 tempest-VolumesCloneNegativeTest-910872178 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:30:46 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-040edb29-a200-4180-b72d-62ff3defdb97 tempest-VolumesCloneNegativeTest-910872178 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:30:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-040edb29-a200-4180-b72d-62ff3defdb97 tempest-VolumesCloneNegativeTest-910872178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6830a2d2-fae4-4083-9630-0fd360c1098a 2147483648 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:46 devstack sudo[103404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6830a2d2-fae4-4083-9630-0fd360c1098a 2147483648 Jul 16 23:30:46 devstack sudo[103404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:47 devstack sudo[103404]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-040edb29-a200-4180-b72d-62ff3defdb97 tempest-VolumesCloneNegativeTest-910872178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6830a2d2-fae4-4083-9630-0fd360c1098a 2147483648" returned: 0 in 0.596s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-040edb29-a200-4180-b72d-62ff3defdb97 tempest-VolumesCloneNegativeTest-910872178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6830a2d2-fae4-4083-9630-0fd360c1098a {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:47 devstack sudo[103411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6830a2d2-fae4-4083-9630-0fd360c1098a Jul 16 23:30:47 devstack sudo[103411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:47 devstack sudo[103411]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-040edb29-a200-4180-b72d-62ff3defdb97 tempest-VolumesCloneNegativeTest-910872178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6830a2d2-fae4-4083-9630-0fd360c1098a" returned: 0 in 0.269s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:47 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-040edb29-a200-4180-b72d-62ff3defdb97 tempest-VolumesCloneNegativeTest-910872178 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:30:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-040edb29-a200-4180-b72d-62ff3defdb97 tempest-VolumesCloneNegativeTest-910872178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:30:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-040edb29-a200-4180-b72d-62ff3defdb97 tempest-VolumesCloneNegativeTest-910872178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0791c90b-de9e-4a45-9cdb-a2ee0df23921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6830a2d2-fae4-4083-9630-0fd360c1098a', 'volume_size': 2}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-040edb29-a200-4180-b72d-62ff3defdb97 tempest-VolumesCloneNegativeTest-910872178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dffa62b-99dd-4089-8749-5c23866fdb75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:47 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-040edb29-a200-4180-b72d-62ff3defdb97 tempest-VolumesCloneNegativeTest-910872178 None] Volume volume-6830a2d2-fae4-4083-9630-0fd360c1098a (6830a2d2-fae4-4083-9630-0fd360c1098a): created successfully Jul 16 23:30:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-040edb29-a200-4180-b72d-62ff3defdb97 tempest-VolumesCloneNegativeTest-910872178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dffa62b-99dd-4089-8749-5c23866fdb75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-040edb29-a200-4180-b72d-62ff3defdb97 tempest-VolumesCloneNegativeTest-910872178 None] Flow 'volume_create_manager' (1fdba087-1f69-4991-a7a6-d686b64c83cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:30:47 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-040edb29-a200-4180-b72d-62ff3defdb97 tempest-VolumesCloneNegativeTest-910872178 None] Created volume successfully. Jul 16 23:30:48 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-815b5ca7-7a20-41c0-ab56-bb989fe4d94c tempest-VolumesCloneNegativeTest-910872178 None] Acquiring lock "cinder-6830a2d2-fae4-4083-9630-0fd360c1098a-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:30:48 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-815b5ca7-7a20-41c0-ab56-bb989fe4d94c tempest-VolumesCloneNegativeTest-910872178 None] Lock "cinder-6830a2d2-fae4-4083-9630-0fd360c1098a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:30:49 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-815b5ca7-7a20-41c0-ab56-bb989fe4d94c tempest-VolumesCloneNegativeTest-910872178 None] Acquiring lock "cinder-quobyte-6830a2d2-fae4-4083-9630-0fd360c1098a" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:30:49 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-815b5ca7-7a20-41c0-ab56-bb989fe4d94c tempest-VolumesCloneNegativeTest-910872178 None] Lock "cinder-quobyte-6830a2d2-fae4-4083-9630-0fd360c1098a" acquired by "delete_volume" :: waited 0.022s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:30:49 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3187a3-f9ca-4603-a245-ea393dc176b4]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:30:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-815b5ca7-7a20-41c0-ab56-bb989fe4d94c tempest-VolumesCloneNegativeTest-910872178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6830a2d2-fae4-4083-9630-0fd360c1098a {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:49 devstack sudo[103417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6830a2d2-fae4-4083-9630-0fd360c1098a Jul 16 23:30:49 devstack sudo[103417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:49 devstack sudo[103417]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-815b5ca7-7a20-41c0-ab56-bb989fe4d94c tempest-VolumesCloneNegativeTest-910872178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6830a2d2-fae4-4083-9630-0fd360c1098a" returned: 0 in 0.402s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-815b5ca7-7a20-41c0-ab56-bb989fe4d94c tempest-VolumesCloneNegativeTest-910872178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6830a2d2-fae4-4083-9630-0fd360c1098a {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:49 devstack sudo[103422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6830a2d2-fae4-4083-9630-0fd360c1098a Jul 16 23:30:49 devstack sudo[103422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:49 devstack sudo[103422]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-815b5ca7-7a20-41c0-ab56-bb989fe4d94c tempest-VolumesCloneNegativeTest-910872178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6830a2d2-fae4-4083-9630-0fd360c1098a" returned: 0 in 0.268s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:49 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-815b5ca7-7a20-41c0-ab56-bb989fe4d94c tempest-VolumesCloneNegativeTest-910872178 None] Lock "cinder-quobyte-6830a2d2-fae4-4083-9630-0fd360c1098a" released by "delete_volume" :: held 0.744s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:30:49 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-815b5ca7-7a20-41c0-ab56-bb989fe4d94c tempest-VolumesCloneNegativeTest-910872178 None] Created reservations ['95dca3fe-2a2a-40ad-84df-9be332d286ba', 'c092c1d6-936c-4698-abaf-185f07ae3e86', '408ad333-b22d-434a-952c-4cc90b9cc785', 'e1676e6f-9929-4ad8-97ac-c31200f7b473'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:30:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-815b5ca7-7a20-41c0-ab56-bb989fe4d94c tempest-VolumesCloneNegativeTest-910872178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:30:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-815b5ca7-7a20-41c0-ab56-bb989fe4d94c tempest-VolumesCloneNegativeTest-910872178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:30:49 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-815b5ca7-7a20-41c0-ab56-bb989fe4d94c tempest-VolumesCloneNegativeTest-910872178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:30:49 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-815b5ca7-7a20-41c0-ab56-bb989fe4d94c tempest-VolumesCloneNegativeTest-910872178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:30:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-815b5ca7-7a20-41c0-ab56-bb989fe4d94c tempest-VolumesCloneNegativeTest-910872178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:30:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-815b5ca7-7a20-41c0-ab56-bb989fe4d94c tempest-VolumesCloneNegativeTest-910872178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:49 devstack sudo[103425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:30:49 devstack sudo[103425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:50 devstack sudo[103425]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-815b5ca7-7a20-41c0-ab56-bb989fe4d94c tempest-VolumesCloneNegativeTest-910872178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.303s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:50 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-815b5ca7-7a20-41c0-ab56-bb989fe4d94c tempest-VolumesCloneNegativeTest-910872178 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:30:50 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-815b5ca7-7a20-41c0-ab56-bb989fe4d94c tempest-VolumesCloneNegativeTest-910872178 None] Deleted volume successfully. Jul 16 23:30:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-815b5ca7-7a20-41c0-ab56-bb989fe4d94c tempest-VolumesCloneNegativeTest-910872178 None] Lock "cinder-6830a2d2-fae4-4083-9630-0fd360c1098a-delete_volume" released by "delete_volume" :: held 1.287s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:30:53 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7780013-7389-43a2-820b-f1565c14d96d tempest-VolumesNegativeTest-1368639697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:30:53 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f7780013-7389-43a2-820b-f1565c14d96d tempest-VolumesNegativeTest-1368639697 None] Flow 'volume_create_manager' (3ae02403-a936-4ada-b524-95684e6bd440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:30:53 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f7780013-7389-43a2-820b-f1565c14d96d tempest-VolumesNegativeTest-1368639697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65d43fb4-565b-44d6-83c4-aa89a01fb431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:53 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f7780013-7389-43a2-820b-f1565c14d96d tempest-VolumesNegativeTest-1368639697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65d43fb4-565b-44d6-83c4-aa89a01fb431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:30:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2018854338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53a82aa0-17f6-4f0b-bcc7-ae42e484ed57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebbb9e99a6da4424801b8d07cac4c2f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:30:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:30:54Z,use_quota=True,user_id='effa9698887246cea6f4d691d60a12e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:54 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f7780013-7389-43a2-820b-f1565c14d96d tempest-VolumesNegativeTest-1368639697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (880b30ee-eaf3-47c1-a220-c312d41e51ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:54 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f7780013-7389-43a2-820b-f1565c14d96d tempest-VolumesNegativeTest-1368639697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (880b30ee-eaf3-47c1-a220-c312d41e51ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:54 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f7780013-7389-43a2-820b-f1565c14d96d tempest-VolumesNegativeTest-1368639697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (147e185c-beb1-410d-9b1c-ce6aced85584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:54 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f7780013-7389-43a2-820b-f1565c14d96d tempest-VolumesNegativeTest-1368639697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (147e185c-beb1-410d-9b1c-ce6aced85584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53a82aa0-17f6-4f0b-bcc7-ae42e484ed57', 'volume_name': 'volume-53a82aa0-17f6-4f0b-bcc7-ae42e484ed57', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:54 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f7780013-7389-43a2-820b-f1565c14d96d tempest-VolumesNegativeTest-1368639697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdc6d56f-a2ea-49f4-bc11-0f570d58a298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:54 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f7780013-7389-43a2-820b-f1565c14d96d tempest-VolumesNegativeTest-1368639697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdc6d56f-a2ea-49f4-bc11-0f570d58a298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:54 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f7780013-7389-43a2-820b-f1565c14d96d tempest-VolumesNegativeTest-1368639697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cad07ef6-a954-430b-a76e-52e9ccd76b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:54 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-f7780013-7389-43a2-820b-f1565c14d96d tempest-VolumesNegativeTest-1368639697 None] Volume 53a82aa0-17f6-4f0b-bcc7-ae42e484ed57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53a82aa0-17f6-4f0b-bcc7-ae42e484ed57', 'volume_size': 1} Jul 16 23:30:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f7780013-7389-43a2-820b-f1565c14d96d tempest-VolumesNegativeTest-1368639697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:30:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f7780013-7389-43a2-820b-f1565c14d96d tempest-VolumesNegativeTest-1368639697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:30:54 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f7780013-7389-43a2-820b-f1565c14d96d tempest-VolumesNegativeTest-1368639697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:30:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2018854338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53a82aa0-17f6-4f0b-bcc7-ae42e484ed57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebbb9e99a6da4424801b8d07cac4c2f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:30:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:30:54Z,use_quota=True,user_id='effa9698887246cea6f4d691d60a12e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:30:54 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-f7780013-7389-43a2-820b-f1565c14d96d tempest-VolumesNegativeTest-1368639697 None] Creating volume 53a82aa0-17f6-4f0b-bcc7-ae42e484ed57 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:30:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f7780013-7389-43a2-820b-f1565c14d96d tempest-VolumesNegativeTest-1368639697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:30:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f7780013-7389-43a2-820b-f1565c14d96d tempest-VolumesNegativeTest-1368639697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:30:54 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f7780013-7389-43a2-820b-f1565c14d96d tempest-VolumesNegativeTest-1368639697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:30:54 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f7780013-7389-43a2-820b-f1565c14d96d tempest-VolumesNegativeTest-1368639697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:30:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f7780013-7389-43a2-820b-f1565c14d96d tempest-VolumesNegativeTest-1368639697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:30:54 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f7780013-7389-43a2-820b-f1565c14d96d tempest-VolumesNegativeTest-1368639697 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:30:54 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-f7780013-7389-43a2-820b-f1565c14d96d tempest-VolumesNegativeTest-1368639697 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:30:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f7780013-7389-43a2-820b-f1565c14d96d tempest-VolumesNegativeTest-1368639697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-53a82aa0-17f6-4f0b-bcc7-ae42e484ed57 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:54 devstack sudo[103437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-53a82aa0-17f6-4f0b-bcc7-ae42e484ed57 1073741824 Jul 16 23:30:54 devstack sudo[103437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:54 devstack sudo[103437]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f7780013-7389-43a2-820b-f1565c14d96d tempest-VolumesNegativeTest-1368639697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-53a82aa0-17f6-4f0b-bcc7-ae42e484ed57 1073741824" returned: 0 in 0.477s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f7780013-7389-43a2-820b-f1565c14d96d tempest-VolumesNegativeTest-1368639697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-53a82aa0-17f6-4f0b-bcc7-ae42e484ed57 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:54 devstack sudo[103443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-53a82aa0-17f6-4f0b-bcc7-ae42e484ed57 Jul 16 23:30:54 devstack sudo[103443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:54 devstack sudo[103443]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f7780013-7389-43a2-820b-f1565c14d96d tempest-VolumesNegativeTest-1368639697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-53a82aa0-17f6-4f0b-bcc7-ae42e484ed57" returned: 0 in 0.289s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:54 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f7780013-7389-43a2-820b-f1565c14d96d tempest-VolumesNegativeTest-1368639697 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:30:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f7780013-7389-43a2-820b-f1565c14d96d tempest-VolumesNegativeTest-1368639697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:30:54 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f7780013-7389-43a2-820b-f1565c14d96d tempest-VolumesNegativeTest-1368639697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cad07ef6-a954-430b-a76e-52e9ccd76b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53a82aa0-17f6-4f0b-bcc7-ae42e484ed57', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:54 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f7780013-7389-43a2-820b-f1565c14d96d tempest-VolumesNegativeTest-1368639697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfdfafd8-9bf1-4fc5-8704-bbc3c29bc90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:54 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-f7780013-7389-43a2-820b-f1565c14d96d tempest-VolumesNegativeTest-1368639697 None] Volume volume-53a82aa0-17f6-4f0b-bcc7-ae42e484ed57 (53a82aa0-17f6-4f0b-bcc7-ae42e484ed57): created successfully Jul 16 23:30:54 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f7780013-7389-43a2-820b-f1565c14d96d tempest-VolumesNegativeTest-1368639697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfdfafd8-9bf1-4fc5-8704-bbc3c29bc90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:54 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f7780013-7389-43a2-820b-f1565c14d96d tempest-VolumesNegativeTest-1368639697 None] Flow 'volume_create_manager' (3ae02403-a936-4ada-b524-95684e6bd440) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:30:54 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-f7780013-7389-43a2-820b-f1565c14d96d tempest-VolumesNegativeTest-1368639697 None] Created volume successfully. Jul 16 23:30:55 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-e73924b6-3878-48a7-8651-bd5c1c327ab7 tempest-VolumeDependencyTests-310975390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:30:55 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e73924b6-3878-48a7-8651-bd5c1c327ab7 tempest-VolumeDependencyTests-310975390 None] Flow 'volume_create_manager' (47f16070-1e15-45d2-9539-8b3bf68350aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:30:55 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e73924b6-3878-48a7-8651-bd5c1c327ab7 tempest-VolumeDependencyTests-310975390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af5b855-f3ce-40be-b10c-6a904e50aa6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:55 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e73924b6-3878-48a7-8651-bd5c1c327ab7 tempest-VolumeDependencyTests-310975390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af5b855-f3ce-40be-b10c-6a904e50aa6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1161237694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12ced06d-0edb-49ce-9764-1f0a29a79b4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cf45c5d4a6e444b902c6f1f9f7cd7e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:30:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:30:55Z,use_quota=True,user_id='35cc0325a4f743e3bb879f9a1fec3ac6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:55 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e73924b6-3878-48a7-8651-bd5c1c327ab7 tempest-VolumeDependencyTests-310975390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85aab893-6d29-485d-909e-cc8804c9c670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:55 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e73924b6-3878-48a7-8651-bd5c1c327ab7 tempest-VolumeDependencyTests-310975390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85aab893-6d29-485d-909e-cc8804c9c670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:55 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e73924b6-3878-48a7-8651-bd5c1c327ab7 tempest-VolumeDependencyTests-310975390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c717ea39-d114-4367-bce8-6a6a72d9dff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:55 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e73924b6-3878-48a7-8651-bd5c1c327ab7 tempest-VolumeDependencyTests-310975390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c717ea39-d114-4367-bce8-6a6a72d9dff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12ced06d-0edb-49ce-9764-1f0a29a79b4f', 'volume_name': 'volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:55 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e73924b6-3878-48a7-8651-bd5c1c327ab7 tempest-VolumeDependencyTests-310975390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c800b15f-f862-426d-a47f-33c7ef09b70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:55 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e73924b6-3878-48a7-8651-bd5c1c327ab7 tempest-VolumeDependencyTests-310975390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c800b15f-f862-426d-a47f-33c7ef09b70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:55 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e73924b6-3878-48a7-8651-bd5c1c327ab7 tempest-VolumeDependencyTests-310975390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8de7809f-0527-4cc2-b156-667a0c2508a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:55 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-e73924b6-3878-48a7-8651-bd5c1c327ab7 tempest-VolumeDependencyTests-310975390 None] Volume 12ced06d-0edb-49ce-9764-1f0a29a79b4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f', 'volume_size': 1} Jul 16 23:30:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e73924b6-3878-48a7-8651-bd5c1c327ab7 tempest-VolumeDependencyTests-310975390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:30:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e73924b6-3878-48a7-8651-bd5c1c327ab7 tempest-VolumeDependencyTests-310975390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:30:55 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e73924b6-3878-48a7-8651-bd5c1c327ab7 tempest-VolumeDependencyTests-310975390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1161237694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12ced06d-0edb-49ce-9764-1f0a29a79b4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cf45c5d4a6e444b902c6f1f9f7cd7e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:30:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:30:55Z,use_quota=True,user_id='35cc0325a4f743e3bb879f9a1fec3ac6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:30:55 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-e73924b6-3878-48a7-8651-bd5c1c327ab7 tempest-VolumeDependencyTests-310975390 None] Creating volume 12ced06d-0edb-49ce-9764-1f0a29a79b4f {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:30:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e73924b6-3878-48a7-8651-bd5c1c327ab7 tempest-VolumeDependencyTests-310975390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:30:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e73924b6-3878-48a7-8651-bd5c1c327ab7 tempest-VolumeDependencyTests-310975390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:30:55 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e73924b6-3878-48a7-8651-bd5c1c327ab7 tempest-VolumeDependencyTests-310975390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:30:55 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e73924b6-3878-48a7-8651-bd5c1c327ab7 tempest-VolumeDependencyTests-310975390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:30:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e73924b6-3878-48a7-8651-bd5c1c327ab7 tempest-VolumeDependencyTests-310975390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:30:55 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e73924b6-3878-48a7-8651-bd5c1c327ab7 tempest-VolumeDependencyTests-310975390 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:30:55 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-e73924b6-3878-48a7-8651-bd5c1c327ab7 tempest-VolumeDependencyTests-310975390 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:30:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e73924b6-3878-48a7-8651-bd5c1c327ab7 tempest-VolumeDependencyTests-310975390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:55 devstack sudo[103446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f 1073741824 Jul 16 23:30:55 devstack sudo[103446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:55 devstack sudo[103446]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e73924b6-3878-48a7-8651-bd5c1c327ab7 tempest-VolumeDependencyTests-310975390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f 1073741824" returned: 0 in 0.407s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e73924b6-3878-48a7-8651-bd5c1c327ab7 tempest-VolumeDependencyTests-310975390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:55 devstack sudo[103451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f Jul 16 23:30:55 devstack sudo[103451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:56 devstack sudo[103451]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e73924b6-3878-48a7-8651-bd5c1c327ab7 tempest-VolumeDependencyTests-310975390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f" returned: 0 in 0.266s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:56 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e73924b6-3878-48a7-8651-bd5c1c327ab7 tempest-VolumeDependencyTests-310975390 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:30:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e73924b6-3878-48a7-8651-bd5c1c327ab7 tempest-VolumeDependencyTests-310975390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:30:56 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e73924b6-3878-48a7-8651-bd5c1c327ab7 tempest-VolumeDependencyTests-310975390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8de7809f-0527-4cc2-b156-667a0c2508a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:56 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e73924b6-3878-48a7-8651-bd5c1c327ab7 tempest-VolumeDependencyTests-310975390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dfad429-48da-4532-bf1b-0dfa7b2a3708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:30:56 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-e73924b6-3878-48a7-8651-bd5c1c327ab7 tempest-VolumeDependencyTests-310975390 None] Volume volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f (12ced06d-0edb-49ce-9764-1f0a29a79b4f): created successfully Jul 16 23:30:56 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e73924b6-3878-48a7-8651-bd5c1c327ab7 tempest-VolumeDependencyTests-310975390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dfad429-48da-4532-bf1b-0dfa7b2a3708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:30:56 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e73924b6-3878-48a7-8651-bd5c1c327ab7 tempest-VolumeDependencyTests-310975390 None] Flow 'volume_create_manager' (47f16070-1e15-45d2-9539-8b3bf68350aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:30:56 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-e73924b6-3878-48a7-8651-bd5c1c327ab7 tempest-VolumeDependencyTests-310975390 None] Created volume successfully. Jul 16 23:30:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7b0d4012-c85d-4e17-9ae7-5153fda155d4 tempest-VolumeDependencyTests-310975390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:30:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7b0d4012-c85d-4e17-9ae7-5153fda155d4 tempest-VolumeDependencyTests-310975390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:30:56 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-7b0d4012-c85d-4e17-9ae7-5153fda155d4 tempest-VolumeDependencyTests-310975390 None] Creating offline snapshot 0aeb7154-3753-4ec3-bedc-00abd01266ca of volume 12ced06d-0edb-49ce-9764-1f0a29a79b4f {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:30:56 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5060403-4913-435e-8749-e17eb9bfba3c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:30:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7b0d4012-c85d-4e17-9ae7-5153fda155d4 tempest-VolumeDependencyTests-310975390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:56 devstack sudo[103460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f Jul 16 23:30:56 devstack sudo[103460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:57 devstack sudo[103460]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7b0d4012-c85d-4e17-9ae7-5153fda155d4 tempest-VolumeDependencyTests-310975390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f" returned: 0 in 0.400s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7b0d4012-c85d-4e17-9ae7-5153fda155d4 tempest-VolumeDependencyTests-310975390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f.0aeb7154-3753-4ec3-bedc-00abd01266ca 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:57 devstack sudo[103468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f.0aeb7154-3753-4ec3-bedc-00abd01266ca 1G Jul 16 23:30:57 devstack sudo[103468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:57 devstack sudo[103468]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7b0d4012-c85d-4e17-9ae7-5153fda155d4 tempest-VolumeDependencyTests-310975390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f.0aeb7154-3753-4ec3-bedc-00abd01266ca 1G" returned: 0 in 0.529s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7b0d4012-c85d-4e17-9ae7-5153fda155d4 tempest-VolumeDependencyTests-310975390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f.0aeb7154-3753-4ec3-bedc-00abd01266ca {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:57 devstack sudo[103486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f.0aeb7154-3753-4ec3-bedc-00abd01266ca Jul 16 23:30:57 devstack sudo[103486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:58 devstack sudo[103486]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7b0d4012-c85d-4e17-9ae7-5153fda155d4 tempest-VolumeDependencyTests-310975390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f.0aeb7154-3753-4ec3-bedc-00abd01266ca" returned: 0 in 0.475s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:58 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-7b0d4012-c85d-4e17-9ae7-5153fda155d4 tempest-VolumeDependencyTests-310975390 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f.0aeb7154-3753-4ec3-bedc-00abd01266ca is being set with open permissions: ugo+rw Jul 16 23:30:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7b0d4012-c85d-4e17-9ae7-5153fda155d4 tempest-VolumeDependencyTests-310975390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f.0aeb7154-3753-4ec3-bedc-00abd01266ca {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:58 devstack sudo[103501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f.0aeb7154-3753-4ec3-bedc-00abd01266ca Jul 16 23:30:58 devstack sudo[103501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:58 devstack sudo[103501]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7b0d4012-c85d-4e17-9ae7-5153fda155d4 tempest-VolumeDependencyTests-310975390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f.0aeb7154-3753-4ec3-bedc-00abd01266ca" returned: 0 in 0.297s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7b0d4012-c85d-4e17-9ae7-5153fda155d4 tempest-VolumeDependencyTests-310975390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:58 devstack sudo[103510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f.info Jul 16 23:30:58 devstack sudo[103510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:59 devstack sudo[103510]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7b0d4012-c85d-4e17-9ae7-5153fda155d4 tempest-VolumeDependencyTests-310975390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f.info" returned: 0 in 0.568s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:59 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-7b0d4012-c85d-4e17-9ae7-5153fda155d4 tempest-VolumeDependencyTests-310975390 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f.info is being set with open permissions: ugo+rw Jul 16 23:30:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7b0d4012-c85d-4e17-9ae7-5153fda155d4 tempest-VolumeDependencyTests-310975390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:30:59 devstack sudo[103527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f.info Jul 16 23:30:59 devstack sudo[103527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:30:59 devstack sudo[103527]: pam_unix(sudo:session): session closed for user root Jul 16 23:30:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7b0d4012-c85d-4e17-9ae7-5153fda155d4 tempest-VolumeDependencyTests-310975390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f.info" returned: 0 in 0.566s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:30:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7b0d4012-c85d-4e17-9ae7-5153fda155d4 tempest-VolumeDependencyTests-310975390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.990s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:30:59 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-7b0d4012-c85d-4e17-9ae7-5153fda155d4 tempest-VolumeDependencyTests-310975390 None] Create snapshot completed successfully Jul 16 23:31:00 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:31:00 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Flow 'volume_create_manager' (d2ca147a-cc9c-4762-a9b8-4fe76211b1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:31:00 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cd44570-0261-49cd-8da1-ab37f76cb23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:00 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cd44570-0261-49cd-8da1-ab37f76cb23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1333670640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9cee980-e2e2-4dd9-8752-72be62cb4fa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cf45c5d4a6e444b902c6f1f9f7cd7e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0aeb7154-3753-4ec3-bedc-00abd01266ca,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:31:01Z,use_quota=True,user_id='35cc0325a4f743e3bb879f9a1fec3ac6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6e805bc-02cd-45f3-a9fb-131c15a2749e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6e805bc-02cd-45f3-a9fb-131c15a2749e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dfeff47-aac2-4cd5-9b8b-416469d3521c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dfeff47-aac2-4cd5-9b8b-416469d3521c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd9cee980-e2e2-4dd9-8752-72be62cb4fa4', 'volume_name': 'volume-d9cee980-e2e2-4dd9-8752-72be62cb4fa4', 'volume_size': 1, 'snapshot_id': '0aeb7154-3753-4ec3-bedc-00abd01266ca'}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35025002-5f2f-4400-bb79-56248cf5f45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35025002-5f2f-4400-bb79-56248cf5f45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1938bf4-fff1-4684-8a05-cf336bab5785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:01 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Volume d9cee980-e2e2-4dd9-8752-72be62cb4fa4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d9cee980-e2e2-4dd9-8752-72be62cb4fa4', 'volume_size': 1, 'snapshot_id': '0aeb7154-3753-4ec3-bedc-00abd01266ca'} Jul 16 23:31:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:31:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:31:01 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Acquiring lock "cinder-quobyte-0aeb7154-3753-4ec3-bedc-00abd01266ca-d9cee980-e2e2-4dd9-8752-72be62cb4fa4" by "_create_volume_from_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:31:01 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Lock "cinder-quobyte-0aeb7154-3753-4ec3-bedc-00abd01266ca-d9cee980-e2e2-4dd9-8752-72be62cb4fa4" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:31:01 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Creating volume d9cee980-e2e2-4dd9-8752-72be62cb4fa4 from snapshot 0aeb7154-3753-4ec3-bedc-00abd01266ca {{(pid=87607) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 16 23:31:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:31:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:31:01 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:31:01 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:31:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:31:01 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:31:01 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Acquiring lock "cinder-quobyte-d9cee980-e2e2-4dd9-8752-72be62cb4fa4" by "_copy_volume_from_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:31:01 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Lock "cinder-quobyte-d9cee980-e2e2-4dd9-8752-72be62cb4fa4" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:31:01 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] snapshot: 0aeb7154-3753-4ec3-bedc-00abd01266ca, volume: d9cee980-e2e2-4dd9-8752-72be62cb4fa4, {{(pid=87607) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 16 23:31:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:31:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:31:01 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:31:01 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:31:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:31:01 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0224a2-4f47-45e4-bf46-5cf9acea3dcb]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:31:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f.0aeb7154-3753-4ec3-bedc-00abd01266ca {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:01 devstack sudo[103541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f.0aeb7154-3753-4ec3-bedc-00abd01266ca Jul 16 23:31:01 devstack sudo[103541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:01 devstack sudo[103541]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f.0aeb7154-3753-4ec3-bedc-00abd01266ca" returned: 0 in 0.460s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:01 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:31:01 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f {{(pid=87607) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 16 23:31:01 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Creating direct copy from snapshot {{(pid=87607) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 16 23:31:01 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[754f8767-9fbb-4aa6-8b96-0463a133d1b6]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:31:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:01 devstack sudo[103547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f Jul 16 23:31:01 devstack sudo[103547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:02 devstack sudo[103547]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f" returned: 0 in 0.889s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:02 devstack cinder-volume[87607]: DEBUG cinder.utils [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Path /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9cee980-e2e2-4dd9-8752-72be62cb4fa4 not found in is_blk_device check {{(pid=87607) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 16 23:31:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9cee980-e2e2-4dd9-8752-72be62cb4fa4 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:02 devstack sudo[103592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9cee980-e2e2-4dd9-8752-72be62cb4fa4 Jul 16 23:31:02 devstack sudo[103592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:10 devstack sudo[103592]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9cee980-e2e2-4dd9-8752-72be62cb4fa4" returned: 0 in 8.381s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:10 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2715d40-8152-45f4-977a-b8448c8e8c17]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:31:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:11 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:SELECT=40,cinder:INSERT=11,cinder:UPDATE=58,cinder:DELETE=7 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:31:11 devstack sudo[103654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f Jul 16 23:31:11 devstack sudo[103654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:11 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:SELECT=51,cinder:UPDATE=49,cinder:DELETE=4,cinder:INSERT=12 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:31:11 devstack sudo[103654]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f" returned: 0 in 0.590s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:11 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Image conversion details: src /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f, size 1024.00 MB, duration 8.38 sec, destination /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9cee980-e2e2-4dd9-8752-72be62cb4fa4 {{(pid=87607) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 23:31:11 devstack cinder-volume[87607]: INFO cinder.image.image_utils [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Converted 1024.00 MB image at 122.16 MB/s Jul 16 23:31:11 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9cee980-e2e2-4dd9-8752-72be62cb4fa4 is being set with open permissions: ugo+rw Jul 16 23:31:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9cee980-e2e2-4dd9-8752-72be62cb4fa4 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:11 devstack sudo[103660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9cee980-e2e2-4dd9-8752-72be62cb4fa4 Jul 16 23:31:11 devstack sudo[103660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:11 devstack sudo[103660]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9cee980-e2e2-4dd9-8752-72be62cb4fa4" returned: 0 in 0.296s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:11 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Lock "cinder-quobyte-d9cee980-e2e2-4dd9-8752-72be62cb4fa4" released by "_copy_volume_from_snapshot" :: held 10.781s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:31:11 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Lock "cinder-quobyte-0aeb7154-3753-4ec3-bedc-00abd01266ca-d9cee980-e2e2-4dd9-8752-72be62cb4fa4" released by "_create_volume_from_snapshot" :: held 10.820s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:31:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.842s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:31:11 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1938bf4-fff1-4684-8a05-cf336bab5785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9cee980-e2e2-4dd9-8752-72be62cb4fa4', 'volume_size': 1, 'snapshot_id': '0aeb7154-3753-4ec3-bedc-00abd01266ca'}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:11 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4f60192-9674-4907-a753-888a88d2e467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:11 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Volume volume-d9cee980-e2e2-4dd9-8752-72be62cb4fa4 (d9cee980-e2e2-4dd9-8752-72be62cb4fa4): created successfully Jul 16 23:31:11 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4f60192-9674-4907-a753-888a88d2e467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:11 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Flow 'volume_create_manager' (d2ca147a-cc9c-4762-a9b8-4fe76211b1c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:31:11 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-b6467ec0-1365-444a-826b-597d9fc5194b tempest-VolumeDependencyTests-310975390 None] Created volume successfully. Jul 16 23:31:12 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c2618b83-9ef2-41b1-9bf7-3d54b1e67846 tempest-VolumeDependencyTests-310975390 None] Acquiring lock "cinder-0aeb7154-3753-4ec3-bedc-00abd01266ca-delete_snapshot" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:31:12 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c2618b83-9ef2-41b1-9bf7-3d54b1e67846 tempest-VolumeDependencyTests-310975390 None] Lock "cinder-0aeb7154-3753-4ec3-bedc-00abd01266ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:31:12 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c2618b83-9ef2-41b1-9bf7-3d54b1e67846 tempest-VolumeDependencyTests-310975390 None] Acquiring lock "cinder-quobyte-12ced06d-0edb-49ce-9764-1f0a29a79b4f" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:31:12 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c2618b83-9ef2-41b1-9bf7-3d54b1e67846 tempest-VolumeDependencyTests-310975390 None] Lock "cinder-quobyte-12ced06d-0edb-49ce-9764-1f0a29a79b4f" acquired by "delete_snapshot" :: waited 0.012s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:31:12 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c2618b83-9ef2-41b1-9bf7-3d54b1e67846 tempest-VolumeDependencyTests-310975390 None] Acquiring lock "cinder-quobyte-0aeb7154-3753-4ec3-bedc-00abd01266ca" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:31:12 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c2618b83-9ef2-41b1-9bf7-3d54b1e67846 tempest-VolumeDependencyTests-310975390 None] Lock "cinder-quobyte-0aeb7154-3753-4ec3-bedc-00abd01266ca" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:31:12 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-c2618b83-9ef2-41b1-9bf7-3d54b1e67846 tempest-VolumeDependencyTests-310975390 None] Deleting offline snapshot 0aeb7154-3753-4ec3-bedc-00abd01266ca of volume 12ced06d-0edb-49ce-9764-1f0a29a79b4f {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:31:12 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-c2618b83-9ef2-41b1-9bf7-3d54b1e67846 tempest-VolumeDependencyTests-310975390 None] snapshot_file for this snap is: volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f.0aeb7154-3753-4ec3-bedc-00abd01266ca {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:31:12 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc6e5ed-20cd-433f-8dd6-c47f1f72a748]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:31:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c2618b83-9ef2-41b1-9bf7-3d54b1e67846 tempest-VolumeDependencyTests-310975390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f.0aeb7154-3753-4ec3-bedc-00abd01266ca {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:12 devstack sudo[103672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f.0aeb7154-3753-4ec3-bedc-00abd01266ca Jul 16 23:31:12 devstack sudo[103672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:13 devstack sudo[103672]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c2618b83-9ef2-41b1-9bf7-3d54b1e67846 tempest-VolumeDependencyTests-310975390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f.0aeb7154-3753-4ec3-bedc-00abd01266ca" returned: 0 in 0.394s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:13 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-c2618b83-9ef2-41b1-9bf7-3d54b1e67846 tempest-VolumeDependencyTests-310975390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:31:13 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed311e7c-bbc9-4a0d-b2ff-9e2e6a6b6a27]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:31:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c2618b83-9ef2-41b1-9bf7-3d54b1e67846 tempest-VolumeDependencyTests-310975390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:13 devstack sudo[103678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f Jul 16 23:31:13 devstack sudo[103678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:13 devstack sudo[103678]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c2618b83-9ef2-41b1-9bf7-3d54b1e67846 tempest-VolumeDependencyTests-310975390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f" returned: 0 in 0.364s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c2618b83-9ef2-41b1-9bf7-3d54b1e67846 tempest-VolumeDependencyTests-310975390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f.0aeb7154-3753-4ec3-bedc-00abd01266ca {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:13 devstack sudo[103683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f.0aeb7154-3753-4ec3-bedc-00abd01266ca Jul 16 23:31:13 devstack sudo[103683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:13 devstack sudo[103683]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c2618b83-9ef2-41b1-9bf7-3d54b1e67846 tempest-VolumeDependencyTests-310975390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f.0aeb7154-3753-4ec3-bedc-00abd01266ca" returned: 0 in 0.346s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c2618b83-9ef2-41b1-9bf7-3d54b1e67846 tempest-VolumeDependencyTests-310975390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f.0aeb7154-3753-4ec3-bedc-00abd01266ca {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:13 devstack sudo[103688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f.0aeb7154-3753-4ec3-bedc-00abd01266ca Jul 16 23:31:13 devstack sudo[103688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:14 devstack sudo[103688]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c2618b83-9ef2-41b1-9bf7-3d54b1e67846 tempest-VolumeDependencyTests-310975390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f.0aeb7154-3753-4ec3-bedc-00abd01266ca" returned: 0 in 0.240s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:14 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c2618b83-9ef2-41b1-9bf7-3d54b1e67846 tempest-VolumeDependencyTests-310975390 None] Lock "cinder-quobyte-0aeb7154-3753-4ec3-bedc-00abd01266ca" released by "_delete_snapshot" :: held 1.447s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:31:14 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c2618b83-9ef2-41b1-9bf7-3d54b1e67846 tempest-VolumeDependencyTests-310975390 None] Lock "cinder-quobyte-12ced06d-0edb-49ce-9764-1f0a29a79b4f" released by "delete_snapshot" :: held 1.467s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:31:14 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-c2618b83-9ef2-41b1-9bf7-3d54b1e67846 tempest-VolumeDependencyTests-310975390 None] Created reservations ['764c9973-2d40-48bf-a85c-d6aa3d2a2f9a', '167fdfad-bddb-4f1d-b9e6-0cad76e98c62', '63d5ce9a-2281-4e76-a9c1-482662f741cb', '98c6d6d2-6b32-4eea-8be7-0f8f9c022381'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:31:14 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-c2618b83-9ef2-41b1-9bf7-3d54b1e67846 tempest-VolumeDependencyTests-310975390 None] Delete snapshot completed successfully. Jul 16 23:31:14 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c2618b83-9ef2-41b1-9bf7-3d54b1e67846 tempest-VolumeDependencyTests-310975390 None] Lock "cinder-0aeb7154-3753-4ec3-bedc-00abd01266ca-delete_snapshot" released by "delete_snapshot" :: held 1.601s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:31:14 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1427bf15-2851-4299-824c-1a9b8ff0084a tempest-VolumeDependencyTests-310975390 None] Acquiring lock "cinder-12ced06d-0edb-49ce-9764-1f0a29a79b4f-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:31:14 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1427bf15-2851-4299-824c-1a9b8ff0084a tempest-VolumeDependencyTests-310975390 None] Lock "cinder-12ced06d-0edb-49ce-9764-1f0a29a79b4f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:31:14 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1427bf15-2851-4299-824c-1a9b8ff0084a tempest-VolumeDependencyTests-310975390 None] Acquiring lock "cinder-quobyte-12ced06d-0edb-49ce-9764-1f0a29a79b4f" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:31:14 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1427bf15-2851-4299-824c-1a9b8ff0084a tempest-VolumeDependencyTests-310975390 None] Lock "cinder-quobyte-12ced06d-0edb-49ce-9764-1f0a29a79b4f" acquired by "delete_volume" :: waited 0.018s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:31:15 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[92efa5d8-332f-4558-abec-e3b021c19251]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:31:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1427bf15-2851-4299-824c-1a9b8ff0084a tempest-VolumeDependencyTests-310975390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:15 devstack sudo[103693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f Jul 16 23:31:15 devstack sudo[103693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:15 devstack sudo[103693]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1427bf15-2851-4299-824c-1a9b8ff0084a tempest-VolumeDependencyTests-310975390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f" returned: 0 in 0.367s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1427bf15-2851-4299-824c-1a9b8ff0084a tempest-VolumeDependencyTests-310975390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:15 devstack sudo[103699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f Jul 16 23:31:15 devstack sudo[103699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:15 devstack sudo[103699]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1427bf15-2851-4299-824c-1a9b8ff0084a tempest-VolumeDependencyTests-310975390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-12ced06d-0edb-49ce-9764-1f0a29a79b4f" returned: 0 in 0.256s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:15 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1427bf15-2851-4299-824c-1a9b8ff0084a tempest-VolumeDependencyTests-310975390 None] Lock "cinder-quobyte-12ced06d-0edb-49ce-9764-1f0a29a79b4f" released by "delete_volume" :: held 0.690s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:31:15 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-1427bf15-2851-4299-824c-1a9b8ff0084a tempest-VolumeDependencyTests-310975390 None] Created reservations ['c0c5074c-fc7d-41b8-b5f5-c0a5fcff1580', 'd2939796-4025-412c-8bde-6342c1347136', '18443c39-deb4-4aa0-8213-c6d153bdcc0c', '2a0495c1-9cb1-47b9-9ee4-22875aae704e'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:31:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1427bf15-2851-4299-824c-1a9b8ff0084a tempest-VolumeDependencyTests-310975390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:31:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1427bf15-2851-4299-824c-1a9b8ff0084a tempest-VolumeDependencyTests-310975390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:31:15 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1427bf15-2851-4299-824c-1a9b8ff0084a tempest-VolumeDependencyTests-310975390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:31:15 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1427bf15-2851-4299-824c-1a9b8ff0084a tempest-VolumeDependencyTests-310975390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:31:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1427bf15-2851-4299-824c-1a9b8ff0084a tempest-VolumeDependencyTests-310975390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:31:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1427bf15-2851-4299-824c-1a9b8ff0084a tempest-VolumeDependencyTests-310975390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:15 devstack sudo[103703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:31:15 devstack sudo[103703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:16 devstack sudo[103703]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:16 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-3db008e9-e413-4e50-a7d1-ca0926a81e2a tempest-VolumeDependencyTests-310975390 None] Acquiring lock "cinder-d9cee980-e2e2-4dd9-8752-72be62cb4fa4-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:31:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1427bf15-2851-4299-824c-1a9b8ff0084a tempest-VolumeDependencyTests-310975390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.267s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:16 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-1427bf15-2851-4299-824c-1a9b8ff0084a tempest-VolumeDependencyTests-310975390 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:31:16 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-1427bf15-2851-4299-824c-1a9b8ff0084a tempest-VolumeDependencyTests-310975390 None] Deleted volume successfully. Jul 16 23:31:16 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-3db008e9-e413-4e50-a7d1-ca0926a81e2a tempest-VolumeDependencyTests-310975390 None] Lock "cinder-d9cee980-e2e2-4dd9-8752-72be62cb4fa4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:31:16 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1427bf15-2851-4299-824c-1a9b8ff0084a tempest-VolumeDependencyTests-310975390 None] Lock "cinder-12ced06d-0edb-49ce-9764-1f0a29a79b4f-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:31:16 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-3db008e9-e413-4e50-a7d1-ca0926a81e2a tempest-VolumeDependencyTests-310975390 None] Acquiring lock "cinder-quobyte-d9cee980-e2e2-4dd9-8752-72be62cb4fa4" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:31:16 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-3db008e9-e413-4e50-a7d1-ca0926a81e2a tempest-VolumeDependencyTests-310975390 None] Lock "cinder-quobyte-d9cee980-e2e2-4dd9-8752-72be62cb4fa4" acquired by "delete_volume" :: waited 0.016s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:31:16 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[9244305f-d7cd-4c1a-8674-f6c058f2e7f0]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:31:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3db008e9-e413-4e50-a7d1-ca0926a81e2a tempest-VolumeDependencyTests-310975390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9cee980-e2e2-4dd9-8752-72be62cb4fa4 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:16 devstack sudo[103706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9cee980-e2e2-4dd9-8752-72be62cb4fa4 Jul 16 23:31:16 devstack sudo[103706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:16 devstack sudo[103706]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3db008e9-e413-4e50-a7d1-ca0926a81e2a tempest-VolumeDependencyTests-310975390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9cee980-e2e2-4dd9-8752-72be62cb4fa4" returned: 0 in 0.365s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3db008e9-e413-4e50-a7d1-ca0926a81e2a tempest-VolumeDependencyTests-310975390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9cee980-e2e2-4dd9-8752-72be62cb4fa4 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:16 devstack sudo[103711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9cee980-e2e2-4dd9-8752-72be62cb4fa4 Jul 16 23:31:16 devstack sudo[103711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:16 devstack sudo[103711]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3db008e9-e413-4e50-a7d1-ca0926a81e2a tempest-VolumeDependencyTests-310975390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9cee980-e2e2-4dd9-8752-72be62cb4fa4" returned: 0 in 0.255s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:16 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-3db008e9-e413-4e50-a7d1-ca0926a81e2a tempest-VolumeDependencyTests-310975390 None] Lock "cinder-quobyte-d9cee980-e2e2-4dd9-8752-72be62cb4fa4" released by "delete_volume" :: held 0.661s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:31:16 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-3db008e9-e413-4e50-a7d1-ca0926a81e2a tempest-VolumeDependencyTests-310975390 None] Created reservations ['fd80bc85-ab05-4c3d-86d4-9dc73135882c', '76b12172-a13c-4dbf-9c09-19db86e66da9', 'e5d57750-37a1-4abf-8b01-fc105b0fc96e', '3cc8e664-85af-4229-b5aa-f301f61703c8'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:31:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3db008e9-e413-4e50-a7d1-ca0926a81e2a tempest-VolumeDependencyTests-310975390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:31:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3db008e9-e413-4e50-a7d1-ca0926a81e2a tempest-VolumeDependencyTests-310975390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:31:16 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3db008e9-e413-4e50-a7d1-ca0926a81e2a tempest-VolumeDependencyTests-310975390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:31:16 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3db008e9-e413-4e50-a7d1-ca0926a81e2a tempest-VolumeDependencyTests-310975390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:31:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3db008e9-e413-4e50-a7d1-ca0926a81e2a tempest-VolumeDependencyTests-310975390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:31:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3db008e9-e413-4e50-a7d1-ca0926a81e2a tempest-VolumeDependencyTests-310975390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:16 devstack sudo[103714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:31:16 devstack sudo[103714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:17 devstack sudo[103714]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:17 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3db008e9-e413-4e50-a7d1-ca0926a81e2a tempest-VolumeDependencyTests-310975390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.265s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:17 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-3db008e9-e413-4e50-a7d1-ca0926a81e2a tempest-VolumeDependencyTests-310975390 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:31:17 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-3db008e9-e413-4e50-a7d1-ca0926a81e2a tempest-VolumeDependencyTests-310975390 None] Deleted volume successfully. Jul 16 23:31:17 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-3db008e9-e413-4e50-a7d1-ca0926a81e2a tempest-VolumeDependencyTests-310975390 None] Lock "cinder-d9cee980-e2e2-4dd9-8752-72be62cb4fa4-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:31:19 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1e246d8a-5191-4b8b-8664-cdb5068e4063 tempest-VolumesNegativeTest-1368639697 None] Acquiring lock "cinder-53a82aa0-17f6-4f0b-bcc7-ae42e484ed57-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:31:19 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1e246d8a-5191-4b8b-8664-cdb5068e4063 tempest-VolumesNegativeTest-1368639697 None] Lock "cinder-53a82aa0-17f6-4f0b-bcc7-ae42e484ed57-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:31:19 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1e246d8a-5191-4b8b-8664-cdb5068e4063 tempest-VolumesNegativeTest-1368639697 None] Acquiring lock "cinder-quobyte-53a82aa0-17f6-4f0b-bcc7-ae42e484ed57" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:31:19 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1e246d8a-5191-4b8b-8664-cdb5068e4063 tempest-VolumesNegativeTest-1368639697 None] Lock "cinder-quobyte-53a82aa0-17f6-4f0b-bcc7-ae42e484ed57" acquired by "delete_volume" :: waited 0.016s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:31:19 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[332d9a2c-64b4-402c-bb8e-2de2705f2b44]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:31:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1e246d8a-5191-4b8b-8664-cdb5068e4063 tempest-VolumesNegativeTest-1368639697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-53a82aa0-17f6-4f0b-bcc7-ae42e484ed57 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:19 devstack sudo[103718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-53a82aa0-17f6-4f0b-bcc7-ae42e484ed57 Jul 16 23:31:19 devstack sudo[103718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:19 devstack sudo[103718]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1e246d8a-5191-4b8b-8664-cdb5068e4063 tempest-VolumesNegativeTest-1368639697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-53a82aa0-17f6-4f0b-bcc7-ae42e484ed57" returned: 0 in 0.368s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1e246d8a-5191-4b8b-8664-cdb5068e4063 tempest-VolumesNegativeTest-1368639697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-53a82aa0-17f6-4f0b-bcc7-ae42e484ed57 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:19 devstack sudo[103724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-53a82aa0-17f6-4f0b-bcc7-ae42e484ed57 Jul 16 23:31:19 devstack sudo[103724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:20 devstack sudo[103724]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1e246d8a-5191-4b8b-8664-cdb5068e4063 tempest-VolumesNegativeTest-1368639697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-53a82aa0-17f6-4f0b-bcc7-ae42e484ed57" returned: 0 in 0.260s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:20 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1e246d8a-5191-4b8b-8664-cdb5068e4063 tempest-VolumesNegativeTest-1368639697 None] Lock "cinder-quobyte-53a82aa0-17f6-4f0b-bcc7-ae42e484ed57" released by "delete_volume" :: held 0.679s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:31:20 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-1e246d8a-5191-4b8b-8664-cdb5068e4063 tempest-VolumesNegativeTest-1368639697 None] Created reservations ['c9a72237-df16-4c59-8861-614a94afb0e5', 'db066923-4e12-4fc2-901a-ff453b5e18cf', 'af911ba7-e85c-416d-bba5-36adfce52e1f', '72b9c85e-a31e-4ea3-82a7-fc1149435cef'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:31:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1e246d8a-5191-4b8b-8664-cdb5068e4063 tempest-VolumesNegativeTest-1368639697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:31:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1e246d8a-5191-4b8b-8664-cdb5068e4063 tempest-VolumesNegativeTest-1368639697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:31:20 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1e246d8a-5191-4b8b-8664-cdb5068e4063 tempest-VolumesNegativeTest-1368639697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:31:20 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1e246d8a-5191-4b8b-8664-cdb5068e4063 tempest-VolumesNegativeTest-1368639697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:31:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1e246d8a-5191-4b8b-8664-cdb5068e4063 tempest-VolumesNegativeTest-1368639697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:31:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1e246d8a-5191-4b8b-8664-cdb5068e4063 tempest-VolumesNegativeTest-1368639697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:20 devstack sudo[103729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:31:20 devstack sudo[103729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:20 devstack sudo[103729]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1e246d8a-5191-4b8b-8664-cdb5068e4063 tempest-VolumesNegativeTest-1368639697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.292s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:20 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-1e246d8a-5191-4b8b-8664-cdb5068e4063 tempest-VolumesNegativeTest-1368639697 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:31:20 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-1e246d8a-5191-4b8b-8664-cdb5068e4063 tempest-VolumesNegativeTest-1368639697 None] Deleted volume successfully. Jul 16 23:31:20 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1e246d8a-5191-4b8b-8664-cdb5068e4063 tempest-VolumesNegativeTest-1368639697 None] Lock "cinder-53a82aa0-17f6-4f0b-bcc7-ae42e484ed57-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:31:21 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-706426c0-83be-45c4-9578-aa70b6a7851c tempest-ProjectReaderTests-18696306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:31:21 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-706426c0-83be-45c4-9578-aa70b6a7851c tempest-ProjectReaderTests-18696306 None] Flow 'volume_create_manager' (54ea7d74-5751-470f-ad41-3b61e584642f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:31:21 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-706426c0-83be-45c4-9578-aa70b6a7851c tempest-ProjectReaderTests-18696306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (527acdb8-e42e-4e9e-980c-07a6a9172c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:21 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-706426c0-83be-45c4-9578-aa70b6a7851c tempest-ProjectReaderTests-18696306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (527acdb8-e42e-4e9e-980c-07a6a9172c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:31:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-128762342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=516d4c02-e607-4ea1-8591-5cbb3b4ba18e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1d9f33c738c4a69bf14e6f8486f24fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:31:22Z,use_quota=True,user_id='5b7a4d1ae9534f65b7cf78ef6cc7e193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:21 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-706426c0-83be-45c4-9578-aa70b6a7851c tempest-ProjectReaderTests-18696306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (373f5077-85a5-46ff-9a28-ef59c7aab561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:21 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-706426c0-83be-45c4-9578-aa70b6a7851c tempest-ProjectReaderTests-18696306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (373f5077-85a5-46ff-9a28-ef59c7aab561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:21 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-706426c0-83be-45c4-9578-aa70b6a7851c tempest-ProjectReaderTests-18696306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ed2d66b-0752-4c2b-801e-8d1f6aaba6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:21 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-706426c0-83be-45c4-9578-aa70b6a7851c tempest-ProjectReaderTests-18696306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ed2d66b-0752-4c2b-801e-8d1f6aaba6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '516d4c02-e607-4ea1-8591-5cbb3b4ba18e', 'volume_name': 'volume-516d4c02-e607-4ea1-8591-5cbb3b4ba18e', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:21 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-706426c0-83be-45c4-9578-aa70b6a7851c tempest-ProjectReaderTests-18696306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a45c52bc-ee73-4ea9-82d6-bc281367fb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:21 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-706426c0-83be-45c4-9578-aa70b6a7851c tempest-ProjectReaderTests-18696306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a45c52bc-ee73-4ea9-82d6-bc281367fb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:21 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-706426c0-83be-45c4-9578-aa70b6a7851c tempest-ProjectReaderTests-18696306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa7b794a-2c3c-42a0-a2bf-c795466a0842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:21 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-706426c0-83be-45c4-9578-aa70b6a7851c tempest-ProjectReaderTests-18696306 None] Volume 516d4c02-e607-4ea1-8591-5cbb3b4ba18e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-516d4c02-e607-4ea1-8591-5cbb3b4ba18e', 'volume_size': 1} Jul 16 23:31:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-706426c0-83be-45c4-9578-aa70b6a7851c tempest-ProjectReaderTests-18696306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:31:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-706426c0-83be-45c4-9578-aa70b6a7851c tempest-ProjectReaderTests-18696306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:31:21 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-706426c0-83be-45c4-9578-aa70b6a7851c tempest-ProjectReaderTests-18696306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:31:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-128762342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=516d4c02-e607-4ea1-8591-5cbb3b4ba18e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1d9f33c738c4a69bf14e6f8486f24fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:31:22Z,use_quota=True,user_id='5b7a4d1ae9534f65b7cf78ef6cc7e193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:31:21 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-706426c0-83be-45c4-9578-aa70b6a7851c tempest-ProjectReaderTests-18696306 None] Creating volume 516d4c02-e607-4ea1-8591-5cbb3b4ba18e {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:31:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-706426c0-83be-45c4-9578-aa70b6a7851c tempest-ProjectReaderTests-18696306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:31:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-706426c0-83be-45c4-9578-aa70b6a7851c tempest-ProjectReaderTests-18696306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:31:21 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-706426c0-83be-45c4-9578-aa70b6a7851c tempest-ProjectReaderTests-18696306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:31:21 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-706426c0-83be-45c4-9578-aa70b6a7851c tempest-ProjectReaderTests-18696306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:31:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-706426c0-83be-45c4-9578-aa70b6a7851c tempest-ProjectReaderTests-18696306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:31:21 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-706426c0-83be-45c4-9578-aa70b6a7851c tempest-ProjectReaderTests-18696306 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:31:21 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-706426c0-83be-45c4-9578-aa70b6a7851c tempest-ProjectReaderTests-18696306 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:31:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-706426c0-83be-45c4-9578-aa70b6a7851c tempest-ProjectReaderTests-18696306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-516d4c02-e607-4ea1-8591-5cbb3b4ba18e 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:21 devstack sudo[103735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-516d4c02-e607-4ea1-8591-5cbb3b4ba18e 1073741824 Jul 16 23:31:21 devstack sudo[103735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:22 devstack sudo[103735]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-706426c0-83be-45c4-9578-aa70b6a7851c tempest-ProjectReaderTests-18696306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-516d4c02-e607-4ea1-8591-5cbb3b4ba18e 1073741824" returned: 0 in 0.551s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-706426c0-83be-45c4-9578-aa70b6a7851c tempest-ProjectReaderTests-18696306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-516d4c02-e607-4ea1-8591-5cbb3b4ba18e {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:22 devstack sudo[103741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-516d4c02-e607-4ea1-8591-5cbb3b4ba18e Jul 16 23:31:22 devstack sudo[103741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:22 devstack sudo[103741]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-706426c0-83be-45c4-9578-aa70b6a7851c tempest-ProjectReaderTests-18696306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-516d4c02-e607-4ea1-8591-5cbb3b4ba18e" returned: 0 in 0.288s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:22 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-706426c0-83be-45c4-9578-aa70b6a7851c tempest-ProjectReaderTests-18696306 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:31:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-706426c0-83be-45c4-9578-aa70b6a7851c tempest-ProjectReaderTests-18696306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:31:22 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-706426c0-83be-45c4-9578-aa70b6a7851c tempest-ProjectReaderTests-18696306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa7b794a-2c3c-42a0-a2bf-c795466a0842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-516d4c02-e607-4ea1-8591-5cbb3b4ba18e', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:22 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-706426c0-83be-45c4-9578-aa70b6a7851c tempest-ProjectReaderTests-18696306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8475466a-d0af-4576-96e0-c8f6655902af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:22 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-706426c0-83be-45c4-9578-aa70b6a7851c tempest-ProjectReaderTests-18696306 None] Volume volume-516d4c02-e607-4ea1-8591-5cbb3b4ba18e (516d4c02-e607-4ea1-8591-5cbb3b4ba18e): created successfully Jul 16 23:31:22 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-706426c0-83be-45c4-9578-aa70b6a7851c tempest-ProjectReaderTests-18696306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8475466a-d0af-4576-96e0-c8f6655902af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:22 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-706426c0-83be-45c4-9578-aa70b6a7851c tempest-ProjectReaderTests-18696306 None] Flow 'volume_create_manager' (54ea7d74-5751-470f-ad41-3b61e584642f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:31:22 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-706426c0-83be-45c4-9578-aa70b6a7851c tempest-ProjectReaderTests-18696306 None] Created volume successfully. Jul 16 23:31:23 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-79198872-5455-4457-b883-06db15fd4c65 req-d23a20a4-692c-43ee-9d6f-c7803ff3fbcd tempest-TestMinimumBasicScenario-1153042250 None] Terminate volume connection completed successfully. Jul 16 23:31:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-79198872-5455-4457-b883-06db15fd4c65 req-d23a20a4-692c-43ee-9d6f-c7803ff3fbcd tempest-TestMinimumBasicScenario-1153042250 None] Deleting attachment a58454b4-f434-46d4-a5e9-1d780287370a. {{(pid=87607) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 23:31:24 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-bcf5b734-cc8c-4e61-ae5f-0192719f0de6 tempest-ProjectReaderTests-18696306 None] Acquiring lock "cinder-516d4c02-e607-4ea1-8591-5cbb3b4ba18e-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:31:24 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-bcf5b734-cc8c-4e61-ae5f-0192719f0de6 tempest-ProjectReaderTests-18696306 None] Lock "cinder-516d4c02-e607-4ea1-8591-5cbb3b4ba18e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:31:24 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-bcf5b734-cc8c-4e61-ae5f-0192719f0de6 tempest-ProjectReaderTests-18696306 None] Acquiring lock "cinder-quobyte-516d4c02-e607-4ea1-8591-5cbb3b4ba18e" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:31:24 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-bcf5b734-cc8c-4e61-ae5f-0192719f0de6 tempest-ProjectReaderTests-18696306 None] Lock "cinder-quobyte-516d4c02-e607-4ea1-8591-5cbb3b4ba18e" acquired by "delete_volume" :: waited 0.031s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:31:24 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[93115469-fdcd-48e8-9177-7878d10f9137]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:31:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bcf5b734-cc8c-4e61-ae5f-0192719f0de6 tempest-ProjectReaderTests-18696306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-516d4c02-e607-4ea1-8591-5cbb3b4ba18e {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:24 devstack sudo[103749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-516d4c02-e607-4ea1-8591-5cbb3b4ba18e Jul 16 23:31:24 devstack sudo[103749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:24 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f8de1b49-7a67-4201-8e43-7d76dad958cd tempest-TestMinimumBasicScenario-1153042250 None] Acquiring lock "cinder-a3790e7a-807b-4f80-af39-068cc199748e-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:31:24 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f8de1b49-7a67-4201-8e43-7d76dad958cd tempest-TestMinimumBasicScenario-1153042250 None] Lock "cinder-a3790e7a-807b-4f80-af39-068cc199748e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:31:24 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f8de1b49-7a67-4201-8e43-7d76dad958cd tempest-TestMinimumBasicScenario-1153042250 None] Acquiring lock "cinder-quobyte-a3790e7a-807b-4f80-af39-068cc199748e" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:31:24 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f8de1b49-7a67-4201-8e43-7d76dad958cd tempest-TestMinimumBasicScenario-1153042250 None] Lock "cinder-quobyte-a3790e7a-807b-4f80-af39-068cc199748e" acquired by "delete_volume" :: waited 0.024s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:31:24 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[282a70eb-6fac-4120-a496-53395a542125]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:31:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f8de1b49-7a67-4201-8e43-7d76dad958cd tempest-TestMinimumBasicScenario-1153042250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a3790e7a-807b-4f80-af39-068cc199748e {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:24 devstack sudo[103749]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bcf5b734-cc8c-4e61-ae5f-0192719f0de6 tempest-ProjectReaderTests-18696306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-516d4c02-e607-4ea1-8591-5cbb3b4ba18e" returned: 0 in 0.467s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bcf5b734-cc8c-4e61-ae5f-0192719f0de6 tempest-ProjectReaderTests-18696306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-516d4c02-e607-4ea1-8591-5cbb3b4ba18e {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:24 devstack sudo[103753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a3790e7a-807b-4f80-af39-068cc199748e Jul 16 23:31:24 devstack sudo[103753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:24 devstack sudo[103756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-516d4c02-e607-4ea1-8591-5cbb3b4ba18e Jul 16 23:31:24 devstack sudo[103756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:24 devstack sudo[103756]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bcf5b734-cc8c-4e61-ae5f-0192719f0de6 tempest-ProjectReaderTests-18696306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-516d4c02-e607-4ea1-8591-5cbb3b4ba18e" returned: 0 in 0.284s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:25 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-bcf5b734-cc8c-4e61-ae5f-0192719f0de6 tempest-ProjectReaderTests-18696306 None] Lock "cinder-quobyte-516d4c02-e607-4ea1-8591-5cbb3b4ba18e" released by "delete_volume" :: held 0.800s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:31:25 devstack sudo[103753]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f8de1b49-7a67-4201-8e43-7d76dad958cd tempest-TestMinimumBasicScenario-1153042250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a3790e7a-807b-4f80-af39-068cc199748e" returned: 0 in 0.402s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f8de1b49-7a67-4201-8e43-7d76dad958cd tempest-TestMinimumBasicScenario-1153042250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a3790e7a-807b-4f80-af39-068cc199748e {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:25 devstack sudo[103763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a3790e7a-807b-4f80-af39-068cc199748e Jul 16 23:31:25 devstack sudo[103763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:25 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-bcf5b734-cc8c-4e61-ae5f-0192719f0de6 tempest-ProjectReaderTests-18696306 None] Created reservations ['264f6deb-225b-4696-b6ca-e350f201a502', 'd3f060ad-64d3-44f2-9ba9-848f0e037f71', '3063fb75-6ba4-4ae2-b9e2-8731cff8286b', '289a3835-063d-4d2b-9fb9-a54f561b6f4b'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:31:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bcf5b734-cc8c-4e61-ae5f-0192719f0de6 tempest-ProjectReaderTests-18696306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:31:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bcf5b734-cc8c-4e61-ae5f-0192719f0de6 tempest-ProjectReaderTests-18696306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:31:25 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-bcf5b734-cc8c-4e61-ae5f-0192719f0de6 tempest-ProjectReaderTests-18696306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:31:25 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-bcf5b734-cc8c-4e61-ae5f-0192719f0de6 tempest-ProjectReaderTests-18696306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:31:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bcf5b734-cc8c-4e61-ae5f-0192719f0de6 tempest-ProjectReaderTests-18696306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:31:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bcf5b734-cc8c-4e61-ae5f-0192719f0de6 tempest-ProjectReaderTests-18696306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:25 devstack sudo[103765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:31:25 devstack sudo[103765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:25 devstack sudo[103763]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f8de1b49-7a67-4201-8e43-7d76dad958cd tempest-TestMinimumBasicScenario-1153042250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a3790e7a-807b-4f80-af39-068cc199748e" returned: 0 in 0.365s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:25 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f8de1b49-7a67-4201-8e43-7d76dad958cd tempest-TestMinimumBasicScenario-1153042250 None] Lock "cinder-quobyte-a3790e7a-807b-4f80-af39-068cc199748e" released by "delete_volume" :: held 0.819s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:31:25 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-f8de1b49-7a67-4201-8e43-7d76dad958cd tempest-TestMinimumBasicScenario-1153042250 None] Created reservations ['fc8c2975-6d6a-4170-b178-b7cd9306f618', 'ab1ffec5-d85d-433c-b1e3-05199ff03ffb', '6cf760e0-4766-451e-a608-6f4329311bf0', '785d5945-93d7-4ebe-a0ab-7076e2d38c29'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:31:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f8de1b49-7a67-4201-8e43-7d76dad958cd tempest-TestMinimumBasicScenario-1153042250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:31:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f8de1b49-7a67-4201-8e43-7d76dad958cd tempest-TestMinimumBasicScenario-1153042250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:31:25 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f8de1b49-7a67-4201-8e43-7d76dad958cd tempest-TestMinimumBasicScenario-1153042250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:31:25 devstack sudo[103765]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:25 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f8de1b49-7a67-4201-8e43-7d76dad958cd tempest-TestMinimumBasicScenario-1153042250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:31:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f8de1b49-7a67-4201-8e43-7d76dad958cd tempest-TestMinimumBasicScenario-1153042250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:31:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f8de1b49-7a67-4201-8e43-7d76dad958cd tempest-TestMinimumBasicScenario-1153042250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bcf5b734-cc8c-4e61-ae5f-0192719f0de6 tempest-ProjectReaderTests-18696306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.426s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:25 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-bcf5b734-cc8c-4e61-ae5f-0192719f0de6 tempest-ProjectReaderTests-18696306 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:31:25 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-bcf5b734-cc8c-4e61-ae5f-0192719f0de6 tempest-ProjectReaderTests-18696306 None] Deleted volume successfully. Jul 16 23:31:25 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-bcf5b734-cc8c-4e61-ae5f-0192719f0de6 tempest-ProjectReaderTests-18696306 None] Lock "cinder-516d4c02-e607-4ea1-8591-5cbb3b4ba18e-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:31:25 devstack sudo[103769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:31:25 devstack sudo[103769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:25 devstack sudo[103769]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f8de1b49-7a67-4201-8e43-7d76dad958cd tempest-TestMinimumBasicScenario-1153042250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.353s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:25 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-f8de1b49-7a67-4201-8e43-7d76dad958cd tempest-TestMinimumBasicScenario-1153042250 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:31:25 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-f8de1b49-7a67-4201-8e43-7d76dad958cd tempest-TestMinimumBasicScenario-1153042250 None] Deleted volume successfully. Jul 16 23:31:25 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f8de1b49-7a67-4201-8e43-7d76dad958cd tempest-TestMinimumBasicScenario-1153042250 None] Lock "cinder-a3790e7a-807b-4f80-af39-068cc199748e-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:31:26 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-846c3679-b582-475d-8f0f-aca185f14c94 tempest-ProjectReaderTests-18696306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:31:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-846c3679-b582-475d-8f0f-aca185f14c94 tempest-ProjectReaderTests-18696306 None] Flow 'volume_create_manager' (3adea32e-df60-46ab-acd8-d5e5f93d06ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:31:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-846c3679-b582-475d-8f0f-aca185f14c94 tempest-ProjectReaderTests-18696306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c898306-b045-4c33-a28b-f0e772cffbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-846c3679-b582-475d-8f0f-aca185f14c94 tempest-ProjectReaderTests-18696306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c898306-b045-4c33-a28b-f0e772cffbaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:31:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-865468161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=606a8ca6-3870-4b25-8185-0a278ce15051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1d9f33c738c4a69bf14e6f8486f24fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:31:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:31:26Z,use_quota=True,user_id='5b7a4d1ae9534f65b7cf78ef6cc7e193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-846c3679-b582-475d-8f0f-aca185f14c94 tempest-ProjectReaderTests-18696306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79791446-b3f2-46e6-ab66-d833d299455c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-846c3679-b582-475d-8f0f-aca185f14c94 tempest-ProjectReaderTests-18696306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79791446-b3f2-46e6-ab66-d833d299455c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-846c3679-b582-475d-8f0f-aca185f14c94 tempest-ProjectReaderTests-18696306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ff484d2-80a6-4454-b313-0a9bb3241e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-846c3679-b582-475d-8f0f-aca185f14c94 tempest-ProjectReaderTests-18696306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ff484d2-80a6-4454-b313-0a9bb3241e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '606a8ca6-3870-4b25-8185-0a278ce15051', 'volume_name': 'volume-606a8ca6-3870-4b25-8185-0a278ce15051', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-846c3679-b582-475d-8f0f-aca185f14c94 tempest-ProjectReaderTests-18696306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50645fa6-88b3-4fca-b72b-563d9da333be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-846c3679-b582-475d-8f0f-aca185f14c94 tempest-ProjectReaderTests-18696306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50645fa6-88b3-4fca-b72b-563d9da333be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-846c3679-b582-475d-8f0f-aca185f14c94 tempest-ProjectReaderTests-18696306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1fe528c-2cfc-4a67-935f-58a8456aeda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:26 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-846c3679-b582-475d-8f0f-aca185f14c94 tempest-ProjectReaderTests-18696306 None] Volume 606a8ca6-3870-4b25-8185-0a278ce15051: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-606a8ca6-3870-4b25-8185-0a278ce15051', 'volume_size': 1} Jul 16 23:31:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-846c3679-b582-475d-8f0f-aca185f14c94 tempest-ProjectReaderTests-18696306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:31:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-846c3679-b582-475d-8f0f-aca185f14c94 tempest-ProjectReaderTests-18696306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:31:26 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-846c3679-b582-475d-8f0f-aca185f14c94 tempest-ProjectReaderTests-18696306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:31:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-865468161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=606a8ca6-3870-4b25-8185-0a278ce15051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1d9f33c738c4a69bf14e6f8486f24fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:31:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:31:26Z,use_quota=True,user_id='5b7a4d1ae9534f65b7cf78ef6cc7e193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:31:26 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-846c3679-b582-475d-8f0f-aca185f14c94 tempest-ProjectReaderTests-18696306 None] Creating volume 606a8ca6-3870-4b25-8185-0a278ce15051 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:31:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-846c3679-b582-475d-8f0f-aca185f14c94 tempest-ProjectReaderTests-18696306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:31:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-846c3679-b582-475d-8f0f-aca185f14c94 tempest-ProjectReaderTests-18696306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:31:26 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-846c3679-b582-475d-8f0f-aca185f14c94 tempest-ProjectReaderTests-18696306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:31:26 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-846c3679-b582-475d-8f0f-aca185f14c94 tempest-ProjectReaderTests-18696306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:31:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-846c3679-b582-475d-8f0f-aca185f14c94 tempest-ProjectReaderTests-18696306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:31:26 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-846c3679-b582-475d-8f0f-aca185f14c94 tempest-ProjectReaderTests-18696306 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:31:26 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-846c3679-b582-475d-8f0f-aca185f14c94 tempest-ProjectReaderTests-18696306 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:31:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-846c3679-b582-475d-8f0f-aca185f14c94 tempest-ProjectReaderTests-18696306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-606a8ca6-3870-4b25-8185-0a278ce15051 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:26 devstack sudo[103773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-606a8ca6-3870-4b25-8185-0a278ce15051 1073741824 Jul 16 23:31:26 devstack sudo[103773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:26 devstack sudo[103773]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-846c3679-b582-475d-8f0f-aca185f14c94 tempest-ProjectReaderTests-18696306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-606a8ca6-3870-4b25-8185-0a278ce15051 1073741824" returned: 0 in 0.645s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-846c3679-b582-475d-8f0f-aca185f14c94 tempest-ProjectReaderTests-18696306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-606a8ca6-3870-4b25-8185-0a278ce15051 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:26 devstack sudo[103798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-606a8ca6-3870-4b25-8185-0a278ce15051 Jul 16 23:31:26 devstack sudo[103798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:27 devstack sudo[103798]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-846c3679-b582-475d-8f0f-aca185f14c94 tempest-ProjectReaderTests-18696306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-606a8ca6-3870-4b25-8185-0a278ce15051" returned: 0 in 0.284s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:27 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-846c3679-b582-475d-8f0f-aca185f14c94 tempest-ProjectReaderTests-18696306 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:31:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-846c3679-b582-475d-8f0f-aca185f14c94 tempest-ProjectReaderTests-18696306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:31:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-846c3679-b582-475d-8f0f-aca185f14c94 tempest-ProjectReaderTests-18696306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1fe528c-2cfc-4a67-935f-58a8456aeda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-606a8ca6-3870-4b25-8185-0a278ce15051', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-846c3679-b582-475d-8f0f-aca185f14c94 tempest-ProjectReaderTests-18696306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5ca922a-408b-49a6-b25d-c35099375e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:27 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-846c3679-b582-475d-8f0f-aca185f14c94 tempest-ProjectReaderTests-18696306 None] Volume volume-606a8ca6-3870-4b25-8185-0a278ce15051 (606a8ca6-3870-4b25-8185-0a278ce15051): created successfully Jul 16 23:31:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-846c3679-b582-475d-8f0f-aca185f14c94 tempest-ProjectReaderTests-18696306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5ca922a-408b-49a6-b25d-c35099375e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-846c3679-b582-475d-8f0f-aca185f14c94 tempest-ProjectReaderTests-18696306 None] Flow 'volume_create_manager' (3adea32e-df60-46ab-acd8-d5e5f93d06ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:31:27 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-846c3679-b582-475d-8f0f-aca185f14c94 tempest-ProjectReaderTests-18696306 None] Created volume successfully. Jul 16 23:31:28 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4f129a7f-959b-4453-bfde-b110da6a87f7 tempest-ProjectReaderTests-18696306 None] Acquiring lock "cinder-606a8ca6-3870-4b25-8185-0a278ce15051-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:31:28 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4f129a7f-959b-4453-bfde-b110da6a87f7 tempest-ProjectReaderTests-18696306 None] Lock "cinder-606a8ca6-3870-4b25-8185-0a278ce15051-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:31:28 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4f129a7f-959b-4453-bfde-b110da6a87f7 tempest-ProjectReaderTests-18696306 None] Acquiring lock "cinder-quobyte-606a8ca6-3870-4b25-8185-0a278ce15051" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:31:28 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4f129a7f-959b-4453-bfde-b110da6a87f7 tempest-ProjectReaderTests-18696306 None] Lock "cinder-quobyte-606a8ca6-3870-4b25-8185-0a278ce15051" acquired by "delete_volume" :: waited 0.020s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:31:28 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e874da-d283-4b42-869d-853e3ce41948]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:31:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4f129a7f-959b-4453-bfde-b110da6a87f7 tempest-ProjectReaderTests-18696306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-606a8ca6-3870-4b25-8185-0a278ce15051 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:28 devstack sudo[103803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-606a8ca6-3870-4b25-8185-0a278ce15051 Jul 16 23:31:28 devstack sudo[103803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:28 devstack sudo[103803]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4f129a7f-959b-4453-bfde-b110da6a87f7 tempest-ProjectReaderTests-18696306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-606a8ca6-3870-4b25-8185-0a278ce15051" returned: 0 in 0.456s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4f129a7f-959b-4453-bfde-b110da6a87f7 tempest-ProjectReaderTests-18696306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-606a8ca6-3870-4b25-8185-0a278ce15051 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:28 devstack sudo[103809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-606a8ca6-3870-4b25-8185-0a278ce15051 Jul 16 23:31:28 devstack sudo[103809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:29 devstack sudo[103809]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4f129a7f-959b-4453-bfde-b110da6a87f7 tempest-ProjectReaderTests-18696306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-606a8ca6-3870-4b25-8185-0a278ce15051" returned: 0 in 0.335s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:29 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4f129a7f-959b-4453-bfde-b110da6a87f7 tempest-ProjectReaderTests-18696306 None] Lock "cinder-quobyte-606a8ca6-3870-4b25-8185-0a278ce15051" released by "delete_volume" :: held 0.869s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:31:29 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-4f129a7f-959b-4453-bfde-b110da6a87f7 tempest-ProjectReaderTests-18696306 None] Created reservations ['02e23960-2810-4b3e-bdb6-9d13eac33d0f', 'bdf6a245-cf55-4d57-af1e-872091bc5c20', '7e5494b2-976e-4a71-86e8-72ea56704882', '5a788940-e94e-4083-bdb5-0fced854cfea'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:31:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4f129a7f-959b-4453-bfde-b110da6a87f7 tempest-ProjectReaderTests-18696306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:31:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4f129a7f-959b-4453-bfde-b110da6a87f7 tempest-ProjectReaderTests-18696306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:31:29 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4f129a7f-959b-4453-bfde-b110da6a87f7 tempest-ProjectReaderTests-18696306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:31:29 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4f129a7f-959b-4453-bfde-b110da6a87f7 tempest-ProjectReaderTests-18696306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:31:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4f129a7f-959b-4453-bfde-b110da6a87f7 tempest-ProjectReaderTests-18696306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:31:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4f129a7f-959b-4453-bfde-b110da6a87f7 tempest-ProjectReaderTests-18696306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:29 devstack sudo[103813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:31:29 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:29 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4f129a7f-959b-4453-bfde-b110da6a87f7 tempest-ProjectReaderTests-18696306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.314s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:29 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-4f129a7f-959b-4453-bfde-b110da6a87f7 tempest-ProjectReaderTests-18696306 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:31:29 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-4f129a7f-959b-4453-bfde-b110da6a87f7 tempest-ProjectReaderTests-18696306 None] Deleted volume successfully. Jul 16 23:31:29 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4f129a7f-959b-4453-bfde-b110da6a87f7 tempest-ProjectReaderTests-18696306 None] Lock "cinder-606a8ca6-3870-4b25-8185-0a278ce15051-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:31:35 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-982877aa-c0cf-4d77-843f-23e891359e7a tempest-VolumesSnapshotTestJSON-1891174813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:31:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-982877aa-c0cf-4d77-843f-23e891359e7a tempest-VolumesSnapshotTestJSON-1891174813 None] Flow 'volume_create_manager' (ef5695ba-5e20-4020-976e-6f6281f159d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:31:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-982877aa-c0cf-4d77-843f-23e891359e7a tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (682962d3-2a99-4264-bcf4-3f9869f8f338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-982877aa-c0cf-4d77-843f-23e891359e7a tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (682962d3-2a99-4264-bcf4-3f9869f8f338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1904347292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=903e6247-bc44-429b-93b9-fc6eccbacc8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25755d47f6c74cbb92e3f7cd7c69f0be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:31:35Z,use_quota=True,user_id='d9c88f9640af4738aaae5d2c25184049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-982877aa-c0cf-4d77-843f-23e891359e7a tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (742cf816-e6fd-4027-8fb1-7366883250f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-982877aa-c0cf-4d77-843f-23e891359e7a tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (742cf816-e6fd-4027-8fb1-7366883250f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-982877aa-c0cf-4d77-843f-23e891359e7a tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a3c09cf-021f-469f-850f-345334fb177e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-982877aa-c0cf-4d77-843f-23e891359e7a tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a3c09cf-021f-469f-850f-345334fb177e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '903e6247-bc44-429b-93b9-fc6eccbacc8d', 'volume_name': 'volume-903e6247-bc44-429b-93b9-fc6eccbacc8d', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-982877aa-c0cf-4d77-843f-23e891359e7a tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3e454af-d1ce-44ef-9ed2-76cfbf836b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-982877aa-c0cf-4d77-843f-23e891359e7a tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3e454af-d1ce-44ef-9ed2-76cfbf836b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-982877aa-c0cf-4d77-843f-23e891359e7a tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7ca58b4-8b6f-4f2e-8da0-207c5098fc7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:35 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-982877aa-c0cf-4d77-843f-23e891359e7a tempest-VolumesSnapshotTestJSON-1891174813 None] Volume 903e6247-bc44-429b-93b9-fc6eccbacc8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-903e6247-bc44-429b-93b9-fc6eccbacc8d', 'volume_size': 1} Jul 16 23:31:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-982877aa-c0cf-4d77-843f-23e891359e7a tempest-VolumesSnapshotTestJSON-1891174813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:31:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-982877aa-c0cf-4d77-843f-23e891359e7a tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:31:35 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-982877aa-c0cf-4d77-843f-23e891359e7a tempest-VolumesSnapshotTestJSON-1891174813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1904347292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=903e6247-bc44-429b-93b9-fc6eccbacc8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25755d47f6c74cbb92e3f7cd7c69f0be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:31:35Z,use_quota=True,user_id='d9c88f9640af4738aaae5d2c25184049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:31:35 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-982877aa-c0cf-4d77-843f-23e891359e7a tempest-VolumesSnapshotTestJSON-1891174813 None] Creating volume 903e6247-bc44-429b-93b9-fc6eccbacc8d {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:31:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-982877aa-c0cf-4d77-843f-23e891359e7a tempest-VolumesSnapshotTestJSON-1891174813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:31:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-982877aa-c0cf-4d77-843f-23e891359e7a tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:31:35 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-982877aa-c0cf-4d77-843f-23e891359e7a tempest-VolumesSnapshotTestJSON-1891174813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:31:35 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-982877aa-c0cf-4d77-843f-23e891359e7a tempest-VolumesSnapshotTestJSON-1891174813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:31:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-982877aa-c0cf-4d77-843f-23e891359e7a tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:31:35 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-982877aa-c0cf-4d77-843f-23e891359e7a tempest-VolumesSnapshotTestJSON-1891174813 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:31:35 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-982877aa-c0cf-4d77-843f-23e891359e7a tempest-VolumesSnapshotTestJSON-1891174813 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:31:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-982877aa-c0cf-4d77-843f-23e891359e7a tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:35 devstack sudo[103818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d 1073741824 Jul 16 23:31:35 devstack sudo[103818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:35 devstack sudo[103818]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-982877aa-c0cf-4d77-843f-23e891359e7a tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d 1073741824" returned: 0 in 0.587s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-982877aa-c0cf-4d77-843f-23e891359e7a tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:35 devstack sudo[103824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d Jul 16 23:31:35 devstack sudo[103824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:36 devstack sudo[103824]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-982877aa-c0cf-4d77-843f-23e891359e7a tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d" returned: 0 in 0.312s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:36 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-982877aa-c0cf-4d77-843f-23e891359e7a tempest-VolumesSnapshotTestJSON-1891174813 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:31:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-982877aa-c0cf-4d77-843f-23e891359e7a tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:31:36 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-982877aa-c0cf-4d77-843f-23e891359e7a tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7ca58b4-8b6f-4f2e-8da0-207c5098fc7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-903e6247-bc44-429b-93b9-fc6eccbacc8d', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:36 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-982877aa-c0cf-4d77-843f-23e891359e7a tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dafb6f5b-3625-43f4-a214-2a773d21fd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:36 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-982877aa-c0cf-4d77-843f-23e891359e7a tempest-VolumesSnapshotTestJSON-1891174813 None] Volume volume-903e6247-bc44-429b-93b9-fc6eccbacc8d (903e6247-bc44-429b-93b9-fc6eccbacc8d): created successfully Jul 16 23:31:36 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-982877aa-c0cf-4d77-843f-23e891359e7a tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dafb6f5b-3625-43f4-a214-2a773d21fd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:36 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-982877aa-c0cf-4d77-843f-23e891359e7a tempest-VolumesSnapshotTestJSON-1891174813 None] Flow 'volume_create_manager' (ef5695ba-5e20-4020-976e-6f6281f159d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:31:36 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-982877aa-c0cf-4d77-843f-23e891359e7a tempest-VolumesSnapshotTestJSON-1891174813 None] Created volume successfully. Jul 16 23:31:36 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb958d14-4488-44ce-a8e5-9d3ca67d70fb tempest-ProjectReaderTests-802587306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:31:36 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bb958d14-4488-44ce-a8e5-9d3ca67d70fb tempest-ProjectReaderTests-802587306 None] Flow 'volume_create_manager' (cad986e9-8731-44eb-a8fb-88afff071b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:31:36 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bb958d14-4488-44ce-a8e5-9d3ca67d70fb tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ca84df3-280b-4c24-a378-efc9e08d1279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:36 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bb958d14-4488-44ce-a8e5-9d3ca67d70fb tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ca84df3-280b-4c24-a378-efc9e08d1279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-615961209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2b865a1-2195-492a-92a2-be89837ce280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01405f67a073473e89de43b289e4f489',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:31:36Z,use_quota=True,user_id='41ca3471b2cb480284d0f1793f2ecd4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:36 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bb958d14-4488-44ce-a8e5-9d3ca67d70fb tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88087a43-a2a3-47ce-879f-165f1798c051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:36 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bb958d14-4488-44ce-a8e5-9d3ca67d70fb tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88087a43-a2a3-47ce-879f-165f1798c051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:36 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bb958d14-4488-44ce-a8e5-9d3ca67d70fb tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (540ce574-8d03-40dc-be08-4370cd79c82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:36 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bb958d14-4488-44ce-a8e5-9d3ca67d70fb tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (540ce574-8d03-40dc-be08-4370cd79c82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2b865a1-2195-492a-92a2-be89837ce280', 'volume_name': 'volume-d2b865a1-2195-492a-92a2-be89837ce280', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:36 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bb958d14-4488-44ce-a8e5-9d3ca67d70fb tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aa73777-1ba4-4d28-a48d-7ffcd52cd687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:36 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bb958d14-4488-44ce-a8e5-9d3ca67d70fb tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aa73777-1ba4-4d28-a48d-7ffcd52cd687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:36 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bb958d14-4488-44ce-a8e5-9d3ca67d70fb tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfc1cc0f-7237-4a9b-858f-8d913af4b629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:36 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-bb958d14-4488-44ce-a8e5-9d3ca67d70fb tempest-ProjectReaderTests-802587306 None] Volume d2b865a1-2195-492a-92a2-be89837ce280: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2b865a1-2195-492a-92a2-be89837ce280', 'volume_size': 1} Jul 16 23:31:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bb958d14-4488-44ce-a8e5-9d3ca67d70fb tempest-ProjectReaderTests-802587306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:31:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bb958d14-4488-44ce-a8e5-9d3ca67d70fb tempest-ProjectReaderTests-802587306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:31:36 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-bb958d14-4488-44ce-a8e5-9d3ca67d70fb tempest-ProjectReaderTests-802587306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-615961209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2b865a1-2195-492a-92a2-be89837ce280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01405f67a073473e89de43b289e4f489',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:31:36Z,use_quota=True,user_id='41ca3471b2cb480284d0f1793f2ecd4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:31:36 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-bb958d14-4488-44ce-a8e5-9d3ca67d70fb tempest-ProjectReaderTests-802587306 None] Creating volume d2b865a1-2195-492a-92a2-be89837ce280 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:31:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bb958d14-4488-44ce-a8e5-9d3ca67d70fb tempest-ProjectReaderTests-802587306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:31:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bb958d14-4488-44ce-a8e5-9d3ca67d70fb tempest-ProjectReaderTests-802587306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:31:36 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-bb958d14-4488-44ce-a8e5-9d3ca67d70fb tempest-ProjectReaderTests-802587306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:31:36 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-bb958d14-4488-44ce-a8e5-9d3ca67d70fb tempest-ProjectReaderTests-802587306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:31:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bb958d14-4488-44ce-a8e5-9d3ca67d70fb tempest-ProjectReaderTests-802587306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:31:36 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-bb958d14-4488-44ce-a8e5-9d3ca67d70fb tempest-ProjectReaderTests-802587306 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:31:36 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-bb958d14-4488-44ce-a8e5-9d3ca67d70fb tempest-ProjectReaderTests-802587306 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:31:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bb958d14-4488-44ce-a8e5-9d3ca67d70fb tempest-ProjectReaderTests-802587306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2b865a1-2195-492a-92a2-be89837ce280 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:36 devstack sudo[103828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2b865a1-2195-492a-92a2-be89837ce280 1073741824 Jul 16 23:31:36 devstack sudo[103828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:36 devstack sudo[103828]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bb958d14-4488-44ce-a8e5-9d3ca67d70fb tempest-ProjectReaderTests-802587306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2b865a1-2195-492a-92a2-be89837ce280 1073741824" returned: 0 in 0.424s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bb958d14-4488-44ce-a8e5-9d3ca67d70fb tempest-ProjectReaderTests-802587306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2b865a1-2195-492a-92a2-be89837ce280 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:36 devstack sudo[103834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2b865a1-2195-492a-92a2-be89837ce280 Jul 16 23:31:36 devstack sudo[103834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:37 devstack sudo[103834]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bb958d14-4488-44ce-a8e5-9d3ca67d70fb tempest-ProjectReaderTests-802587306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2b865a1-2195-492a-92a2-be89837ce280" returned: 0 in 0.290s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:37 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-bb958d14-4488-44ce-a8e5-9d3ca67d70fb tempest-ProjectReaderTests-802587306 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:31:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bb958d14-4488-44ce-a8e5-9d3ca67d70fb tempest-ProjectReaderTests-802587306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:31:37 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bb958d14-4488-44ce-a8e5-9d3ca67d70fb tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfc1cc0f-7237-4a9b-858f-8d913af4b629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2b865a1-2195-492a-92a2-be89837ce280', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:37 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bb958d14-4488-44ce-a8e5-9d3ca67d70fb tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5f76dba-fac8-45e8-a549-b6832547179a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:37 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-bb958d14-4488-44ce-a8e5-9d3ca67d70fb tempest-ProjectReaderTests-802587306 None] Volume volume-d2b865a1-2195-492a-92a2-be89837ce280 (d2b865a1-2195-492a-92a2-be89837ce280): created successfully Jul 16 23:31:37 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bb958d14-4488-44ce-a8e5-9d3ca67d70fb tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5f76dba-fac8-45e8-a549-b6832547179a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:37 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-bb958d14-4488-44ce-a8e5-9d3ca67d70fb tempest-ProjectReaderTests-802587306 None] Flow 'volume_create_manager' (cad986e9-8731-44eb-a8fb-88afff071b99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:31:37 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-bb958d14-4488-44ce-a8e5-9d3ca67d70fb tempest-ProjectReaderTests-802587306 None] Created volume successfully. Jul 16 23:31:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f3468afb-66c8-4634-96b6-a026d7a6c67f tempest-VolumesSnapshotTestJSON-1891174813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:31:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f3468afb-66c8-4634-96b6-a026d7a6c67f tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:31:37 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-f3468afb-66c8-4634-96b6-a026d7a6c67f tempest-VolumesSnapshotTestJSON-1891174813 None] Creating offline snapshot ef96fe53-7b55-478d-bae4-7b16e42847f2 of volume 903e6247-bc44-429b-93b9-fc6eccbacc8d {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:31:37 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[884e260c-347c-4dd0-93f8-0a4c5a14845b]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:31:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f3468afb-66c8-4634-96b6-a026d7a6c67f tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:37 devstack sudo[103837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d Jul 16 23:31:37 devstack sudo[103837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:37 devstack sudo[103837]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f3468afb-66c8-4634-96b6-a026d7a6c67f tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d" returned: 0 in 0.449s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f3468afb-66c8-4634-96b6-a026d7a6c67f tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d.ef96fe53-7b55-478d-bae4-7b16e42847f2 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:37 devstack sudo[103842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d.ef96fe53-7b55-478d-bae4-7b16e42847f2 1G Jul 16 23:31:37 devstack sudo[103842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:38 devstack sudo[103842]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f3468afb-66c8-4634-96b6-a026d7a6c67f tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d.ef96fe53-7b55-478d-bae4-7b16e42847f2 1G" returned: 0 in 0.435s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f3468afb-66c8-4634-96b6-a026d7a6c67f tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-903e6247-bc44-429b-93b9-fc6eccbacc8d -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d.ef96fe53-7b55-478d-bae4-7b16e42847f2 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:38 devstack sudo[103848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-903e6247-bc44-429b-93b9-fc6eccbacc8d -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d.ef96fe53-7b55-478d-bae4-7b16e42847f2 Jul 16 23:31:38 devstack sudo[103848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:38 devstack sudo[103848]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f3468afb-66c8-4634-96b6-a026d7a6c67f tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-903e6247-bc44-429b-93b9-fc6eccbacc8d -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d.ef96fe53-7b55-478d-bae4-7b16e42847f2" returned: 0 in 0.350s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:38 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-f3468afb-66c8-4634-96b6-a026d7a6c67f tempest-VolumesSnapshotTestJSON-1891174813 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d.ef96fe53-7b55-478d-bae4-7b16e42847f2 is being set with open permissions: ugo+rw Jul 16 23:31:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f3468afb-66c8-4634-96b6-a026d7a6c67f tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d.ef96fe53-7b55-478d-bae4-7b16e42847f2 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:38 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6ec4d8d8-6a75-47cf-b6bb-da896e885526 tempest-ProjectReaderTests-802587306 None] Acquiring lock "cinder-d2b865a1-2195-492a-92a2-be89837ce280-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:31:38 devstack sudo[103854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d.ef96fe53-7b55-478d-bae4-7b16e42847f2 Jul 16 23:31:38 devstack sudo[103854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:38 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6ec4d8d8-6a75-47cf-b6bb-da896e885526 tempest-ProjectReaderTests-802587306 None] Lock "cinder-d2b865a1-2195-492a-92a2-be89837ce280-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:31:38 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6ec4d8d8-6a75-47cf-b6bb-da896e885526 tempest-ProjectReaderTests-802587306 None] Acquiring lock "cinder-quobyte-d2b865a1-2195-492a-92a2-be89837ce280" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:31:38 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6ec4d8d8-6a75-47cf-b6bb-da896e885526 tempest-ProjectReaderTests-802587306 None] Lock "cinder-quobyte-d2b865a1-2195-492a-92a2-be89837ce280" acquired by "delete_volume" :: waited 0.028s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:31:38 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56dd087-9d43-47b0-b90a-38de24874152]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:31:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6ec4d8d8-6a75-47cf-b6bb-da896e885526 tempest-ProjectReaderTests-802587306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2b865a1-2195-492a-92a2-be89837ce280 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:39 devstack sudo[103856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2b865a1-2195-492a-92a2-be89837ce280 Jul 16 23:31:39 devstack sudo[103856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:39 devstack sudo[103854]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f3468afb-66c8-4634-96b6-a026d7a6c67f tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d.ef96fe53-7b55-478d-bae4-7b16e42847f2" returned: 0 in 0.294s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f3468afb-66c8-4634-96b6-a026d7a6c67f tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:39 devstack sudo[103879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d.info Jul 16 23:31:39 devstack sudo[103879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:39 devstack sudo[103856]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6ec4d8d8-6a75-47cf-b6bb-da896e885526 tempest-ProjectReaderTests-802587306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2b865a1-2195-492a-92a2-be89837ce280" returned: 0 in 0.419s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6ec4d8d8-6a75-47cf-b6bb-da896e885526 tempest-ProjectReaderTests-802587306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2b865a1-2195-492a-92a2-be89837ce280 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:39 devstack sudo[103901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2b865a1-2195-492a-92a2-be89837ce280 Jul 16 23:31:39 devstack sudo[103901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:39 devstack sudo[103879]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f3468afb-66c8-4634-96b6-a026d7a6c67f tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d.info" returned: 0 in 0.359s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:39 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-f3468afb-66c8-4634-96b6-a026d7a6c67f tempest-VolumesSnapshotTestJSON-1891174813 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d.info is being set with open permissions: ugo+rw Jul 16 23:31:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f3468afb-66c8-4634-96b6-a026d7a6c67f tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:39 devstack cinder-volume[87607]: DEBUG oslo_service.periodic_task [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:31:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:31:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:31:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:31:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:31:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:31:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:39 devstack sudo[103906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d.info Jul 16 23:31:39 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:39 devstack sudo[103908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:31:39 devstack sudo[103908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:39 devstack sudo[103901]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6ec4d8d8-6a75-47cf-b6bb-da896e885526 tempest-ProjectReaderTests-802587306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d2b865a1-2195-492a-92a2-be89837ce280" returned: 0 in 0.358s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:39 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6ec4d8d8-6a75-47cf-b6bb-da896e885526 tempest-ProjectReaderTests-802587306 None] Lock "cinder-quobyte-d2b865a1-2195-492a-92a2-be89837ce280" released by "delete_volume" :: held 0.833s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:31:39 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-6ec4d8d8-6a75-47cf-b6bb-da896e885526 tempest-ProjectReaderTests-802587306 None] Created reservations ['1c0a15c2-5f49-4f2b-8be9-afb55b939eb4', 'df5006da-c5eb-45cb-8dde-887ea35284f2', 'b6446ad0-047b-4267-ab24-8851dcb7af27', 'a8ecbe4b-2517-49f2-a036-46af86d790f7'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:31:39 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f3468afb-66c8-4634-96b6-a026d7a6c67f tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d.info" returned: 0 in 0.347s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f3468afb-66c8-4634-96b6-a026d7a6c67f tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.364s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:31:39 devstack sudo[103908]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6ec4d8d8-6a75-47cf-b6bb-da896e885526 tempest-ProjectReaderTests-802587306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:31:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6ec4d8d8-6a75-47cf-b6bb-da896e885526 tempest-ProjectReaderTests-802587306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:31:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-6ec4d8d8-6a75-47cf-b6bb-da896e885526 tempest-ProjectReaderTests-802587306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:31:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-6ec4d8d8-6a75-47cf-b6bb-da896e885526 tempest-ProjectReaderTests-802587306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:31:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6ec4d8d8-6a75-47cf-b6bb-da896e885526 tempest-ProjectReaderTests-802587306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:31:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6ec4d8d8-6a75-47cf-b6bb-da896e885526 tempest-ProjectReaderTests-802587306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:39 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-f3468afb-66c8-4634-96b6-a026d7a6c67f tempest-VolumesSnapshotTestJSON-1891174813 None] Create snapshot completed successfully Jul 16 23:31:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.462s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:39 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:31:39 devstack sudo[103913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:31:39 devstack sudo[103913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:39 devstack cinder-volume[87607]: DEBUG oslo_service.periodic_task [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running periodic task VolumeManager._thread_info {{(pid=87607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:31:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] thread count: 28 {{(pid=87607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 23:31:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] thread info: [<_MainThread(MainThread, started 139090403627136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 23:31:40 devstack sudo[103913]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6ec4d8d8-6a75-47cf-b6bb-da896e885526 tempest-ProjectReaderTests-802587306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.280s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:40 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-6ec4d8d8-6a75-47cf-b6bb-da896e885526 tempest-ProjectReaderTests-802587306 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:31:40 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-6ec4d8d8-6a75-47cf-b6bb-da896e885526 tempest-ProjectReaderTests-802587306 None] Deleted volume successfully. Jul 16 23:31:40 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6ec4d8d8-6a75-47cf-b6bb-da896e885526 tempest-ProjectReaderTests-802587306 None] Lock "cinder-d2b865a1-2195-492a-92a2-be89837ce280-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:31:40 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-15ade459-8127-4aa8-afe8-16d8be89508f tempest-ProjectReaderTests-802587306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:31:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-15ade459-8127-4aa8-afe8-16d8be89508f tempest-ProjectReaderTests-802587306 None] Flow 'volume_create_manager' (b9239996-9c4d-4b9f-8986-c0dc1bab948a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:31:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-15ade459-8127-4aa8-afe8-16d8be89508f tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b63d079-8511-4020-8a74-98947ce365f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-15ade459-8127-4aa8-afe8-16d8be89508f tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b63d079-8511-4020-8a74-98947ce365f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2060557207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfc6b39c-13db-45dc-bffa-2d672072b781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01405f67a073473e89de43b289e4f489',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:31:40Z,use_quota=True,user_id='41ca3471b2cb480284d0f1793f2ecd4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-15ade459-8127-4aa8-afe8-16d8be89508f tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0151cfe9-ab69-4dc1-8313-f27ac098e6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-15ade459-8127-4aa8-afe8-16d8be89508f tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0151cfe9-ab69-4dc1-8313-f27ac098e6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-15ade459-8127-4aa8-afe8-16d8be89508f tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce23a7ad-e712-42f2-8540-d472eaeb2948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-15ade459-8127-4aa8-afe8-16d8be89508f tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce23a7ad-e712-42f2-8540-d472eaeb2948) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfc6b39c-13db-45dc-bffa-2d672072b781', 'volume_name': 'volume-bfc6b39c-13db-45dc-bffa-2d672072b781', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-15ade459-8127-4aa8-afe8-16d8be89508f tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b149844-aee6-4557-9c7d-0900412ef658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-15ade459-8127-4aa8-afe8-16d8be89508f tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b149844-aee6-4557-9c7d-0900412ef658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-15ade459-8127-4aa8-afe8-16d8be89508f tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9b70acc-aa62-4543-82b1-937fda3f400c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:40 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-15ade459-8127-4aa8-afe8-16d8be89508f tempest-ProjectReaderTests-802587306 None] Volume bfc6b39c-13db-45dc-bffa-2d672072b781: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfc6b39c-13db-45dc-bffa-2d672072b781', 'volume_size': 1} Jul 16 23:31:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-15ade459-8127-4aa8-afe8-16d8be89508f tempest-ProjectReaderTests-802587306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:31:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-15ade459-8127-4aa8-afe8-16d8be89508f tempest-ProjectReaderTests-802587306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:31:40 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-15ade459-8127-4aa8-afe8-16d8be89508f tempest-ProjectReaderTests-802587306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2060557207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfc6b39c-13db-45dc-bffa-2d672072b781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01405f67a073473e89de43b289e4f489',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:31:40Z,use_quota=True,user_id='41ca3471b2cb480284d0f1793f2ecd4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:31:40 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-15ade459-8127-4aa8-afe8-16d8be89508f tempest-ProjectReaderTests-802587306 None] Creating volume bfc6b39c-13db-45dc-bffa-2d672072b781 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:31:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-15ade459-8127-4aa8-afe8-16d8be89508f tempest-ProjectReaderTests-802587306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:31:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-15ade459-8127-4aa8-afe8-16d8be89508f tempest-ProjectReaderTests-802587306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:31:40 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-15ade459-8127-4aa8-afe8-16d8be89508f tempest-ProjectReaderTests-802587306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:31:40 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-15ade459-8127-4aa8-afe8-16d8be89508f tempest-ProjectReaderTests-802587306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:31:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-15ade459-8127-4aa8-afe8-16d8be89508f tempest-ProjectReaderTests-802587306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:31:40 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-15ade459-8127-4aa8-afe8-16d8be89508f tempest-ProjectReaderTests-802587306 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:31:40 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-15ade459-8127-4aa8-afe8-16d8be89508f tempest-ProjectReaderTests-802587306 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:31:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-15ade459-8127-4aa8-afe8-16d8be89508f tempest-ProjectReaderTests-802587306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bfc6b39c-13db-45dc-bffa-2d672072b781 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:40 devstack sudo[103916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bfc6b39c-13db-45dc-bffa-2d672072b781 1073741824 Jul 16 23:31:40 devstack sudo[103916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:40 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-eabede2f-6f50-421e-8600-95ecee740fa9 tempest-VolumesSnapshotTestJSON-1891174813 None] Acquiring lock "cinder-ef96fe53-7b55-478d-bae4-7b16e42847f2-delete_snapshot" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:31:40 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-eabede2f-6f50-421e-8600-95ecee740fa9 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-ef96fe53-7b55-478d-bae4-7b16e42847f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:31:40 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-eabede2f-6f50-421e-8600-95ecee740fa9 tempest-VolumesSnapshotTestJSON-1891174813 None] Acquiring lock "cinder-quobyte-903e6247-bc44-429b-93b9-fc6eccbacc8d" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:31:40 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-eabede2f-6f50-421e-8600-95ecee740fa9 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-quobyte-903e6247-bc44-429b-93b9-fc6eccbacc8d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:31:40 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-eabede2f-6f50-421e-8600-95ecee740fa9 tempest-VolumesSnapshotTestJSON-1891174813 None] Acquiring lock "cinder-quobyte-ef96fe53-7b55-478d-bae4-7b16e42847f2" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:31:40 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-eabede2f-6f50-421e-8600-95ecee740fa9 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-quobyte-ef96fe53-7b55-478d-bae4-7b16e42847f2" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:31:40 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-eabede2f-6f50-421e-8600-95ecee740fa9 tempest-VolumesSnapshotTestJSON-1891174813 None] Deleting offline snapshot ef96fe53-7b55-478d-bae4-7b16e42847f2 of volume 903e6247-bc44-429b-93b9-fc6eccbacc8d {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:31:40 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-eabede2f-6f50-421e-8600-95ecee740fa9 tempest-VolumesSnapshotTestJSON-1891174813 None] snapshot_file for this snap is: volume-903e6247-bc44-429b-93b9-fc6eccbacc8d.ef96fe53-7b55-478d-bae4-7b16e42847f2 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:31:40 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e514ac-20f2-4fde-abda-092f8541518c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:31:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-eabede2f-6f50-421e-8600-95ecee740fa9 tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d.ef96fe53-7b55-478d-bae4-7b16e42847f2 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:41 devstack sudo[103916]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-15ade459-8127-4aa8-afe8-16d8be89508f tempest-ProjectReaderTests-802587306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bfc6b39c-13db-45dc-bffa-2d672072b781 1073741824" returned: 0 in 0.475s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-15ade459-8127-4aa8-afe8-16d8be89508f tempest-ProjectReaderTests-802587306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bfc6b39c-13db-45dc-bffa-2d672072b781 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:41 devstack sudo[103922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d.ef96fe53-7b55-478d-bae4-7b16e42847f2 Jul 16 23:31:41 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:41 devstack sudo[103923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bfc6b39c-13db-45dc-bffa-2d672072b781 Jul 16 23:31:41 devstack sudo[103923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:41 devstack sudo[103923]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-15ade459-8127-4aa8-afe8-16d8be89508f tempest-ProjectReaderTests-802587306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bfc6b39c-13db-45dc-bffa-2d672072b781" returned: 0 in 0.268s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:41 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-15ade459-8127-4aa8-afe8-16d8be89508f tempest-ProjectReaderTests-802587306 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:31:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-15ade459-8127-4aa8-afe8-16d8be89508f tempest-ProjectReaderTests-802587306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:31:41 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-15ade459-8127-4aa8-afe8-16d8be89508f tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9b70acc-aa62-4543-82b1-937fda3f400c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfc6b39c-13db-45dc-bffa-2d672072b781', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-15ade459-8127-4aa8-afe8-16d8be89508f tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad318f45-01cd-4d97-b69a-7abe10f984d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-eabede2f-6f50-421e-8600-95ecee740fa9 tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d.ef96fe53-7b55-478d-bae4-7b16e42847f2" returned: 0 in 0.411s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:41 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-eabede2f-6f50-421e-8600-95ecee740fa9 tempest-VolumesSnapshotTestJSON-1891174813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-903e6247-bc44-429b-93b9-fc6eccbacc8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:31:41 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-15ade459-8127-4aa8-afe8-16d8be89508f tempest-ProjectReaderTests-802587306 None] Volume volume-bfc6b39c-13db-45dc-bffa-2d672072b781 (bfc6b39c-13db-45dc-bffa-2d672072b781): created successfully Jul 16 23:31:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-15ade459-8127-4aa8-afe8-16d8be89508f tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad318f45-01cd-4d97-b69a-7abe10f984d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-15ade459-8127-4aa8-afe8-16d8be89508f tempest-ProjectReaderTests-802587306 None] Flow 'volume_create_manager' (b9239996-9c4d-4b9f-8986-c0dc1bab948a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:31:41 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[87981dbc-576c-4776-924b-4074e86e53cc]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:31:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-eabede2f-6f50-421e-8600-95ecee740fa9 tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:41 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-15ade459-8127-4aa8-afe8-16d8be89508f tempest-ProjectReaderTests-802587306 None] Created volume successfully. Jul 16 23:31:41 devstack sudo[103930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d Jul 16 23:31:41 devstack sudo[103930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:41 devstack sudo[103930]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-eabede2f-6f50-421e-8600-95ecee740fa9 tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d" returned: 0 in 0.369s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-eabede2f-6f50-421e-8600-95ecee740fa9 tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d.ef96fe53-7b55-478d-bae4-7b16e42847f2 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:41 devstack sudo[103935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d.ef96fe53-7b55-478d-bae4-7b16e42847f2 Jul 16 23:31:41 devstack sudo[103935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:42 devstack sudo[103935]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-eabede2f-6f50-421e-8600-95ecee740fa9 tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d.ef96fe53-7b55-478d-bae4-7b16e42847f2" returned: 0 in 0.368s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-eabede2f-6f50-421e-8600-95ecee740fa9 tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d.ef96fe53-7b55-478d-bae4-7b16e42847f2 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:42 devstack sudo[103941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d.ef96fe53-7b55-478d-bae4-7b16e42847f2 Jul 16 23:31:42 devstack sudo[103941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:42 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8f49d76-1410-48cf-b9c5-22eaa2df23ce tempest-CinderUnicodeTest-300297570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:31:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a8f49d76-1410-48cf-b9c5-22eaa2df23ce tempest-CinderUnicodeTest-300297570 None] Flow 'volume_create_manager' (c69cbd9c-78f1-4d4f-be2e-7a98c90c1607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:31:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a8f49d76-1410-48cf-b9c5-22eaa2df23ce tempest-CinderUnicodeTest-300297570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c00e838-53a9-4a34-9b24-46dca2dd0fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a8f49d76-1410-48cf-b9c5-22eaa2df23ce tempest-CinderUnicodeTest-300297570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c00e838-53a9-4a34-9b24-46dca2dd0fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d047743-65fd-4db3-8c1b-5552708666cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e2ccf7229c649f7a2f2aa7aee3b24cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:31:42Z,use_quota=True,user_id='374f569a91a445f79d29888bb4af5a8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a8f49d76-1410-48cf-b9c5-22eaa2df23ce tempest-CinderUnicodeTest-300297570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (966e658f-350a-4c47-a43e-1a291f3f57dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a8f49d76-1410-48cf-b9c5-22eaa2df23ce tempest-CinderUnicodeTest-300297570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (966e658f-350a-4c47-a43e-1a291f3f57dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a8f49d76-1410-48cf-b9c5-22eaa2df23ce tempest-CinderUnicodeTest-300297570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7a80436-7866-408a-9f96-7aac3ba71afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a8f49d76-1410-48cf-b9c5-22eaa2df23ce tempest-CinderUnicodeTest-300297570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7a80436-7866-408a-9f96-7aac3ba71afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d047743-65fd-4db3-8c1b-5552708666cd', 'volume_name': 'volume-3d047743-65fd-4db3-8c1b-5552708666cd', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:42 devstack sudo[103941]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a8f49d76-1410-48cf-b9c5-22eaa2df23ce tempest-CinderUnicodeTest-300297570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f85b1b0e-599d-4d85-be92-5adb08a9f80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a8f49d76-1410-48cf-b9c5-22eaa2df23ce tempest-CinderUnicodeTest-300297570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f85b1b0e-599d-4d85-be92-5adb08a9f80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a8f49d76-1410-48cf-b9c5-22eaa2df23ce tempest-CinderUnicodeTest-300297570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59d0893e-8288-4496-8e5e-60f65d51d465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:42 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-a8f49d76-1410-48cf-b9c5-22eaa2df23ce tempest-CinderUnicodeTest-300297570 None] Volume 3d047743-65fd-4db3-8c1b-5552708666cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d047743-65fd-4db3-8c1b-5552708666cd', 'volume_size': 1} Jul 16 23:31:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a8f49d76-1410-48cf-b9c5-22eaa2df23ce tempest-CinderUnicodeTest-300297570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:31:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a8f49d76-1410-48cf-b9c5-22eaa2df23ce tempest-CinderUnicodeTest-300297570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:31:42 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a8f49d76-1410-48cf-b9c5-22eaa2df23ce tempest-CinderUnicodeTest-300297570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d047743-65fd-4db3-8c1b-5552708666cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e2ccf7229c649f7a2f2aa7aee3b24cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:31:42Z,use_quota=True,user_id='374f569a91a445f79d29888bb4af5a8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:31:42 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-a8f49d76-1410-48cf-b9c5-22eaa2df23ce tempest-CinderUnicodeTest-300297570 None] Creating volume 3d047743-65fd-4db3-8c1b-5552708666cd {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:31:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a8f49d76-1410-48cf-b9c5-22eaa2df23ce tempest-CinderUnicodeTest-300297570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:31:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a8f49d76-1410-48cf-b9c5-22eaa2df23ce tempest-CinderUnicodeTest-300297570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:31:42 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a8f49d76-1410-48cf-b9c5-22eaa2df23ce tempest-CinderUnicodeTest-300297570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:31:42 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a8f49d76-1410-48cf-b9c5-22eaa2df23ce tempest-CinderUnicodeTest-300297570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:31:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a8f49d76-1410-48cf-b9c5-22eaa2df23ce tempest-CinderUnicodeTest-300297570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:31:42 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a8f49d76-1410-48cf-b9c5-22eaa2df23ce tempest-CinderUnicodeTest-300297570 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:31:42 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-a8f49d76-1410-48cf-b9c5-22eaa2df23ce tempest-CinderUnicodeTest-300297570 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:31:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a8f49d76-1410-48cf-b9c5-22eaa2df23ce tempest-CinderUnicodeTest-300297570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3d047743-65fd-4db3-8c1b-5552708666cd 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-eabede2f-6f50-421e-8600-95ecee740fa9 tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d.ef96fe53-7b55-478d-bae4-7b16e42847f2" returned: 0 in 0.280s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:42 devstack sudo[103944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3d047743-65fd-4db3-8c1b-5552708666cd 1073741824 Jul 16 23:31:42 devstack sudo[103944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:42 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-eabede2f-6f50-421e-8600-95ecee740fa9 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-quobyte-ef96fe53-7b55-478d-bae4-7b16e42847f2" released by "_delete_snapshot" :: held 1.576s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:31:42 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-eabede2f-6f50-421e-8600-95ecee740fa9 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-quobyte-903e6247-bc44-429b-93b9-fc6eccbacc8d" released by "delete_snapshot" :: held 1.604s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:31:42 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-eabede2f-6f50-421e-8600-95ecee740fa9 tempest-VolumesSnapshotTestJSON-1891174813 None] Created reservations ['8ef4550e-ae0c-44a6-ba62-6de1189ec099', 'c233f322-ede5-4c7c-93f7-bb0bf6875292', '1b7616b0-b70e-4748-be8c-dd55f342cc44', '388165d3-8100-408f-94fc-e0b8945a9bee'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:31:42 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d36abe1c-4ba3-4afd-b462-5903d3cc7dcb tempest-ProjectReaderTests-802587306 None] Acquiring lock "cinder-bfc6b39c-13db-45dc-bffa-2d672072b781-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:31:42 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d36abe1c-4ba3-4afd-b462-5903d3cc7dcb tempest-ProjectReaderTests-802587306 None] Lock "cinder-bfc6b39c-13db-45dc-bffa-2d672072b781-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:31:42 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-eabede2f-6f50-421e-8600-95ecee740fa9 tempest-VolumesSnapshotTestJSON-1891174813 None] Delete snapshot completed successfully. Jul 16 23:31:42 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-eabede2f-6f50-421e-8600-95ecee740fa9 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-ef96fe53-7b55-478d-bae4-7b16e42847f2-delete_snapshot" released by "delete_snapshot" :: held 1.824s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:31:42 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d36abe1c-4ba3-4afd-b462-5903d3cc7dcb tempest-ProjectReaderTests-802587306 None] Acquiring lock "cinder-quobyte-bfc6b39c-13db-45dc-bffa-2d672072b781" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:31:42 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d36abe1c-4ba3-4afd-b462-5903d3cc7dcb tempest-ProjectReaderTests-802587306 None] Lock "cinder-quobyte-bfc6b39c-13db-45dc-bffa-2d672072b781" acquired by "delete_volume" :: waited 0.018s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:31:42 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[70dc1562-48db-4da9-9127-9f0d94158190]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:31:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d36abe1c-4ba3-4afd-b462-5903d3cc7dcb tempest-ProjectReaderTests-802587306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bfc6b39c-13db-45dc-bffa-2d672072b781 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:42 devstack sudo[103949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bfc6b39c-13db-45dc-bffa-2d672072b781 Jul 16 23:31:42 devstack sudo[103949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:42 devstack sudo[103944]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a8f49d76-1410-48cf-b9c5-22eaa2df23ce tempest-CinderUnicodeTest-300297570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3d047743-65fd-4db3-8c1b-5552708666cd 1073741824" returned: 0 in 0.462s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a8f49d76-1410-48cf-b9c5-22eaa2df23ce tempest-CinderUnicodeTest-300297570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3d047743-65fd-4db3-8c1b-5552708666cd {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:42 devstack sudo[103952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3d047743-65fd-4db3-8c1b-5552708666cd Jul 16 23:31:42 devstack sudo[103952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:43 devstack sudo[103949]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d36abe1c-4ba3-4afd-b462-5903d3cc7dcb tempest-ProjectReaderTests-802587306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bfc6b39c-13db-45dc-bffa-2d672072b781" returned: 0 in 0.405s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d36abe1c-4ba3-4afd-b462-5903d3cc7dcb tempest-ProjectReaderTests-802587306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bfc6b39c-13db-45dc-bffa-2d672072b781 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:43 devstack sudo[103957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bfc6b39c-13db-45dc-bffa-2d672072b781 Jul 16 23:31:43 devstack sudo[103957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:43 devstack sudo[103952]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a8f49d76-1410-48cf-b9c5-22eaa2df23ce tempest-CinderUnicodeTest-300297570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3d047743-65fd-4db3-8c1b-5552708666cd" returned: 0 in 0.271s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a8f49d76-1410-48cf-b9c5-22eaa2df23ce tempest-CinderUnicodeTest-300297570 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:31:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a8f49d76-1410-48cf-b9c5-22eaa2df23ce tempest-CinderUnicodeTest-300297570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:31:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a8f49d76-1410-48cf-b9c5-22eaa2df23ce tempest-CinderUnicodeTest-300297570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59d0893e-8288-4496-8e5e-60f65d51d465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d047743-65fd-4db3-8c1b-5552708666cd', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a8f49d76-1410-48cf-b9c5-22eaa2df23ce tempest-CinderUnicodeTest-300297570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5783784-c4b9-45c1-8713-b6aa1961079e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:43 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-a8f49d76-1410-48cf-b9c5-22eaa2df23ce tempest-CinderUnicodeTest-300297570 None] Volume volume-3d047743-65fd-4db3-8c1b-5552708666cd (3d047743-65fd-4db3-8c1b-5552708666cd): created successfully Jul 16 23:31:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a8f49d76-1410-48cf-b9c5-22eaa2df23ce tempest-CinderUnicodeTest-300297570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5783784-c4b9-45c1-8713-b6aa1961079e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a8f49d76-1410-48cf-b9c5-22eaa2df23ce tempest-CinderUnicodeTest-300297570 None] Flow 'volume_create_manager' (c69cbd9c-78f1-4d4f-be2e-7a98c90c1607) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:31:43 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-a8f49d76-1410-48cf-b9c5-22eaa2df23ce tempest-CinderUnicodeTest-300297570 None] Created volume successfully. Jul 16 23:31:43 devstack sudo[103957]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d36abe1c-4ba3-4afd-b462-5903d3cc7dcb tempest-ProjectReaderTests-802587306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-bfc6b39c-13db-45dc-bffa-2d672072b781" returned: 0 in 0.273s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:43 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d36abe1c-4ba3-4afd-b462-5903d3cc7dcb tempest-ProjectReaderTests-802587306 None] Lock "cinder-quobyte-bfc6b39c-13db-45dc-bffa-2d672072b781" released by "delete_volume" :: held 0.714s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:31:43 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-d36abe1c-4ba3-4afd-b462-5903d3cc7dcb tempest-ProjectReaderTests-802587306 None] Created reservations ['eb23b762-c66f-43f3-b385-37786fe91355', 'd64a8dde-1f03-48dc-a17b-512926b17853', '82e5dc12-0d88-4e7c-b53a-2f34ca7ad398', '414bc822-5a65-4877-b1c2-1dea03f8ebf1'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:31:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-d36abe1c-4ba3-4afd-b462-5903d3cc7dcb tempest-ProjectReaderTests-802587306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:31:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-d36abe1c-4ba3-4afd-b462-5903d3cc7dcb tempest-ProjectReaderTests-802587306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:31:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-d36abe1c-4ba3-4afd-b462-5903d3cc7dcb tempest-ProjectReaderTests-802587306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:31:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-d36abe1c-4ba3-4afd-b462-5903d3cc7dcb tempest-ProjectReaderTests-802587306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:31:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-d36abe1c-4ba3-4afd-b462-5903d3cc7dcb tempest-ProjectReaderTests-802587306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:31:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d36abe1c-4ba3-4afd-b462-5903d3cc7dcb tempest-ProjectReaderTests-802587306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:43 devstack sudo[103961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:31:43 devstack sudo[103961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:43 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ba655a9-1ac3-44c3-a2b0-bb6428c5df2d tempest-VolumesSnapshotTestJSON-1891174813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:31:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-8ba655a9-1ac3-44c3-a2b0-bb6428c5df2d tempest-VolumesSnapshotTestJSON-1891174813 None] Flow 'volume_create_manager' (3ac5e7ff-b4e2-4ff2-9600-f3782ce81336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:31:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-8ba655a9-1ac3-44c3-a2b0-bb6428c5df2d tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1be70d76-acd5-4a54-9c46-0db17858892a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-8ba655a9-1ac3-44c3-a2b0-bb6428c5df2d tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1be70d76-acd5-4a54-9c46-0db17858892a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-716470295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07a7ed21-ab7b-4c2e-8455-959d7bd612ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25755d47f6c74cbb92e3f7cd7c69f0be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:31:44Z,use_quota=True,user_id='d9c88f9640af4738aaae5d2c25184049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-8ba655a9-1ac3-44c3-a2b0-bb6428c5df2d tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e100f069-d9f5-4516-92db-4efb701ed436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-8ba655a9-1ac3-44c3-a2b0-bb6428c5df2d tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e100f069-d9f5-4516-92db-4efb701ed436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-8ba655a9-1ac3-44c3-a2b0-bb6428c5df2d tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99fd3bc0-88ec-4859-8548-2474eab179f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-8ba655a9-1ac3-44c3-a2b0-bb6428c5df2d tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99fd3bc0-88ec-4859-8548-2474eab179f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07a7ed21-ab7b-4c2e-8455-959d7bd612ba', 'volume_name': 'volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-8ba655a9-1ac3-44c3-a2b0-bb6428c5df2d tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a3254f8-59db-4ca8-bc3a-f7162cf057d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-8ba655a9-1ac3-44c3-a2b0-bb6428c5df2d tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a3254f8-59db-4ca8-bc3a-f7162cf057d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-8ba655a9-1ac3-44c3-a2b0-bb6428c5df2d tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcd77a3e-4e04-4dfa-87e5-ba2e5b6607b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:43 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-8ba655a9-1ac3-44c3-a2b0-bb6428c5df2d tempest-VolumesSnapshotTestJSON-1891174813 None] Volume 07a7ed21-ab7b-4c2e-8455-959d7bd612ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba', 'volume_size': 1} Jul 16 23:31:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-8ba655a9-1ac3-44c3-a2b0-bb6428c5df2d tempest-VolumesSnapshotTestJSON-1891174813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:31:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-8ba655a9-1ac3-44c3-a2b0-bb6428c5df2d tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:31:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-8ba655a9-1ac3-44c3-a2b0-bb6428c5df2d tempest-VolumesSnapshotTestJSON-1891174813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-716470295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07a7ed21-ab7b-4c2e-8455-959d7bd612ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25755d47f6c74cbb92e3f7cd7c69f0be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:31:44Z,use_quota=True,user_id='d9c88f9640af4738aaae5d2c25184049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:31:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-8ba655a9-1ac3-44c3-a2b0-bb6428c5df2d tempest-VolumesSnapshotTestJSON-1891174813 None] Creating volume 07a7ed21-ab7b-4c2e-8455-959d7bd612ba {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:31:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-8ba655a9-1ac3-44c3-a2b0-bb6428c5df2d tempest-VolumesSnapshotTestJSON-1891174813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:31:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-8ba655a9-1ac3-44c3-a2b0-bb6428c5df2d tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:31:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-8ba655a9-1ac3-44c3-a2b0-bb6428c5df2d tempest-VolumesSnapshotTestJSON-1891174813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:31:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-8ba655a9-1ac3-44c3-a2b0-bb6428c5df2d tempest-VolumesSnapshotTestJSON-1891174813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:31:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-8ba655a9-1ac3-44c3-a2b0-bb6428c5df2d tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:31:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-8ba655a9-1ac3-44c3-a2b0-bb6428c5df2d tempest-VolumesSnapshotTestJSON-1891174813 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:31:43 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-8ba655a9-1ac3-44c3-a2b0-bb6428c5df2d tempest-VolumesSnapshotTestJSON-1891174813 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:31:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8ba655a9-1ac3-44c3-a2b0-bb6428c5df2d tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:43 devstack sudo[103963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba 1073741824 Jul 16 23:31:43 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:43 devstack sudo[103961]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d36abe1c-4ba3-4afd-b462-5903d3cc7dcb tempest-ProjectReaderTests-802587306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.249s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:43 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-d36abe1c-4ba3-4afd-b462-5903d3cc7dcb tempest-ProjectReaderTests-802587306 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:31:43 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-d36abe1c-4ba3-4afd-b462-5903d3cc7dcb tempest-ProjectReaderTests-802587306 None] Deleted volume successfully. Jul 16 23:31:43 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d36abe1c-4ba3-4afd-b462-5903d3cc7dcb tempest-ProjectReaderTests-802587306 None] Lock "cinder-bfc6b39c-13db-45dc-bffa-2d672072b781-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:31:44 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8ba655a9-1ac3-44c3-a2b0-bb6428c5df2d tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba 1073741824" returned: 0 in 0.474s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8ba655a9-1ac3-44c3-a2b0-bb6428c5df2d tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:44 devstack sudo[103971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba Jul 16 23:31:44 devstack sudo[103971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:44 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-80838479-809d-4bc0-8f81-c4bed3bbb1e5 tempest-ProjectReaderTests-802587306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:31:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-80838479-809d-4bc0-8f81-c4bed3bbb1e5 tempest-ProjectReaderTests-802587306 None] Flow 'volume_create_manager' (d31017d0-0e48-41b7-94fb-7a7a9a7b2d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:31:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-80838479-809d-4bc0-8f81-c4bed3bbb1e5 tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cfbf986-2ab6-4464-8871-5bf2264fd776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-80838479-809d-4bc0-8f81-c4bed3bbb1e5 tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cfbf986-2ab6-4464-8871-5bf2264fd776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1218001146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20d61d45-c7b8-41c9-ba1f-5a29b9f43aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01405f67a073473e89de43b289e4f489',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:31:44Z,use_quota=True,user_id='41ca3471b2cb480284d0f1793f2ecd4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-80838479-809d-4bc0-8f81-c4bed3bbb1e5 tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48c82175-a19e-48fe-9e77-c9c243c5f83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-80838479-809d-4bc0-8f81-c4bed3bbb1e5 tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48c82175-a19e-48fe-9e77-c9c243c5f83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-80838479-809d-4bc0-8f81-c4bed3bbb1e5 tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aa42e2b-1d11-45f3-ac0c-45274aeecd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-80838479-809d-4bc0-8f81-c4bed3bbb1e5 tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aa42e2b-1d11-45f3-ac0c-45274aeecd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20d61d45-c7b8-41c9-ba1f-5a29b9f43aaf', 'volume_name': 'volume-20d61d45-c7b8-41c9-ba1f-5a29b9f43aaf', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-80838479-809d-4bc0-8f81-c4bed3bbb1e5 tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fc3adc6-3817-4567-9e18-0f0a9289a400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-80838479-809d-4bc0-8f81-c4bed3bbb1e5 tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fc3adc6-3817-4567-9e18-0f0a9289a400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-80838479-809d-4bc0-8f81-c4bed3bbb1e5 tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2eeba25-0ac9-477e-9719-e1a20884c8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:44 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-80838479-809d-4bc0-8f81-c4bed3bbb1e5 tempest-ProjectReaderTests-802587306 None] Volume 20d61d45-c7b8-41c9-ba1f-5a29b9f43aaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20d61d45-c7b8-41c9-ba1f-5a29b9f43aaf', 'volume_size': 1} Jul 16 23:31:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-80838479-809d-4bc0-8f81-c4bed3bbb1e5 tempest-ProjectReaderTests-802587306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:31:44 devstack sudo[103971]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8ba655a9-1ac3-44c3-a2b0-bb6428c5df2d tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba" returned: 0 in 0.251s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:44 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-8ba655a9-1ac3-44c3-a2b0-bb6428c5df2d tempest-VolumesSnapshotTestJSON-1891174813 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:31:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-8ba655a9-1ac3-44c3-a2b0-bb6428c5df2d tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:31:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-80838479-809d-4bc0-8f81-c4bed3bbb1e5 tempest-ProjectReaderTests-802587306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.116s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:31:44 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-80838479-809d-4bc0-8f81-c4bed3bbb1e5 tempest-ProjectReaderTests-802587306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1218001146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20d61d45-c7b8-41c9-ba1f-5a29b9f43aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01405f67a073473e89de43b289e4f489',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:31:44Z,use_quota=True,user_id='41ca3471b2cb480284d0f1793f2ecd4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:31:44 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-80838479-809d-4bc0-8f81-c4bed3bbb1e5 tempest-ProjectReaderTests-802587306 None] Creating volume 20d61d45-c7b8-41c9-ba1f-5a29b9f43aaf {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:31:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-80838479-809d-4bc0-8f81-c4bed3bbb1e5 tempest-ProjectReaderTests-802587306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:31:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-80838479-809d-4bc0-8f81-c4bed3bbb1e5 tempest-ProjectReaderTests-802587306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:31:44 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-80838479-809d-4bc0-8f81-c4bed3bbb1e5 tempest-ProjectReaderTests-802587306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:31:44 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-80838479-809d-4bc0-8f81-c4bed3bbb1e5 tempest-ProjectReaderTests-802587306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:31:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-80838479-809d-4bc0-8f81-c4bed3bbb1e5 tempest-ProjectReaderTests-802587306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:31:44 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-80838479-809d-4bc0-8f81-c4bed3bbb1e5 tempest-ProjectReaderTests-802587306 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:31:44 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-80838479-809d-4bc0-8f81-c4bed3bbb1e5 tempest-ProjectReaderTests-802587306 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:31:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-80838479-809d-4bc0-8f81-c4bed3bbb1e5 tempest-ProjectReaderTests-802587306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20d61d45-c7b8-41c9-ba1f-5a29b9f43aaf 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-8ba655a9-1ac3-44c3-a2b0-bb6428c5df2d tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcd77a3e-4e04-4dfa-87e5-ba2e5b6607b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:44 devstack sudo[103974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20d61d45-c7b8-41c9-ba1f-5a29b9f43aaf 1073741824 Jul 16 23:31:44 devstack sudo[103974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-8ba655a9-1ac3-44c3-a2b0-bb6428c5df2d tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99ad4062-acac-4e04-9089-1e8f24e9831d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:44 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-8ba655a9-1ac3-44c3-a2b0-bb6428c5df2d tempest-VolumesSnapshotTestJSON-1891174813 None] Volume volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba (07a7ed21-ab7b-4c2e-8455-959d7bd612ba): created successfully Jul 16 23:31:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-8ba655a9-1ac3-44c3-a2b0-bb6428c5df2d tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99ad4062-acac-4e04-9089-1e8f24e9831d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-8ba655a9-1ac3-44c3-a2b0-bb6428c5df2d tempest-VolumesSnapshotTestJSON-1891174813 None] Flow 'volume_create_manager' (3ac5e7ff-b4e2-4ff2-9600-f3782ce81336) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:31:44 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-8ba655a9-1ac3-44c3-a2b0-bb6428c5df2d tempest-VolumesSnapshotTestJSON-1891174813 None] Created volume successfully. Jul 16 23:31:44 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cc48c6b-3e1c-4d98-b530-c725f9ae9364 tempest-CinderUnicodeTest-300297570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:31:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4cc48c6b-3e1c-4d98-b530-c725f9ae9364 tempest-CinderUnicodeTest-300297570 None] Flow 'volume_create_manager' (e9646795-1b75-4f6a-aef9-0376c23b7dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:31:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4cc48c6b-3e1c-4d98-b530-c725f9ae9364 tempest-CinderUnicodeTest-300297570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c54a0e7-fc6b-417d-8585-147bd5d4abbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:44 devstack sudo[103974]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-80838479-809d-4bc0-8f81-c4bed3bbb1e5 tempest-ProjectReaderTests-802587306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20d61d45-c7b8-41c9-ba1f-5a29b9f43aaf 1073741824" returned: 0 in 0.504s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4cc48c6b-3e1c-4d98-b530-c725f9ae9364 tempest-CinderUnicodeTest-300297570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c54a0e7-fc6b-417d-8585-147bd5d4abbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:31:45Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-940314712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bea624a-c0f9-44a8-afbf-604a0ba8f58c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e2ccf7229c649f7a2f2aa7aee3b24cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:31:45Z,use_quota=True,user_id='374f569a91a445f79d29888bb4af5a8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4cc48c6b-3e1c-4d98-b530-c725f9ae9364 tempest-CinderUnicodeTest-300297570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f08d7479-3495-49f8-853c-c97aa4056e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4cc48c6b-3e1c-4d98-b530-c725f9ae9364 tempest-CinderUnicodeTest-300297570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f08d7479-3495-49f8-853c-c97aa4056e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4cc48c6b-3e1c-4d98-b530-c725f9ae9364 tempest-CinderUnicodeTest-300297570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25a26497-aa1d-4091-a121-433aeb27bfee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4cc48c6b-3e1c-4d98-b530-c725f9ae9364 tempest-CinderUnicodeTest-300297570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25a26497-aa1d-4091-a121-433aeb27bfee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bea624a-c0f9-44a8-afbf-604a0ba8f58c', 'volume_name': 'volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4cc48c6b-3e1c-4d98-b530-c725f9ae9364 tempest-CinderUnicodeTest-300297570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0b2bb0e-581b-4b03-9c9e-987580691f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4cc48c6b-3e1c-4d98-b530-c725f9ae9364 tempest-CinderUnicodeTest-300297570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0b2bb0e-581b-4b03-9c9e-987580691f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4cc48c6b-3e1c-4d98-b530-c725f9ae9364 tempest-CinderUnicodeTest-300297570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e83d399-b65e-42e9-87f0-b075466b4d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:44 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-4cc48c6b-3e1c-4d98-b530-c725f9ae9364 tempest-CinderUnicodeTest-300297570 None] Volume 6bea624a-c0f9-44a8-afbf-604a0ba8f58c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c', 'volume_size': 1} Jul 16 23:31:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4cc48c6b-3e1c-4d98-b530-c725f9ae9364 tempest-CinderUnicodeTest-300297570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:31:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-80838479-809d-4bc0-8f81-c4bed3bbb1e5 tempest-ProjectReaderTests-802587306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20d61d45-c7b8-41c9-ba1f-5a29b9f43aaf {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:45 devstack sudo[103980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20d61d45-c7b8-41c9-ba1f-5a29b9f43aaf Jul 16 23:31:45 devstack sudo[103980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:45 devstack sudo[103980]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-80838479-809d-4bc0-8f81-c4bed3bbb1e5 tempest-ProjectReaderTests-802587306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20d61d45-c7b8-41c9-ba1f-5a29b9f43aaf" returned: 0 in 0.252s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:45 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-80838479-809d-4bc0-8f81-c4bed3bbb1e5 tempest-ProjectReaderTests-802587306 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:31:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-80838479-809d-4bc0-8f81-c4bed3bbb1e5 tempest-ProjectReaderTests-802587306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:31:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4cc48c6b-3e1c-4d98-b530-c725f9ae9364 tempest-CinderUnicodeTest-300297570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.283s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:31:45 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4cc48c6b-3e1c-4d98-b530-c725f9ae9364 tempest-CinderUnicodeTest-300297570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:31:45Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-940314712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bea624a-c0f9-44a8-afbf-604a0ba8f58c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e2ccf7229c649f7a2f2aa7aee3b24cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:31:45Z,use_quota=True,user_id='374f569a91a445f79d29888bb4af5a8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:31:45 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-4cc48c6b-3e1c-4d98-b530-c725f9ae9364 tempest-CinderUnicodeTest-300297570 None] Creating volume 6bea624a-c0f9-44a8-afbf-604a0ba8f58c {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:31:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4cc48c6b-3e1c-4d98-b530-c725f9ae9364 tempest-CinderUnicodeTest-300297570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:31:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4cc48c6b-3e1c-4d98-b530-c725f9ae9364 tempest-CinderUnicodeTest-300297570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:31:45 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4cc48c6b-3e1c-4d98-b530-c725f9ae9364 tempest-CinderUnicodeTest-300297570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:31:45 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4cc48c6b-3e1c-4d98-b530-c725f9ae9364 tempest-CinderUnicodeTest-300297570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:31:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4cc48c6b-3e1c-4d98-b530-c725f9ae9364 tempest-CinderUnicodeTest-300297570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:31:45 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4cc48c6b-3e1c-4d98-b530-c725f9ae9364 tempest-CinderUnicodeTest-300297570 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:31:45 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-4cc48c6b-3e1c-4d98-b530-c725f9ae9364 tempest-CinderUnicodeTest-300297570 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:31:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4cc48c6b-3e1c-4d98-b530-c725f9ae9364 tempest-CinderUnicodeTest-300297570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:45 devstack sudo[103983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c 1073741824 Jul 16 23:31:45 devstack sudo[103983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-80838479-809d-4bc0-8f81-c4bed3bbb1e5 tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2eeba25-0ac9-477e-9719-e1a20884c8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20d61d45-c7b8-41c9-ba1f-5a29b9f43aaf', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-80838479-809d-4bc0-8f81-c4bed3bbb1e5 tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7141223d-17c8-489c-8b9f-eead1e00b1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:45 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-80838479-809d-4bc0-8f81-c4bed3bbb1e5 tempest-ProjectReaderTests-802587306 None] Volume volume-20d61d45-c7b8-41c9-ba1f-5a29b9f43aaf (20d61d45-c7b8-41c9-ba1f-5a29b9f43aaf): created successfully Jul 16 23:31:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-80838479-809d-4bc0-8f81-c4bed3bbb1e5 tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7141223d-17c8-489c-8b9f-eead1e00b1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-80838479-809d-4bc0-8f81-c4bed3bbb1e5 tempest-ProjectReaderTests-802587306 None] Flow 'volume_create_manager' (d31017d0-0e48-41b7-94fb-7a7a9a7b2d70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:31:45 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-80838479-809d-4bc0-8f81-c4bed3bbb1e5 tempest-ProjectReaderTests-802587306 None] Created volume successfully. Jul 16 23:31:45 devstack sudo[103983]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4cc48c6b-3e1c-4d98-b530-c725f9ae9364 tempest-CinderUnicodeTest-300297570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c 1073741824" returned: 0 in 0.438s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4cc48c6b-3e1c-4d98-b530-c725f9ae9364 tempest-CinderUnicodeTest-300297570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:45 devstack sudo[103989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c Jul 16 23:31:45 devstack sudo[103989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-8018c797-5ccd-4388-9ed7-97e505d5e4f5 tempest-VolumesSnapshotTestJSON-1891174813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:31:46 devstack sudo[103989]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4cc48c6b-3e1c-4d98-b530-c725f9ae9364 tempest-CinderUnicodeTest-300297570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c" returned: 0 in 0.258s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:46 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4cc48c6b-3e1c-4d98-b530-c725f9ae9364 tempest-CinderUnicodeTest-300297570 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:31:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4cc48c6b-3e1c-4d98-b530-c725f9ae9364 tempest-CinderUnicodeTest-300297570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:31:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-8018c797-5ccd-4388-9ed7-97e505d5e4f5 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.199s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:31:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4cc48c6b-3e1c-4d98-b530-c725f9ae9364 tempest-CinderUnicodeTest-300297570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e83d399-b65e-42e9-87f0-b075466b4d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4cc48c6b-3e1c-4d98-b530-c725f9ae9364 tempest-CinderUnicodeTest-300297570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d80c686c-810f-4944-b75f-a3261d7f9701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:46 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-8018c797-5ccd-4388-9ed7-97e505d5e4f5 tempest-VolumesSnapshotTestJSON-1891174813 None] Creating offline snapshot 6718bccc-bfcf-4a4f-91f9-d691a4048a33 of volume 07a7ed21-ab7b-4c2e-8455-959d7bd612ba {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:31:46 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-4cc48c6b-3e1c-4d98-b530-c725f9ae9364 tempest-CinderUnicodeTest-300297570 None] Volume volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c (6bea624a-c0f9-44a8-afbf-604a0ba8f58c): created successfully Jul 16 23:31:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4cc48c6b-3e1c-4d98-b530-c725f9ae9364 tempest-CinderUnicodeTest-300297570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d80c686c-810f-4944-b75f-a3261d7f9701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4cc48c6b-3e1c-4d98-b530-c725f9ae9364 tempest-CinderUnicodeTest-300297570 None] Flow 'volume_create_manager' (e9646795-1b75-4f6a-aef9-0376c23b7dab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:31:46 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a0c7ed-088e-47a8-9ad2-ef518b4b2a75]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:31:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8018c797-5ccd-4388-9ed7-97e505d5e4f5 tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:46 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-4cc48c6b-3e1c-4d98-b530-c725f9ae9364 tempest-CinderUnicodeTest-300297570 None] Created volume successfully. Jul 16 23:31:46 devstack sudo[103992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba Jul 16 23:31:46 devstack sudo[103992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:46 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f72dce6b-337e-44f8-a0dc-6cfcb3a61d86 tempest-ProjectReaderTests-802587306 None] Acquiring lock "cinder-20d61d45-c7b8-41c9-ba1f-5a29b9f43aaf-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:31:46 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f72dce6b-337e-44f8-a0dc-6cfcb3a61d86 tempest-ProjectReaderTests-802587306 None] Lock "cinder-20d61d45-c7b8-41c9-ba1f-5a29b9f43aaf-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:31:46 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f72dce6b-337e-44f8-a0dc-6cfcb3a61d86 tempest-ProjectReaderTests-802587306 None] Acquiring lock "cinder-quobyte-20d61d45-c7b8-41c9-ba1f-5a29b9f43aaf" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:31:46 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f72dce6b-337e-44f8-a0dc-6cfcb3a61d86 tempest-ProjectReaderTests-802587306 None] Lock "cinder-quobyte-20d61d45-c7b8-41c9-ba1f-5a29b9f43aaf" acquired by "delete_volume" :: waited 0.016s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:31:46 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d16b98-9f0b-4597-b4ea-a409ed85baad]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:31:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f72dce6b-337e-44f8-a0dc-6cfcb3a61d86 tempest-ProjectReaderTests-802587306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20d61d45-c7b8-41c9-ba1f-5a29b9f43aaf {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:46 devstack sudo[103992]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8018c797-5ccd-4388-9ed7-97e505d5e4f5 tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba" returned: 0 in 0.392s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8018c797-5ccd-4388-9ed7-97e505d5e4f5 tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba.6718bccc-bfcf-4a4f-91f9-d691a4048a33 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:46 devstack sudo[104000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba.6718bccc-bfcf-4a4f-91f9-d691a4048a33 1G Jul 16 23:31:46 devstack sudo[104000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:46 devstack sudo[103999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20d61d45-c7b8-41c9-ba1f-5a29b9f43aaf Jul 16 23:31:46 devstack sudo[103999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:46 devstack sudo[103999]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f72dce6b-337e-44f8-a0dc-6cfcb3a61d86 tempest-ProjectReaderTests-802587306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20d61d45-c7b8-41c9-ba1f-5a29b9f43aaf" returned: 0 in 0.359s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f72dce6b-337e-44f8-a0dc-6cfcb3a61d86 tempest-ProjectReaderTests-802587306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20d61d45-c7b8-41c9-ba1f-5a29b9f43aaf {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:46 devstack sudo[104010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20d61d45-c7b8-41c9-ba1f-5a29b9f43aaf Jul 16 23:31:46 devstack sudo[104010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:46 devstack sudo[104000]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8018c797-5ccd-4388-9ed7-97e505d5e4f5 tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba.6718bccc-bfcf-4a4f-91f9-d691a4048a33 1G" returned: 0 in 0.430s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8018c797-5ccd-4388-9ed7-97e505d5e4f5 tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba.6718bccc-bfcf-4a4f-91f9-d691a4048a33 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:46 devstack sudo[104013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba.6718bccc-bfcf-4a4f-91f9-d691a4048a33 Jul 16 23:31:46 devstack sudo[104013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:47 devstack sudo[104010]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f72dce6b-337e-44f8-a0dc-6cfcb3a61d86 tempest-ProjectReaderTests-802587306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20d61d45-c7b8-41c9-ba1f-5a29b9f43aaf" returned: 0 in 0.274s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:47 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f72dce6b-337e-44f8-a0dc-6cfcb3a61d86 tempest-ProjectReaderTests-802587306 None] Lock "cinder-quobyte-20d61d45-c7b8-41c9-ba1f-5a29b9f43aaf" released by "delete_volume" :: held 0.676s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:31:47 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-f72dce6b-337e-44f8-a0dc-6cfcb3a61d86 tempest-ProjectReaderTests-802587306 None] Created reservations ['fd0b0cd6-3b0e-4ed3-92f3-7ab7dfc74f6f', '20d99c3f-0ac2-4ec7-820f-f179bf01c98e', 'a20e2d34-605c-4638-8dd4-784f773bc034', '20b9f9f4-b341-4627-b7ae-c34cc4f2cf7c'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:31:47 devstack sudo[104013]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8018c797-5ccd-4388-9ed7-97e505d5e4f5 tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba.6718bccc-bfcf-4a4f-91f9-d691a4048a33" returned: 0 in 0.346s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:47 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-8018c797-5ccd-4388-9ed7-97e505d5e4f5 tempest-VolumesSnapshotTestJSON-1891174813 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba.6718bccc-bfcf-4a4f-91f9-d691a4048a33 is being set with open permissions: ugo+rw Jul 16 23:31:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8018c797-5ccd-4388-9ed7-97e505d5e4f5 tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba.6718bccc-bfcf-4a4f-91f9-d691a4048a33 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f72dce6b-337e-44f8-a0dc-6cfcb3a61d86 tempest-ProjectReaderTests-802587306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:31:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f72dce6b-337e-44f8-a0dc-6cfcb3a61d86 tempest-ProjectReaderTests-802587306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:31:47 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f72dce6b-337e-44f8-a0dc-6cfcb3a61d86 tempest-ProjectReaderTests-802587306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:31:47 devstack sudo[104021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba.6718bccc-bfcf-4a4f-91f9-d691a4048a33 Jul 16 23:31:47 devstack sudo[104021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:47 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f72dce6b-337e-44f8-a0dc-6cfcb3a61d86 tempest-ProjectReaderTests-802587306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:31:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f72dce6b-337e-44f8-a0dc-6cfcb3a61d86 tempest-ProjectReaderTests-802587306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:31:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f72dce6b-337e-44f8-a0dc-6cfcb3a61d86 tempest-ProjectReaderTests-802587306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:47 devstack sudo[104023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:31:47 devstack sudo[104023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1b86aab7-dfa3-41cf-b067-1afa0e34fcdd tempest-CinderUnicodeTest-300297570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:31:47 devstack sudo[104021]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8018c797-5ccd-4388-9ed7-97e505d5e4f5 tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba.6718bccc-bfcf-4a4f-91f9-d691a4048a33" returned: 0 in 0.254s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:47 devstack sudo[104023]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8018c797-5ccd-4388-9ed7-97e505d5e4f5 tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f72dce6b-337e-44f8-a0dc-6cfcb3a61d86 tempest-ProjectReaderTests-802587306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.264s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:47 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-f72dce6b-337e-44f8-a0dc-6cfcb3a61d86 tempest-ProjectReaderTests-802587306 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:31:47 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-f72dce6b-337e-44f8-a0dc-6cfcb3a61d86 tempest-ProjectReaderTests-802587306 None] Deleted volume successfully. Jul 16 23:31:47 devstack sudo[104027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba.info Jul 16 23:31:47 devstack sudo[104027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:47 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f72dce6b-337e-44f8-a0dc-6cfcb3a61d86 tempest-ProjectReaderTests-802587306 None] Lock "cinder-20d61d45-c7b8-41c9-ba1f-5a29b9f43aaf-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:31:47 devstack sudo[104027]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8018c797-5ccd-4388-9ed7-97e505d5e4f5 tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba.info" returned: 0 in 0.293s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:47 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-8018c797-5ccd-4388-9ed7-97e505d5e4f5 tempest-VolumesSnapshotTestJSON-1891174813 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba.info is being set with open permissions: ugo+rw Jul 16 23:31:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8018c797-5ccd-4388-9ed7-97e505d5e4f5 tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:47 devstack sudo[104030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba.info Jul 16 23:31:47 devstack sudo[104030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:47 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-a263eab5-9f34-44a5-8466-1fb989bff09d tempest-ProjectReaderTests-802587306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:31:48 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a263eab5-9f34-44a5-8466-1fb989bff09d tempest-ProjectReaderTests-802587306 None] Flow 'volume_create_manager' (80e787d7-69b4-497a-83d9-8ce303ff31d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:31:48 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a263eab5-9f34-44a5-8466-1fb989bff09d tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24e3aa9f-cf50-42c2-ab87-ef5a9de4af8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:48 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a263eab5-9f34-44a5-8466-1fb989bff09d tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24e3aa9f-cf50-42c2-ab87-ef5a9de4af8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-121390248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=928ba2bb-c50d-45f0-b999-65d68fcf2166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01405f67a073473e89de43b289e4f489',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:31:48Z,use_quota=True,user_id='41ca3471b2cb480284d0f1793f2ecd4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:48 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a263eab5-9f34-44a5-8466-1fb989bff09d tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (563e19aa-4f0d-42d3-ab25-29c6e7a01840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:48 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a263eab5-9f34-44a5-8466-1fb989bff09d tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (563e19aa-4f0d-42d3-ab25-29c6e7a01840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:48 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a263eab5-9f34-44a5-8466-1fb989bff09d tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e3ffaa0-2049-4e1e-a4b1-7c5e5d11d1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:48 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a263eab5-9f34-44a5-8466-1fb989bff09d tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e3ffaa0-2049-4e1e-a4b1-7c5e5d11d1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '928ba2bb-c50d-45f0-b999-65d68fcf2166', 'volume_name': 'volume-928ba2bb-c50d-45f0-b999-65d68fcf2166', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:48 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a263eab5-9f34-44a5-8466-1fb989bff09d tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd4efdf1-0b6f-4bf7-a956-f6991bd13fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:48 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a263eab5-9f34-44a5-8466-1fb989bff09d tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd4efdf1-0b6f-4bf7-a956-f6991bd13fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:48 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a263eab5-9f34-44a5-8466-1fb989bff09d tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b6fc3e-26dc-4be6-88e2-10d9717349c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:48 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-a263eab5-9f34-44a5-8466-1fb989bff09d tempest-ProjectReaderTests-802587306 None] Volume 928ba2bb-c50d-45f0-b999-65d68fcf2166: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-928ba2bb-c50d-45f0-b999-65d68fcf2166', 'volume_size': 1} Jul 16 23:31:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a263eab5-9f34-44a5-8466-1fb989bff09d tempest-ProjectReaderTests-802587306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:31:48 devstack sudo[104030]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8018c797-5ccd-4388-9ed7-97e505d5e4f5 tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba.info" returned: 0 in 0.276s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-8018c797-5ccd-4388-9ed7-97e505d5e4f5 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.099s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:31:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1b86aab7-dfa3-41cf-b067-1afa0e34fcdd tempest-CinderUnicodeTest-300297570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.807s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:31:48 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-1b86aab7-dfa3-41cf-b067-1afa0e34fcdd tempest-CinderUnicodeTest-300297570 None] Creating offline snapshot 2cef7c81-64d4-43bd-820d-6c6027cc0b51 of volume 6bea624a-c0f9-44a8-afbf-604a0ba8f58c {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:31:48 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-8018c797-5ccd-4388-9ed7-97e505d5e4f5 tempest-VolumesSnapshotTestJSON-1891174813 None] Create snapshot completed successfully Jul 16 23:31:48 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb69aabe-9bc1-4809-9e87-f0434c483cbd]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:31:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1b86aab7-dfa3-41cf-b067-1afa0e34fcdd tempest-CinderUnicodeTest-300297570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:48 devstack sudo[104033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c Jul 16 23:31:48 devstack sudo[104033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:48 devstack sudo[104033]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1b86aab7-dfa3-41cf-b067-1afa0e34fcdd tempest-CinderUnicodeTest-300297570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c" returned: 0 in 0.343s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1b86aab7-dfa3-41cf-b067-1afa0e34fcdd tempest-CinderUnicodeTest-300297570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c.2cef7c81-64d4-43bd-820d-6c6027cc0b51 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:48 devstack sudo[104038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c.2cef7c81-64d4-43bd-820d-6c6027cc0b51 1G Jul 16 23:31:48 devstack sudo[104038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:48 devstack sudo[104038]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1b86aab7-dfa3-41cf-b067-1afa0e34fcdd tempest-CinderUnicodeTest-300297570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c.2cef7c81-64d4-43bd-820d-6c6027cc0b51 1G" returned: 0 in 0.411s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1b86aab7-dfa3-41cf-b067-1afa0e34fcdd tempest-CinderUnicodeTest-300297570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c.2cef7c81-64d4-43bd-820d-6c6027cc0b51 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:48 devstack sudo[104044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c.2cef7c81-64d4-43bd-820d-6c6027cc0b51 Jul 16 23:31:48 devstack sudo[104044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:49 devstack sudo[104044]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1b86aab7-dfa3-41cf-b067-1afa0e34fcdd tempest-CinderUnicodeTest-300297570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c.2cef7c81-64d4-43bd-820d-6c6027cc0b51" returned: 0 in 0.307s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:49 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-1b86aab7-dfa3-41cf-b067-1afa0e34fcdd tempest-CinderUnicodeTest-300297570 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c.2cef7c81-64d4-43bd-820d-6c6027cc0b51 is being set with open permissions: ugo+rw Jul 16 23:31:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1b86aab7-dfa3-41cf-b067-1afa0e34fcdd tempest-CinderUnicodeTest-300297570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c.2cef7c81-64d4-43bd-820d-6c6027cc0b51 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:49 devstack sudo[104050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c.2cef7c81-64d4-43bd-820d-6c6027cc0b51 Jul 16 23:31:49 devstack sudo[104050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:49 devstack sudo[104050]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1b86aab7-dfa3-41cf-b067-1afa0e34fcdd tempest-CinderUnicodeTest-300297570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c.2cef7c81-64d4-43bd-820d-6c6027cc0b51" returned: 0 in 0.244s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:49 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:31:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1b86aab7-dfa3-41cf-b067-1afa0e34fcdd tempest-CinderUnicodeTest-300297570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:49 devstack sudo[104053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c.info Jul 16 23:31:49 devstack sudo[104053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:49 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Flow 'volume_create_manager' (5b2a009c-89fc-4198-a3e7-c38831132b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:31:49 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (565cd88c-1eef-466c-b673-d30b02fda70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:49 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (565cd88c-1eef-466c-b673-d30b02fda70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:31:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-942597237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d97cd8bd-af9d-47d8-8b04-2a2e8c5e9e58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25755d47f6c74cbb92e3f7cd7c69f0be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:31:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=6718bccc-bfcf-4a4f-91f9-d691a4048a33,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:31:49Z,use_quota=True,user_id='d9c88f9640af4738aaae5d2c25184049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:49 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37990cef-f717-47a4-8d49-6fdb079ae08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:49 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37990cef-f717-47a4-8d49-6fdb079ae08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:49 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d634b5e-6a2e-41ef-afed-68708c36424b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:49 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d634b5e-6a2e-41ef-afed-68708c36424b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd97cd8bd-af9d-47d8-8b04-2a2e8c5e9e58', 'volume_name': 'volume-d97cd8bd-af9d-47d8-8b04-2a2e8c5e9e58', 'volume_size': 2, 'snapshot_id': '6718bccc-bfcf-4a4f-91f9-d691a4048a33'}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:49 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (352f6b23-f88f-490e-b71f-38ef2d52525d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:49 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (352f6b23-f88f-490e-b71f-38ef2d52525d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:49 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2e9cba6-9504-4e4f-836f-66deea5cf18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:49 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Volume d97cd8bd-af9d-47d8-8b04-2a2e8c5e9e58: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d97cd8bd-af9d-47d8-8b04-2a2e8c5e9e58', 'volume_size': 2, 'snapshot_id': '6718bccc-bfcf-4a4f-91f9-d691a4048a33'} Jul 16 23:31:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:31:49 devstack sudo[104053]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1b86aab7-dfa3-41cf-b067-1afa0e34fcdd tempest-CinderUnicodeTest-300297570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c.info" returned: 0 in 0.244s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:49 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-1b86aab7-dfa3-41cf-b067-1afa0e34fcdd tempest-CinderUnicodeTest-300297570 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c.info is being set with open permissions: ugo+rw Jul 16 23:31:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1b86aab7-dfa3-41cf-b067-1afa0e34fcdd tempest-CinderUnicodeTest-300297570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:49 devstack sudo[104056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c.info Jul 16 23:31:49 devstack sudo[104056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:50 devstack sudo[104056]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1b86aab7-dfa3-41cf-b067-1afa0e34fcdd tempest-CinderUnicodeTest-300297570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c.info" returned: 0 in 0.235s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1b86aab7-dfa3-41cf-b067-1afa0e34fcdd tempest-CinderUnicodeTest-300297570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.897s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a263eab5-9f34-44a5-8466-1fb989bff09d tempest-ProjectReaderTests-802587306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.948s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a263eab5-9f34-44a5-8466-1fb989bff09d tempest-ProjectReaderTests-802587306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-121390248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=928ba2bb-c50d-45f0-b999-65d68fcf2166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01405f67a073473e89de43b289e4f489',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:31:48Z,use_quota=True,user_id='41ca3471b2cb480284d0f1793f2ecd4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-a263eab5-9f34-44a5-8466-1fb989bff09d tempest-ProjectReaderTests-802587306 None] Creating volume 928ba2bb-c50d-45f0-b999-65d68fcf2166 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a263eab5-9f34-44a5-8466-1fb989bff09d tempest-ProjectReaderTests-802587306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a263eab5-9f34-44a5-8466-1fb989bff09d tempest-ProjectReaderTests-802587306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a263eab5-9f34-44a5-8466-1fb989bff09d tempest-ProjectReaderTests-802587306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a263eab5-9f34-44a5-8466-1fb989bff09d tempest-ProjectReaderTests-802587306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a263eab5-9f34-44a5-8466-1fb989bff09d tempest-ProjectReaderTests-802587306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a263eab5-9f34-44a5-8466-1fb989bff09d tempest-ProjectReaderTests-802587306 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:31:50 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-a263eab5-9f34-44a5-8466-1fb989bff09d tempest-ProjectReaderTests-802587306 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a263eab5-9f34-44a5-8466-1fb989bff09d tempest-ProjectReaderTests-802587306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-928ba2bb-c50d-45f0-b999-65d68fcf2166 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:50 devstack sudo[104059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-928ba2bb-c50d-45f0-b999-65d68fcf2166 1073741824 Jul 16 23:31:50 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:50 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-1b86aab7-dfa3-41cf-b067-1afa0e34fcdd tempest-CinderUnicodeTest-300297570 None] Create snapshot completed successfully Jul 16 23:31:50 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-bce475f9-85cb-49ea-ae4d-bdf763026c11 tempest-CinderUnicodeTest-300297570 None] Acquiring lock "cinder-2cef7c81-64d4-43bd-820d-6c6027cc0b51-delete_snapshot" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a263eab5-9f34-44a5-8466-1fb989bff09d tempest-ProjectReaderTests-802587306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-928ba2bb-c50d-45f0-b999-65d68fcf2166 1073741824" returned: 0 in 0.428s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-bce475f9-85cb-49ea-ae4d-bdf763026c11 tempest-CinderUnicodeTest-300297570 None] Lock "cinder-2cef7c81-64d4-43bd-820d-6c6027cc0b51-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-bce475f9-85cb-49ea-ae4d-bdf763026c11 tempest-CinderUnicodeTest-300297570 None] Acquiring lock "cinder-quobyte-6bea624a-c0f9-44a8-afbf-604a0ba8f58c" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-bce475f9-85cb-49ea-ae4d-bdf763026c11 tempest-CinderUnicodeTest-300297570 None] Lock "cinder-quobyte-6bea624a-c0f9-44a8-afbf-604a0ba8f58c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-bce475f9-85cb-49ea-ae4d-bdf763026c11 tempest-CinderUnicodeTest-300297570 None] Acquiring lock "cinder-quobyte-2cef7c81-64d4-43bd-820d-6c6027cc0b51" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a263eab5-9f34-44a5-8466-1fb989bff09d tempest-ProjectReaderTests-802587306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-928ba2bb-c50d-45f0-b999-65d68fcf2166 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-bce475f9-85cb-49ea-ae4d-bdf763026c11 tempest-CinderUnicodeTest-300297570 None] Lock "cinder-quobyte-2cef7c81-64d4-43bd-820d-6c6027cc0b51" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-bce475f9-85cb-49ea-ae4d-bdf763026c11 tempest-CinderUnicodeTest-300297570 None] Deleting offline snapshot 2cef7c81-64d4-43bd-820d-6c6027cc0b51 of volume 6bea624a-c0f9-44a8-afbf-604a0ba8f58c {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:31:50 devstack sudo[104065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-928ba2bb-c50d-45f0-b999-65d68fcf2166 Jul 16 23:31:50 devstack sudo[104065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-bce475f9-85cb-49ea-ae4d-bdf763026c11 tempest-CinderUnicodeTest-300297570 None] snapshot_file for this snap is: volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c.2cef7c81-64d4-43bd-820d-6c6027cc0b51 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0de2a2-24b7-4c56-b620-5f665cc59bd9]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bce475f9-85cb-49ea-ae4d-bdf763026c11 tempest-CinderUnicodeTest-300297570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c.2cef7c81-64d4-43bd-820d-6c6027cc0b51 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:50 devstack sudo[104070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c.2cef7c81-64d4-43bd-820d-6c6027cc0b51 Jul 16 23:31:50 devstack sudo[104070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:50 devstack sudo[104065]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a263eab5-9f34-44a5-8466-1fb989bff09d tempest-ProjectReaderTests-802587306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-928ba2bb-c50d-45f0-b999-65d68fcf2166" returned: 0 in 0.242s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a263eab5-9f34-44a5-8466-1fb989bff09d tempest-ProjectReaderTests-802587306 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a263eab5-9f34-44a5-8466-1fb989bff09d tempest-ProjectReaderTests-802587306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.139s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Acquiring lock "cinder-quobyte-6718bccc-bfcf-4a4f-91f9-d691a4048a33-d97cd8bd-af9d-47d8-8b04-2a2e8c5e9e58" by "_create_volume_from_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a263eab5-9f34-44a5-8466-1fb989bff09d tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b6fc3e-26dc-4be6-88e2-10d9717349c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-928ba2bb-c50d-45f0-b999-65d68fcf2166', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a263eab5-9f34-44a5-8466-1fb989bff09d tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9713c9c-088b-42de-8b60-29b9431b8e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-quobyte-6718bccc-bfcf-4a4f-91f9-d691a4048a33-d97cd8bd-af9d-47d8-8b04-2a2e8c5e9e58" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Creating volume d97cd8bd-af9d-47d8-8b04-2a2e8c5e9e58 from snapshot 6718bccc-bfcf-4a4f-91f9-d691a4048a33 {{(pid=87607) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Acquiring lock "cinder-quobyte-d97cd8bd-af9d-47d8-8b04-2a2e8c5e9e58" by "_copy_volume_from_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:31:50 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-a263eab5-9f34-44a5-8466-1fb989bff09d tempest-ProjectReaderTests-802587306 None] Volume volume-928ba2bb-c50d-45f0-b999-65d68fcf2166 (928ba2bb-c50d-45f0-b999-65d68fcf2166): created successfully Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a263eab5-9f34-44a5-8466-1fb989bff09d tempest-ProjectReaderTests-802587306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9713c9c-088b-42de-8b60-29b9431b8e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a263eab5-9f34-44a5-8466-1fb989bff09d tempest-ProjectReaderTests-802587306 None] Flow 'volume_create_manager' (80e787d7-69b4-497a-83d9-8ce303ff31d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-quobyte-d97cd8bd-af9d-47d8-8b04-2a2e8c5e9e58" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] snapshot: 6718bccc-bfcf-4a4f-91f9-d691a4048a33, volume: d97cd8bd-af9d-47d8-8b04-2a2e8c5e9e58, {{(pid=87607) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:31:50 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-a263eab5-9f34-44a5-8466-1fb989bff09d tempest-ProjectReaderTests-802587306 None] Created volume successfully. Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26d8561-08bc-4858-96fd-fc4f20511c3d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba.6718bccc-bfcf-4a4f-91f9-d691a4048a33 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:50 devstack sudo[104070]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bce475f9-85cb-49ea-ae4d-bdf763026c11 tempest-CinderUnicodeTest-300297570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c.2cef7c81-64d4-43bd-820d-6c6027cc0b51" returned: 0 in 0.372s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-bce475f9-85cb-49ea-ae4d-bdf763026c11 tempest-CinderUnicodeTest-300297570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59f44d5-500d-47c5-92e3-79d1419e84a6]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:31:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bce475f9-85cb-49ea-ae4d-bdf763026c11 tempest-CinderUnicodeTest-300297570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:51 devstack sudo[104079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba.6718bccc-bfcf-4a4f-91f9-d691a4048a33 Jul 16 23:31:51 devstack sudo[104079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:51 devstack sudo[104080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c Jul 16 23:31:51 devstack sudo[104080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:51 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-585bd72a-8e0e-432b-a5f4-ca9b01c102b7 tempest-ProjectReaderTests-802587306 None] Acquiring lock "cinder-928ba2bb-c50d-45f0-b999-65d68fcf2166-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:31:51 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-585bd72a-8e0e-432b-a5f4-ca9b01c102b7 tempest-ProjectReaderTests-802587306 None] Lock "cinder-928ba2bb-c50d-45f0-b999-65d68fcf2166-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:31:51 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-585bd72a-8e0e-432b-a5f4-ca9b01c102b7 tempest-ProjectReaderTests-802587306 None] Acquiring lock "cinder-quobyte-928ba2bb-c50d-45f0-b999-65d68fcf2166" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:31:51 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-585bd72a-8e0e-432b-a5f4-ca9b01c102b7 tempest-ProjectReaderTests-802587306 None] Lock "cinder-quobyte-928ba2bb-c50d-45f0-b999-65d68fcf2166" acquired by "delete_volume" :: waited 0.025s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:31:51 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d4387d-0d4f-4ae0-8d47-87a72b0956c5]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:31:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-585bd72a-8e0e-432b-a5f4-ca9b01c102b7 tempest-ProjectReaderTests-802587306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-928ba2bb-c50d-45f0-b999-65d68fcf2166 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:51 devstack sudo[104079]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba.6718bccc-bfcf-4a4f-91f9-d691a4048a33" returned: 0 in 0.423s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:51 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:31:51 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba {{(pid=87607) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 16 23:31:51 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Creating direct copy from snapshot {{(pid=87607) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 16 23:31:51 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ca5777-9572-4df4-bc0f-9a94230165d8]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:31:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:51 devstack sudo[104080]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bce475f9-85cb-49ea-ae4d-bdf763026c11 tempest-CinderUnicodeTest-300297570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c" returned: 0 in 0.389s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bce475f9-85cb-49ea-ae4d-bdf763026c11 tempest-CinderUnicodeTest-300297570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c.2cef7c81-64d4-43bd-820d-6c6027cc0b51 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:51 devstack sudo[104091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c.2cef7c81-64d4-43bd-820d-6c6027cc0b51 Jul 16 23:31:51 devstack sudo[104091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:51 devstack sudo[104088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-928ba2bb-c50d-45f0-b999-65d68fcf2166 Jul 16 23:31:51 devstack sudo[104088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:51 devstack sudo[104090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba Jul 16 23:31:51 devstack sudo[104090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:51 devstack sudo[104088]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-585bd72a-8e0e-432b-a5f4-ca9b01c102b7 tempest-ProjectReaderTests-802587306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-928ba2bb-c50d-45f0-b999-65d68fcf2166" returned: 0 in 0.399s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-585bd72a-8e0e-432b-a5f4-ca9b01c102b7 tempest-ProjectReaderTests-802587306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-928ba2bb-c50d-45f0-b999-65d68fcf2166 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:51 devstack sudo[104103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-928ba2bb-c50d-45f0-b999-65d68fcf2166 Jul 16 23:31:51 devstack sudo[104103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:51 devstack sudo[104091]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bce475f9-85cb-49ea-ae4d-bdf763026c11 tempest-CinderUnicodeTest-300297570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c.2cef7c81-64d4-43bd-820d-6c6027cc0b51" returned: 0 in 0.379s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bce475f9-85cb-49ea-ae4d-bdf763026c11 tempest-CinderUnicodeTest-300297570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c.2cef7c81-64d4-43bd-820d-6c6027cc0b51 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:51 devstack sudo[104090]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba" returned: 0 in 0.415s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:51 devstack sudo[104106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c.2cef7c81-64d4-43bd-820d-6c6027cc0b51 Jul 16 23:31:51 devstack sudo[104106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:51 devstack cinder-volume[87607]: DEBUG cinder.utils [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Path /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d97cd8bd-af9d-47d8-8b04-2a2e8c5e9e58 not found in is_blk_device check {{(pid=87607) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 16 23:31:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d97cd8bd-af9d-47d8-8b04-2a2e8c5e9e58 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:51 devstack sudo[104108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d97cd8bd-af9d-47d8-8b04-2a2e8c5e9e58 Jul 16 23:31:51 devstack sudo[104108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:51 devstack sudo[104103]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-585bd72a-8e0e-432b-a5f4-ca9b01c102b7 tempest-ProjectReaderTests-802587306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-928ba2bb-c50d-45f0-b999-65d68fcf2166" returned: 0 in 0.260s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:51 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-585bd72a-8e0e-432b-a5f4-ca9b01c102b7 tempest-ProjectReaderTests-802587306 None] Lock "cinder-quobyte-928ba2bb-c50d-45f0-b999-65d68fcf2166" released by "delete_volume" :: held 0.704s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:31:52 devstack sudo[104106]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:52 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-585bd72a-8e0e-432b-a5f4-ca9b01c102b7 tempest-ProjectReaderTests-802587306 None] Created reservations ['8771808e-a888-4f6e-8c58-73140d877c09', 'f6de46fd-99df-41de-babc-3f235ecef4e1', '5c9b72c8-13de-4c98-bca1-a2aad2a3425d', '4731e063-862f-4686-8744-752326cad9ef'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:31:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bce475f9-85cb-49ea-ae4d-bdf763026c11 tempest-CinderUnicodeTest-300297570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c.2cef7c81-64d4-43bd-820d-6c6027cc0b51" returned: 0 in 0.282s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:52 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-bce475f9-85cb-49ea-ae4d-bdf763026c11 tempest-CinderUnicodeTest-300297570 None] Lock "cinder-quobyte-2cef7c81-64d4-43bd-820d-6c6027cc0b51" released by "_delete_snapshot" :: held 1.544s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:31:52 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-bce475f9-85cb-49ea-ae4d-bdf763026c11 tempest-CinderUnicodeTest-300297570 None] Lock "cinder-quobyte-6bea624a-c0f9-44a8-afbf-604a0ba8f58c" released by "delete_snapshot" :: held 1.582s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:31:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-585bd72a-8e0e-432b-a5f4-ca9b01c102b7 tempest-ProjectReaderTests-802587306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:31:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-585bd72a-8e0e-432b-a5f4-ca9b01c102b7 tempest-ProjectReaderTests-802587306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:31:52 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-585bd72a-8e0e-432b-a5f4-ca9b01c102b7 tempest-ProjectReaderTests-802587306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:31:52 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-585bd72a-8e0e-432b-a5f4-ca9b01c102b7 tempest-ProjectReaderTests-802587306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:31:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-585bd72a-8e0e-432b-a5f4-ca9b01c102b7 tempest-ProjectReaderTests-802587306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:31:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-585bd72a-8e0e-432b-a5f4-ca9b01c102b7 tempest-ProjectReaderTests-802587306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:52 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-bce475f9-85cb-49ea-ae4d-bdf763026c11 tempest-CinderUnicodeTest-300297570 None] Created reservations ['31ed7fff-3b2a-4997-a6ec-98279f957579', '1065f099-9a93-44b1-827c-1a0a0d94f05a', 'e0d993b0-fc2b-4c42-adde-ddd800a5d00e', 'bad6744d-6a28-4b97-a001-5e12a448a4f8'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:31:52 devstack sudo[104116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:31:52 devstack sudo[104116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:52 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-bce475f9-85cb-49ea-ae4d-bdf763026c11 tempest-CinderUnicodeTest-300297570 None] Delete snapshot completed successfully. Jul 16 23:31:52 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-bce475f9-85cb-49ea-ae4d-bdf763026c11 tempest-CinderUnicodeTest-300297570 None] Lock "cinder-2cef7c81-64d4-43bd-820d-6c6027cc0b51-delete_snapshot" released by "delete_snapshot" :: held 1.782s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:31:52 devstack sudo[104116]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-585bd72a-8e0e-432b-a5f4-ca9b01c102b7 tempest-ProjectReaderTests-802587306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.622s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:52 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-585bd72a-8e0e-432b-a5f4-ca9b01c102b7 tempest-ProjectReaderTests-802587306 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:31:52 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-585bd72a-8e0e-432b-a5f4-ca9b01c102b7 tempest-ProjectReaderTests-802587306 None] Deleted volume successfully. Jul 16 23:31:52 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1f0a3421-afd0-49b2-ae1a-b0e3d13d12ea tempest-CinderUnicodeTest-300297570 None] Acquiring lock "cinder-6bea624a-c0f9-44a8-afbf-604a0ba8f58c-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:31:52 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1f0a3421-afd0-49b2-ae1a-b0e3d13d12ea tempest-CinderUnicodeTest-300297570 None] Lock "cinder-6bea624a-c0f9-44a8-afbf-604a0ba8f58c-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:31:52 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-585bd72a-8e0e-432b-a5f4-ca9b01c102b7 tempest-ProjectReaderTests-802587306 None] Lock "cinder-928ba2bb-c50d-45f0-b999-65d68fcf2166-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:31:53 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1f0a3421-afd0-49b2-ae1a-b0e3d13d12ea tempest-CinderUnicodeTest-300297570 None] Acquiring lock "cinder-quobyte-6bea624a-c0f9-44a8-afbf-604a0ba8f58c" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:31:53 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1f0a3421-afd0-49b2-ae1a-b0e3d13d12ea tempest-CinderUnicodeTest-300297570 None] Lock "cinder-quobyte-6bea624a-c0f9-44a8-afbf-604a0ba8f58c" acquired by "delete_volume" :: waited 0.049s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:31:53 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac44f8e0-2da8-464c-b86a-dd8279e8359c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:31:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1f0a3421-afd0-49b2-ae1a-b0e3d13d12ea tempest-CinderUnicodeTest-300297570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:53 devstack sudo[104125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c Jul 16 23:31:53 devstack sudo[104125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:54 devstack sudo[104125]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1f0a3421-afd0-49b2-ae1a-b0e3d13d12ea tempest-CinderUnicodeTest-300297570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c" returned: 0 in 1.072s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1f0a3421-afd0-49b2-ae1a-b0e3d13d12ea tempest-CinderUnicodeTest-300297570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:54 devstack sudo[104132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c Jul 16 23:31:54 devstack sudo[104132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:54 devstack sudo[104132]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1f0a3421-afd0-49b2-ae1a-b0e3d13d12ea tempest-CinderUnicodeTest-300297570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6bea624a-c0f9-44a8-afbf-604a0ba8f58c" returned: 0 in 0.671s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:54 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1f0a3421-afd0-49b2-ae1a-b0e3d13d12ea tempest-CinderUnicodeTest-300297570 None] Lock "cinder-quobyte-6bea624a-c0f9-44a8-afbf-604a0ba8f58c" released by "delete_volume" :: held 1.910s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:31:55 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-1f0a3421-afd0-49b2-ae1a-b0e3d13d12ea tempest-CinderUnicodeTest-300297570 None] Created reservations ['395d4b0e-b61b-4043-9cb8-250ee3e49664', '1e83494e-4629-4d5f-a68d-829eb5921f3d', '4a36dd0b-43e7-43f8-8d8a-dd97c9825a11', 'aa8d7976-0f90-4cc1-b9ee-3051c4a2a337'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:31:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1f0a3421-afd0-49b2-ae1a-b0e3d13d12ea tempest-CinderUnicodeTest-300297570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:31:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1f0a3421-afd0-49b2-ae1a-b0e3d13d12ea tempest-CinderUnicodeTest-300297570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:31:55 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1f0a3421-afd0-49b2-ae1a-b0e3d13d12ea tempest-CinderUnicodeTest-300297570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:31:55 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1f0a3421-afd0-49b2-ae1a-b0e3d13d12ea tempest-CinderUnicodeTest-300297570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:31:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1f0a3421-afd0-49b2-ae1a-b0e3d13d12ea tempest-CinderUnicodeTest-300297570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:31:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1f0a3421-afd0-49b2-ae1a-b0e3d13d12ea tempest-CinderUnicodeTest-300297570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:55 devstack sudo[104135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:31:55 devstack sudo[104135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:55 devstack sudo[104135]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1f0a3421-afd0-49b2-ae1a-b0e3d13d12ea tempest-CinderUnicodeTest-300297570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.589s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:56 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-1f0a3421-afd0-49b2-ae1a-b0e3d13d12ea tempest-CinderUnicodeTest-300297570 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:31:56 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-1f0a3421-afd0-49b2-ae1a-b0e3d13d12ea tempest-CinderUnicodeTest-300297570 None] Deleted volume successfully. Jul 16 23:31:56 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1f0a3421-afd0-49b2-ae1a-b0e3d13d12ea tempest-CinderUnicodeTest-300297570 None] Lock "cinder-6bea624a-c0f9-44a8-afbf-604a0ba8f58c-delete_volume" released by "delete_volume" :: held 3.160s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:31:56 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0cd70045-19de-4458-87f9-73c17dae42b9 tempest-CinderUnicodeTest-300297570 None] Acquiring lock "cinder-3d047743-65fd-4db3-8c1b-5552708666cd-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:31:56 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0cd70045-19de-4458-87f9-73c17dae42b9 tempest-CinderUnicodeTest-300297570 None] Lock "cinder-3d047743-65fd-4db3-8c1b-5552708666cd-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:31:56 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0cd70045-19de-4458-87f9-73c17dae42b9 tempest-CinderUnicodeTest-300297570 None] Acquiring lock "cinder-quobyte-3d047743-65fd-4db3-8c1b-5552708666cd" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:31:56 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0cd70045-19de-4458-87f9-73c17dae42b9 tempest-CinderUnicodeTest-300297570 None] Lock "cinder-quobyte-3d047743-65fd-4db3-8c1b-5552708666cd" acquired by "delete_volume" :: waited 0.021s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:31:56 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e57a0eb-9c81-4478-8b87-bb89d5adeb70]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:31:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0cd70045-19de-4458-87f9-73c17dae42b9 tempest-CinderUnicodeTest-300297570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3d047743-65fd-4db3-8c1b-5552708666cd {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:57 devstack sudo[104139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3d047743-65fd-4db3-8c1b-5552708666cd Jul 16 23:31:57 devstack sudo[104139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:57 devstack sudo[104108]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d97cd8bd-af9d-47d8-8b04-2a2e8c5e9e58" returned: 0 in 5.396s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:57 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7198b3-6d64-4900-b7ef-309b51301f88]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:31:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:57 devstack sudo[104141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba Jul 16 23:31:57 devstack sudo[104141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:57 devstack sudo[104139]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0cd70045-19de-4458-87f9-73c17dae42b9 tempest-CinderUnicodeTest-300297570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3d047743-65fd-4db3-8c1b-5552708666cd" returned: 0 in 0.536s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0cd70045-19de-4458-87f9-73c17dae42b9 tempest-CinderUnicodeTest-300297570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3d047743-65fd-4db3-8c1b-5552708666cd {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:57 devstack sudo[104146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3d047743-65fd-4db3-8c1b-5552708666cd Jul 16 23:31:57 devstack sudo[104146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:57 devstack sudo[104146]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0cd70045-19de-4458-87f9-73c17dae42b9 tempest-CinderUnicodeTest-300297570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3d047743-65fd-4db3-8c1b-5552708666cd" returned: 0 in 0.251s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:57 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0cd70045-19de-4458-87f9-73c17dae42b9 tempest-CinderUnicodeTest-300297570 None] Lock "cinder-quobyte-3d047743-65fd-4db3-8c1b-5552708666cd" released by "delete_volume" :: held 0.877s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:31:57 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-0cd70045-19de-4458-87f9-73c17dae42b9 tempest-CinderUnicodeTest-300297570 None] Created reservations ['f7a4d4de-0745-479f-b81c-1850831314f8', 'ac475b3d-02ae-45f2-b6aa-62cf278db780', '33e46e14-91dd-4d8c-887d-4af6c1d82570', '3e9bc80d-b0e9-45f2-8ccc-86d7fb4b5e5c'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:31:57 devstack sudo[104141]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba" returned: 0 in 0.551s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:57 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Image conversion details: src /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba, size 1024.00 MB, duration 5.40 sec, destination /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d97cd8bd-af9d-47d8-8b04-2a2e8c5e9e58 {{(pid=87607) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 23:31:57 devstack cinder-volume[87607]: INFO cinder.image.image_utils [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Converted 1024.00 MB image at 189.72 MB/s Jul 16 23:31:57 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d97cd8bd-af9d-47d8-8b04-2a2e8c5e9e58 is being set with open permissions: ugo+rw Jul 16 23:31:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d97cd8bd-af9d-47d8-8b04-2a2e8c5e9e58 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0cd70045-19de-4458-87f9-73c17dae42b9 tempest-CinderUnicodeTest-300297570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:31:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0cd70045-19de-4458-87f9-73c17dae42b9 tempest-CinderUnicodeTest-300297570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:31:57 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0cd70045-19de-4458-87f9-73c17dae42b9 tempest-CinderUnicodeTest-300297570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:31:57 devstack sudo[104153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d97cd8bd-af9d-47d8-8b04-2a2e8c5e9e58 Jul 16 23:31:57 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:57 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0cd70045-19de-4458-87f9-73c17dae42b9 tempest-CinderUnicodeTest-300297570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:31:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0cd70045-19de-4458-87f9-73c17dae42b9 tempest-CinderUnicodeTest-300297570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:31:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0cd70045-19de-4458-87f9-73c17dae42b9 tempest-CinderUnicodeTest-300297570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:57 devstack sudo[104155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:31:57 devstack sudo[104155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:58 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d97cd8bd-af9d-47d8-8b04-2a2e8c5e9e58" returned: 0 in 0.281s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:58 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-quobyte-d97cd8bd-af9d-47d8-8b04-2a2e8c5e9e58" released by "_copy_volume_from_snapshot" :: held 7.175s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:31:58 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-quobyte-6718bccc-bfcf-4a4f-91f9-d691a4048a33-d97cd8bd-af9d-47d8-8b04-2a2e8c5e9e58" released by "_create_volume_from_snapshot" :: held 7.231s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:31:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.270s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:31:58 devstack sudo[104155]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2e9cba6-9504-4e4f-836f-66deea5cf18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d97cd8bd-af9d-47d8-8b04-2a2e8c5e9e58', 'volume_size': 2, 'snapshot_id': '6718bccc-bfcf-4a4f-91f9-d691a4048a33'}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4ab1f92-e1b4-4c12-9fc6-20d82668239f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:31:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0cd70045-19de-4458-87f9-73c17dae42b9 tempest-CinderUnicodeTest-300297570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.311s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:58 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-0cd70045-19de-4458-87f9-73c17dae42b9 tempest-CinderUnicodeTest-300297570 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:31:58 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-0cd70045-19de-4458-87f9-73c17dae42b9 tempest-CinderUnicodeTest-300297570 None] Deleted volume successfully. Jul 16 23:31:58 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Volume volume-d97cd8bd-af9d-47d8-8b04-2a2e8c5e9e58 (d97cd8bd-af9d-47d8-8b04-2a2e8c5e9e58): created successfully Jul 16 23:31:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4ab1f92-e1b4-4c12-9fc6-20d82668239f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:31:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Flow 'volume_create_manager' (5b2a009c-89fc-4198-a3e7-c38831132b40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:31:58 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0cd70045-19de-4458-87f9-73c17dae42b9 tempest-CinderUnicodeTest-300297570 None] Lock "cinder-3d047743-65fd-4db3-8c1b-5552708666cd-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:31:58 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-a6b3ee3c-7dac-4326-af32-9962b0eb5fb3 tempest-VolumesSnapshotTestJSON-1891174813 None] Created volume successfully. Jul 16 23:31:58 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6b3fe35e-605f-4884-a683-1410cfbc7dc8 tempest-VolumesSnapshotTestJSON-1891174813 None] Acquiring lock "cinder-d97cd8bd-af9d-47d8-8b04-2a2e8c5e9e58-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:31:58 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6b3fe35e-605f-4884-a683-1410cfbc7dc8 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-d97cd8bd-af9d-47d8-8b04-2a2e8c5e9e58-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:31:58 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6b3fe35e-605f-4884-a683-1410cfbc7dc8 tempest-VolumesSnapshotTestJSON-1891174813 None] Acquiring lock "cinder-quobyte-d97cd8bd-af9d-47d8-8b04-2a2e8c5e9e58" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:31:58 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6b3fe35e-605f-4884-a683-1410cfbc7dc8 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-quobyte-d97cd8bd-af9d-47d8-8b04-2a2e8c5e9e58" acquired by "delete_volume" :: waited 0.018s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:31:58 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08a1f29-31b3-4e11-9d78-8e6d4c495944]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:31:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6b3fe35e-605f-4884-a683-1410cfbc7dc8 tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d97cd8bd-af9d-47d8-8b04-2a2e8c5e9e58 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:58 devstack sudo[104159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d97cd8bd-af9d-47d8-8b04-2a2e8c5e9e58 Jul 16 23:31:58 devstack sudo[104159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:58 devstack sudo[104159]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6b3fe35e-605f-4884-a683-1410cfbc7dc8 tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d97cd8bd-af9d-47d8-8b04-2a2e8c5e9e58" returned: 0 in 0.397s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6b3fe35e-605f-4884-a683-1410cfbc7dc8 tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d97cd8bd-af9d-47d8-8b04-2a2e8c5e9e58 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:59 devstack sudo[104164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d97cd8bd-af9d-47d8-8b04-2a2e8c5e9e58 Jul 16 23:31:59 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:59 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6b3fe35e-605f-4884-a683-1410cfbc7dc8 tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d97cd8bd-af9d-47d8-8b04-2a2e8c5e9e58" returned: 0 in 0.267s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:59 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6b3fe35e-605f-4884-a683-1410cfbc7dc8 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-quobyte-d97cd8bd-af9d-47d8-8b04-2a2e8c5e9e58" released by "delete_volume" :: held 0.704s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:31:59 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-6b3fe35e-605f-4884-a683-1410cfbc7dc8 tempest-VolumesSnapshotTestJSON-1891174813 None] Created reservations ['cee4a05e-184e-4865-b77c-7bc6c657fa99', '7f1d4ff9-e19d-4c81-a48c-5ca61a68c4ee', 'd4f8345c-869d-4126-8a03-913b913c5a62', '8136da13-86f2-4995-b928-bf175dda20a9'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:31:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6b3fe35e-605f-4884-a683-1410cfbc7dc8 tempest-VolumesSnapshotTestJSON-1891174813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:31:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6b3fe35e-605f-4884-a683-1410cfbc7dc8 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:31:59 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-6b3fe35e-605f-4884-a683-1410cfbc7dc8 tempest-VolumesSnapshotTestJSON-1891174813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:31:59 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-6b3fe35e-605f-4884-a683-1410cfbc7dc8 tempest-VolumesSnapshotTestJSON-1891174813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:31:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6b3fe35e-605f-4884-a683-1410cfbc7dc8 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:31:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6b3fe35e-605f-4884-a683-1410cfbc7dc8 tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:59 devstack sudo[104168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:31:59 devstack sudo[104168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:31:59 devstack sudo[104168]: pam_unix(sudo:session): session closed for user root Jul 16 23:31:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6b3fe35e-605f-4884-a683-1410cfbc7dc8 tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.269s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:31:59 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-6b3fe35e-605f-4884-a683-1410cfbc7dc8 tempest-VolumesSnapshotTestJSON-1891174813 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:31:59 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-6b3fe35e-605f-4884-a683-1410cfbc7dc8 tempest-VolumesSnapshotTestJSON-1891174813 None] Deleted volume successfully. Jul 16 23:31:59 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-6b3fe35e-605f-4884-a683-1410cfbc7dc8 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-d97cd8bd-af9d-47d8-8b04-2a2e8c5e9e58-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:31:59 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ac61add0-7ea6-4c3d-b572-ace4b3e13110 tempest-VolumesSnapshotTestJSON-1891174813 None] Acquiring lock "cinder-6718bccc-bfcf-4a4f-91f9-d691a4048a33-delete_snapshot" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:31:59 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ac61add0-7ea6-4c3d-b572-ace4b3e13110 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-6718bccc-bfcf-4a4f-91f9-d691a4048a33-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:31:59 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ac61add0-7ea6-4c3d-b572-ace4b3e13110 tempest-VolumesSnapshotTestJSON-1891174813 None] Acquiring lock "cinder-quobyte-07a7ed21-ab7b-4c2e-8455-959d7bd612ba" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:31:59 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ac61add0-7ea6-4c3d-b572-ace4b3e13110 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-quobyte-07a7ed21-ab7b-4c2e-8455-959d7bd612ba" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:31:59 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ac61add0-7ea6-4c3d-b572-ace4b3e13110 tempest-VolumesSnapshotTestJSON-1891174813 None] Acquiring lock "cinder-quobyte-6718bccc-bfcf-4a4f-91f9-d691a4048a33" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:31:59 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ac61add0-7ea6-4c3d-b572-ace4b3e13110 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-quobyte-6718bccc-bfcf-4a4f-91f9-d691a4048a33" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:31:59 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-ac61add0-7ea6-4c3d-b572-ace4b3e13110 tempest-VolumesSnapshotTestJSON-1891174813 None] Deleting offline snapshot 6718bccc-bfcf-4a4f-91f9-d691a4048a33 of volume 07a7ed21-ab7b-4c2e-8455-959d7bd612ba {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:31:59 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-ac61add0-7ea6-4c3d-b572-ace4b3e13110 tempest-VolumesSnapshotTestJSON-1891174813 None] snapshot_file for this snap is: volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba.6718bccc-bfcf-4a4f-91f9-d691a4048a33 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:31:59 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22fd7f3-3f8e-4eff-8802-2782ce87c8b2]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:31:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ac61add0-7ea6-4c3d-b572-ace4b3e13110 tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba.6718bccc-bfcf-4a4f-91f9-d691a4048a33 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:31:59 devstack sudo[104171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba.6718bccc-bfcf-4a4f-91f9-d691a4048a33 Jul 16 23:31:59 devstack sudo[104171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:00 devstack sudo[104171]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ac61add0-7ea6-4c3d-b572-ace4b3e13110 tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba.6718bccc-bfcf-4a4f-91f9-d691a4048a33" returned: 0 in 0.403s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:00 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-ac61add0-7ea6-4c3d-b572-ace4b3e13110 tempest-VolumesSnapshotTestJSON-1891174813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:32:00 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[77850106-6101-4d7e-b2c9-279174f13ad3]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:32:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ac61add0-7ea6-4c3d-b572-ace4b3e13110 tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:00 devstack sudo[104178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba Jul 16 23:32:00 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:00 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ac61add0-7ea6-4c3d-b572-ace4b3e13110 tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba" returned: 0 in 0.442s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ac61add0-7ea6-4c3d-b572-ace4b3e13110 tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba.6718bccc-bfcf-4a4f-91f9-d691a4048a33 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:00 devstack sudo[104183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba.6718bccc-bfcf-4a4f-91f9-d691a4048a33 Jul 16 23:32:00 devstack sudo[104183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:01 devstack sudo[104183]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ac61add0-7ea6-4c3d-b572-ace4b3e13110 tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba.6718bccc-bfcf-4a4f-91f9-d691a4048a33" returned: 0 in 0.401s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ac61add0-7ea6-4c3d-b572-ace4b3e13110 tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba.6718bccc-bfcf-4a4f-91f9-d691a4048a33 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:01 devstack sudo[104188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba.6718bccc-bfcf-4a4f-91f9-d691a4048a33 Jul 16 23:32:01 devstack sudo[104188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:01 devstack sudo[104188]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ac61add0-7ea6-4c3d-b572-ace4b3e13110 tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba.6718bccc-bfcf-4a4f-91f9-d691a4048a33" returned: 0 in 0.276s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:01 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ac61add0-7ea6-4c3d-b572-ace4b3e13110 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-quobyte-6718bccc-bfcf-4a4f-91f9-d691a4048a33" released by "_delete_snapshot" :: held 1.651s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:32:01 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ac61add0-7ea6-4c3d-b572-ace4b3e13110 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-quobyte-07a7ed21-ab7b-4c2e-8455-959d7bd612ba" released by "delete_snapshot" :: held 1.673s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:32:01 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-ac61add0-7ea6-4c3d-b572-ace4b3e13110 tempest-VolumesSnapshotTestJSON-1891174813 None] Created reservations ['d905c2e3-6ee9-4a92-805b-cdb492b64c15', '0f830074-dd30-412a-b74f-be4968f50e82', '60b816aa-a452-4494-8b13-84b827266ddb', 'd43fbbd3-b766-4a24-9868-eb5e00fd6423'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:32:01 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-ac61add0-7ea6-4c3d-b572-ace4b3e13110 tempest-VolumesSnapshotTestJSON-1891174813 None] Delete snapshot completed successfully. Jul 16 23:32:01 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ac61add0-7ea6-4c3d-b572-ace4b3e13110 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-6718bccc-bfcf-4a4f-91f9-d691a4048a33-delete_snapshot" released by "delete_snapshot" :: held 1.842s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:32:01 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-8f39b20d-37a5-4855-8ad8-d7ea79130899 tempest-VolumesSnapshotTestJSON-1891174813 None] Acquiring lock "cinder-07a7ed21-ab7b-4c2e-8455-959d7bd612ba-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:32:02 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-8f39b20d-37a5-4855-8ad8-d7ea79130899 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-07a7ed21-ab7b-4c2e-8455-959d7bd612ba-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:32:02 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-8f39b20d-37a5-4855-8ad8-d7ea79130899 tempest-VolumesSnapshotTestJSON-1891174813 None] Acquiring lock "cinder-quobyte-07a7ed21-ab7b-4c2e-8455-959d7bd612ba" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:32:02 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-8f39b20d-37a5-4855-8ad8-d7ea79130899 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-quobyte-07a7ed21-ab7b-4c2e-8455-959d7bd612ba" acquired by "delete_volume" :: waited 0.019s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:32:02 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a6d0b1-9bf4-4b62-bce2-1837f1be3f2f]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:32:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8f39b20d-37a5-4855-8ad8-d7ea79130899 tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:02 devstack sudo[104191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba Jul 16 23:32:02 devstack sudo[104191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:02 devstack sudo[104191]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8f39b20d-37a5-4855-8ad8-d7ea79130899 tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba" returned: 0 in 0.383s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8f39b20d-37a5-4855-8ad8-d7ea79130899 tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:02 devstack sudo[104196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba Jul 16 23:32:02 devstack sudo[104196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:02 devstack sudo[104196]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8f39b20d-37a5-4855-8ad8-d7ea79130899 tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-07a7ed21-ab7b-4c2e-8455-959d7bd612ba" returned: 0 in 0.267s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:02 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-8f39b20d-37a5-4855-8ad8-d7ea79130899 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-quobyte-07a7ed21-ab7b-4c2e-8455-959d7bd612ba" released by "delete_volume" :: held 0.710s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:32:02 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-8f39b20d-37a5-4855-8ad8-d7ea79130899 tempest-VolumesSnapshotTestJSON-1891174813 None] Created reservations ['d7650125-7f16-4d11-94b0-e26c1edd2463', 'bb328b1c-2a20-4969-9c5b-5eb89cfe56f7', '61457f3c-6213-401a-b567-8bf37cbc44f2', 'edd13ffe-3a46-461f-844a-773564a6f296'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:32:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-8f39b20d-37a5-4855-8ad8-d7ea79130899 tempest-VolumesSnapshotTestJSON-1891174813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:32:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-8f39b20d-37a5-4855-8ad8-d7ea79130899 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:32:02 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-8f39b20d-37a5-4855-8ad8-d7ea79130899 tempest-VolumesSnapshotTestJSON-1891174813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:32:02 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-8f39b20d-37a5-4855-8ad8-d7ea79130899 tempest-VolumesSnapshotTestJSON-1891174813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:32:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-8f39b20d-37a5-4855-8ad8-d7ea79130899 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:32:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8f39b20d-37a5-4855-8ad8-d7ea79130899 tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:02 devstack sudo[104199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:32:02 devstack sudo[104199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:03 devstack sudo[104199]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8f39b20d-37a5-4855-8ad8-d7ea79130899 tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.281s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:03 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-8f39b20d-37a5-4855-8ad8-d7ea79130899 tempest-VolumesSnapshotTestJSON-1891174813 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:32:03 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-8f39b20d-37a5-4855-8ad8-d7ea79130899 tempest-VolumesSnapshotTestJSON-1891174813 None] Deleted volume successfully. Jul 16 23:32:03 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-8f39b20d-37a5-4855-8ad8-d7ea79130899 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-07a7ed21-ab7b-4c2e-8455-959d7bd612ba-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:32:03 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-f68633d9-9d7d-4582-a931-caba4a98aa19 tempest-VolumesSnapshotTestJSON-1891174813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:32:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f68633d9-9d7d-4582-a931-caba4a98aa19 tempest-VolumesSnapshotTestJSON-1891174813 None] Flow 'volume_create_manager' (d7a694be-26da-46c5-9d7c-ea8061395b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:32:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f68633d9-9d7d-4582-a931-caba4a98aa19 tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b88f4ba-b690-4200-bf21-07f3e479ca96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:32:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f68633d9-9d7d-4582-a931-caba4a98aa19 tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b88f4ba-b690-4200-bf21-07f3e479ca96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2114872323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e399445-ca23-401b-a268-4473e0cf079b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25755d47f6c74cbb92e3f7cd7c69f0be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:32:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:32:04Z,use_quota=True,user_id='d9c88f9640af4738aaae5d2c25184049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:32:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f68633d9-9d7d-4582-a931-caba4a98aa19 tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1fbd07d-2825-46ea-bd3f-00159b52c8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:32:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f68633d9-9d7d-4582-a931-caba4a98aa19 tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1fbd07d-2825-46ea-bd3f-00159b52c8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:32:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f68633d9-9d7d-4582-a931-caba4a98aa19 tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ec2364e-387d-4409-a6b5-328cd7ad2d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:32:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f68633d9-9d7d-4582-a931-caba4a98aa19 tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ec2364e-387d-4409-a6b5-328cd7ad2d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e399445-ca23-401b-a268-4473e0cf079b', 'volume_name': 'volume-7e399445-ca23-401b-a268-4473e0cf079b', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:32:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f68633d9-9d7d-4582-a931-caba4a98aa19 tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (328bbc18-246c-4b09-9dc5-a450af7abf72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:32:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f68633d9-9d7d-4582-a931-caba4a98aa19 tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (328bbc18-246c-4b09-9dc5-a450af7abf72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:32:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f68633d9-9d7d-4582-a931-caba4a98aa19 tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67635720-bc52-4170-8612-4fa113ed3840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:32:03 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-f68633d9-9d7d-4582-a931-caba4a98aa19 tempest-VolumesSnapshotTestJSON-1891174813 None] Volume 7e399445-ca23-401b-a268-4473e0cf079b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e399445-ca23-401b-a268-4473e0cf079b', 'volume_size': 1} Jul 16 23:32:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f68633d9-9d7d-4582-a931-caba4a98aa19 tempest-VolumesSnapshotTestJSON-1891174813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:32:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f68633d9-9d7d-4582-a931-caba4a98aa19 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:32:03 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f68633d9-9d7d-4582-a931-caba4a98aa19 tempest-VolumesSnapshotTestJSON-1891174813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2114872323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e399445-ca23-401b-a268-4473e0cf079b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25755d47f6c74cbb92e3f7cd7c69f0be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:32:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:32:04Z,use_quota=True,user_id='d9c88f9640af4738aaae5d2c25184049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:32:03 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-f68633d9-9d7d-4582-a931-caba4a98aa19 tempest-VolumesSnapshotTestJSON-1891174813 None] Creating volume 7e399445-ca23-401b-a268-4473e0cf079b {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:32:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f68633d9-9d7d-4582-a931-caba4a98aa19 tempest-VolumesSnapshotTestJSON-1891174813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:32:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f68633d9-9d7d-4582-a931-caba4a98aa19 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:32:03 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f68633d9-9d7d-4582-a931-caba4a98aa19 tempest-VolumesSnapshotTestJSON-1891174813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:32:03 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f68633d9-9d7d-4582-a931-caba4a98aa19 tempest-VolumesSnapshotTestJSON-1891174813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:32:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f68633d9-9d7d-4582-a931-caba4a98aa19 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:32:03 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f68633d9-9d7d-4582-a931-caba4a98aa19 tempest-VolumesSnapshotTestJSON-1891174813 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:32:03 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-f68633d9-9d7d-4582-a931-caba4a98aa19 tempest-VolumesSnapshotTestJSON-1891174813 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:32:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f68633d9-9d7d-4582-a931-caba4a98aa19 tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:03 devstack sudo[104202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b 1073741824 Jul 16 23:32:03 devstack sudo[104202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:04 devstack sudo[104202]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f68633d9-9d7d-4582-a931-caba4a98aa19 tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b 1073741824" returned: 0 in 0.438s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f68633d9-9d7d-4582-a931-caba4a98aa19 tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:04 devstack sudo[104209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b Jul 16 23:32:04 devstack sudo[104209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:04 devstack sudo[104209]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f68633d9-9d7d-4582-a931-caba4a98aa19 tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b" returned: 0 in 0.236s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f68633d9-9d7d-4582-a931-caba4a98aa19 tempest-VolumesSnapshotTestJSON-1891174813 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:32:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f68633d9-9d7d-4582-a931-caba4a98aa19 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:32:04 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f68633d9-9d7d-4582-a931-caba4a98aa19 tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67635720-bc52-4170-8612-4fa113ed3840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e399445-ca23-401b-a268-4473e0cf079b', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:32:04 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f68633d9-9d7d-4582-a931-caba4a98aa19 tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dfadd7c-8a63-4462-8e54-43031b74dc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:32:04 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-f68633d9-9d7d-4582-a931-caba4a98aa19 tempest-VolumesSnapshotTestJSON-1891174813 None] Volume volume-7e399445-ca23-401b-a268-4473e0cf079b (7e399445-ca23-401b-a268-4473e0cf079b): created successfully Jul 16 23:32:04 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f68633d9-9d7d-4582-a931-caba4a98aa19 tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dfadd7c-8a63-4462-8e54-43031b74dc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:32:04 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-f68633d9-9d7d-4582-a931-caba4a98aa19 tempest-VolumesSnapshotTestJSON-1891174813 None] Flow 'volume_create_manager' (d7a694be-26da-46c5-9d7c-ea8061395b6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:32:04 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-f68633d9-9d7d-4582-a931-caba4a98aa19 tempest-VolumesSnapshotTestJSON-1891174813 None] Created volume successfully. Jul 16 23:32:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-05220f09-66c3-4185-a829-885f623ef5ee tempest-VolumesSnapshotTestJSON-1891174813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:32:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-05220f09-66c3-4185-a829-885f623ef5ee tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:32:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-05220f09-66c3-4185-a829-885f623ef5ee tempest-VolumesSnapshotTestJSON-1891174813 None] Creating offline snapshot ebd48b0b-aa95-46ac-8ba1-bf0bc5469f97 of volume 7e399445-ca23-401b-a268-4473e0cf079b {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:32:04 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fe08f0-80a9-4daa-9398-356fe2a65342]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:32:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-05220f09-66c3-4185-a829-885f623ef5ee tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:04 devstack sudo[104212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b Jul 16 23:32:04 devstack sudo[104212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:05 devstack sudo[104212]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-05220f09-66c3-4185-a829-885f623ef5ee tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b" returned: 0 in 0.350s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-05220f09-66c3-4185-a829-885f623ef5ee tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b.ebd48b0b-aa95-46ac-8ba1-bf0bc5469f97 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:05 devstack sudo[104218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b.ebd48b0b-aa95-46ac-8ba1-bf0bc5469f97 1G Jul 16 23:32:05 devstack sudo[104218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:05 devstack sudo[104218]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-05220f09-66c3-4185-a829-885f623ef5ee tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b.ebd48b0b-aa95-46ac-8ba1-bf0bc5469f97 1G" returned: 0 in 0.382s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-05220f09-66c3-4185-a829-885f623ef5ee tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e399445-ca23-401b-a268-4473e0cf079b -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b.ebd48b0b-aa95-46ac-8ba1-bf0bc5469f97 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:05 devstack sudo[104223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e399445-ca23-401b-a268-4473e0cf079b -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b.ebd48b0b-aa95-46ac-8ba1-bf0bc5469f97 Jul 16 23:32:05 devstack sudo[104223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:05 devstack sudo[104223]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-05220f09-66c3-4185-a829-885f623ef5ee tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e399445-ca23-401b-a268-4473e0cf079b -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b.ebd48b0b-aa95-46ac-8ba1-bf0bc5469f97" returned: 0 in 0.294s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:05 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-05220f09-66c3-4185-a829-885f623ef5ee tempest-VolumesSnapshotTestJSON-1891174813 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b.ebd48b0b-aa95-46ac-8ba1-bf0bc5469f97 is being set with open permissions: ugo+rw Jul 16 23:32:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-05220f09-66c3-4185-a829-885f623ef5ee tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b.ebd48b0b-aa95-46ac-8ba1-bf0bc5469f97 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:05 devstack sudo[104228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b.ebd48b0b-aa95-46ac-8ba1-bf0bc5469f97 Jul 16 23:32:05 devstack sudo[104228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:06 devstack sudo[104228]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-05220f09-66c3-4185-a829-885f623ef5ee tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b.ebd48b0b-aa95-46ac-8ba1-bf0bc5469f97" returned: 0 in 0.238s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-05220f09-66c3-4185-a829-885f623ef5ee tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:06 devstack sudo[104231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b.info Jul 16 23:32:06 devstack sudo[104231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:06 devstack sudo[104231]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-05220f09-66c3-4185-a829-885f623ef5ee tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b.info" returned: 0 in 0.282s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:06 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-05220f09-66c3-4185-a829-885f623ef5ee tempest-VolumesSnapshotTestJSON-1891174813 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b.info is being set with open permissions: ugo+rw Jul 16 23:32:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-05220f09-66c3-4185-a829-885f623ef5ee tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:06 devstack sudo[104234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b.info Jul 16 23:32:06 devstack sudo[104234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:06 devstack sudo[104234]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-05220f09-66c3-4185-a829-885f623ef5ee tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b.info" returned: 0 in 0.247s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-05220f09-66c3-4185-a829-885f623ef5ee tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.879s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:32:06 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-05220f09-66c3-4185-a829-885f623ef5ee tempest-VolumesSnapshotTestJSON-1891174813 None] Create snapshot completed successfully Jul 16 23:32:07 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:32:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Flow 'volume_create_manager' (52fe6b15-c6d7-4354-bd62-1459da88823c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:32:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a35b6c56-81c7-422f-b8f6-e552ff2eb8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:32:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a35b6c56-81c7-422f-b8f6-e552ff2eb8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:32:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1916136758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bad0332-8f1e-4ddf-8c57-54764eafb894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25755d47f6c74cbb92e3f7cd7c69f0be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ebd48b0b-aa95-46ac-8ba1-bf0bc5469f97,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:32:07Z,use_quota=True,user_id='d9c88f9640af4738aaae5d2c25184049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:32:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90dfdbea-3c7e-42c3-b91b-61aa539253bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:32:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90dfdbea-3c7e-42c3-b91b-61aa539253bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:32:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (290d0b92-6c76-4df2-9057-51ae6c1f7471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:32:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (290d0b92-6c76-4df2-9057-51ae6c1f7471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7bad0332-8f1e-4ddf-8c57-54764eafb894', 'volume_name': 'volume-7bad0332-8f1e-4ddf-8c57-54764eafb894', 'volume_size': 1, 'snapshot_id': 'ebd48b0b-aa95-46ac-8ba1-bf0bc5469f97'}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:32:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47083cf3-2b07-4a27-82f6-749e3f301d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:32:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47083cf3-2b07-4a27-82f6-749e3f301d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:32:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed1faba0-d763-40e3-898f-85034cc2cd60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:32:07 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Volume 7bad0332-8f1e-4ddf-8c57-54764eafb894: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7bad0332-8f1e-4ddf-8c57-54764eafb894', 'volume_size': 1, 'snapshot_id': 'ebd48b0b-aa95-46ac-8ba1-bf0bc5469f97'} Jul 16 23:32:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:32:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:32:07 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Acquiring lock "cinder-quobyte-ebd48b0b-aa95-46ac-8ba1-bf0bc5469f97-7bad0332-8f1e-4ddf-8c57-54764eafb894" by "_create_volume_from_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:32:07 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-quobyte-ebd48b0b-aa95-46ac-8ba1-bf0bc5469f97-7bad0332-8f1e-4ddf-8c57-54764eafb894" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:32:07 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Creating volume 7bad0332-8f1e-4ddf-8c57-54764eafb894 from snapshot ebd48b0b-aa95-46ac-8ba1-bf0bc5469f97 {{(pid=87607) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 16 23:32:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:32:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:32:07 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:32:07 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:32:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:32:07 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:32:07 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Acquiring lock "cinder-quobyte-7bad0332-8f1e-4ddf-8c57-54764eafb894" by "_copy_volume_from_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:32:07 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-quobyte-7bad0332-8f1e-4ddf-8c57-54764eafb894" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:32:07 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] snapshot: ebd48b0b-aa95-46ac-8ba1-bf0bc5469f97, volume: 7bad0332-8f1e-4ddf-8c57-54764eafb894, {{(pid=87607) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 16 23:32:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:32:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:32:07 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:32:07 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:32:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:32:07 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[6383b390-c29d-4e1b-b4bc-7b263d72b9a0]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:32:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b.ebd48b0b-aa95-46ac-8ba1-bf0bc5469f97 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:07 devstack sudo[104237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b.ebd48b0b-aa95-46ac-8ba1-bf0bc5469f97 Jul 16 23:32:07 devstack sudo[104237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:07 devstack sudo[104237]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b.ebd48b0b-aa95-46ac-8ba1-bf0bc5469f97" returned: 0 in 0.358s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:07 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e399445-ca23-401b-a268-4473e0cf079b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:32:08 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b {{(pid=87607) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 16 23:32:08 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Creating direct copy from snapshot {{(pid=87607) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 16 23:32:08 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[80309ba3-17e9-4df5-a8ab-a6e2d07d4bb6]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:32:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:08 devstack sudo[104242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b Jul 16 23:32:08 devstack sudo[104242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:08 devstack sudo[104242]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b" returned: 0 in 0.362s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:08 devstack cinder-volume[87607]: DEBUG cinder.utils [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Path /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7bad0332-8f1e-4ddf-8c57-54764eafb894 not found in is_blk_device check {{(pid=87607) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 16 23:32:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7bad0332-8f1e-4ddf-8c57-54764eafb894 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:08 devstack sudo[104247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7bad0332-8f1e-4ddf-8c57-54764eafb894 Jul 16 23:32:08 devstack sudo[104247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:12 devstack sudo[104247]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7bad0332-8f1e-4ddf-8c57-54764eafb894" returned: 0 in 3.964s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:12 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d37078-0b9d-4bbe-98e7-6a2f6e6224c0]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:32:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:12 devstack sudo[104261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b Jul 16 23:32:12 devstack sudo[104261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:12 devstack sudo[104261]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b" returned: 0 in 0.554s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:12 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Image conversion details: src /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b, size 1024.00 MB, duration 3.97 sec, destination /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7bad0332-8f1e-4ddf-8c57-54764eafb894 {{(pid=87607) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 23:32:12 devstack cinder-volume[87607]: INFO cinder.image.image_utils [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Converted 1024.00 MB image at 258.26 MB/s Jul 16 23:32:12 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7bad0332-8f1e-4ddf-8c57-54764eafb894 is being set with open permissions: ugo+rw Jul 16 23:32:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7bad0332-8f1e-4ddf-8c57-54764eafb894 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:12 devstack sudo[104266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7bad0332-8f1e-4ddf-8c57-54764eafb894 Jul 16 23:32:12 devstack sudo[104266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:13 devstack sudo[104266]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7bad0332-8f1e-4ddf-8c57-54764eafb894" returned: 0 in 0.263s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:13 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-quobyte-7bad0332-8f1e-4ddf-8c57-54764eafb894" released by "_copy_volume_from_snapshot" :: held 5.590s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:32:13 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-quobyte-ebd48b0b-aa95-46ac-8ba1-bf0bc5469f97-7bad0332-8f1e-4ddf-8c57-54764eafb894" released by "_create_volume_from_snapshot" :: held 5.617s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:32:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.632s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:32:13 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:UPDATE=171,cinder:DELETE=21,cinder:SELECT=138,cinder:INSERT=42 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:32:13 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:SELECT=143,cinder:UPDATE=185,cinder:INSERT=45,cinder:DELETE=10 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:32:13 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed1faba0-d763-40e3-898f-85034cc2cd60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bad0332-8f1e-4ddf-8c57-54764eafb894', 'volume_size': 1, 'snapshot_id': 'ebd48b0b-aa95-46ac-8ba1-bf0bc5469f97'}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:32:13 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (009188ff-1f0b-4ad3-ad88-f37c0a455aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:32:13 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Volume volume-7bad0332-8f1e-4ddf-8c57-54764eafb894 (7bad0332-8f1e-4ddf-8c57-54764eafb894): created successfully Jul 16 23:32:13 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (009188ff-1f0b-4ad3-ad88-f37c0a455aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:32:13 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Flow 'volume_create_manager' (52fe6b15-c6d7-4354-bd62-1459da88823c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:32:13 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-4281596d-908b-4f33-8df4-91d1deb13630 tempest-VolumesSnapshotTestJSON-1891174813 None] Created volume successfully. Jul 16 23:32:14 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-90acfd65-a41f-44dc-a500-41646b22b4dc tempest-VolumesSnapshotTestJSON-1891174813 None] Acquiring lock "cinder-7bad0332-8f1e-4ddf-8c57-54764eafb894-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:32:14 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-90acfd65-a41f-44dc-a500-41646b22b4dc tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-7bad0332-8f1e-4ddf-8c57-54764eafb894-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:32:14 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-90acfd65-a41f-44dc-a500-41646b22b4dc tempest-VolumesSnapshotTestJSON-1891174813 None] Acquiring lock "cinder-quobyte-7bad0332-8f1e-4ddf-8c57-54764eafb894" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:32:14 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-90acfd65-a41f-44dc-a500-41646b22b4dc tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-quobyte-7bad0332-8f1e-4ddf-8c57-54764eafb894" acquired by "delete_volume" :: waited 0.019s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:32:14 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[773275af-952c-4c78-92cf-a645f41f8f2b]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:32:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-90acfd65-a41f-44dc-a500-41646b22b4dc tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7bad0332-8f1e-4ddf-8c57-54764eafb894 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:14 devstack sudo[104269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7bad0332-8f1e-4ddf-8c57-54764eafb894 Jul 16 23:32:14 devstack sudo[104269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:14 devstack sudo[104269]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-90acfd65-a41f-44dc-a500-41646b22b4dc tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7bad0332-8f1e-4ddf-8c57-54764eafb894" returned: 0 in 0.350s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-90acfd65-a41f-44dc-a500-41646b22b4dc tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7bad0332-8f1e-4ddf-8c57-54764eafb894 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:14 devstack sudo[104275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7bad0332-8f1e-4ddf-8c57-54764eafb894 Jul 16 23:32:14 devstack sudo[104275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:14 devstack sudo[104275]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-90acfd65-a41f-44dc-a500-41646b22b4dc tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7bad0332-8f1e-4ddf-8c57-54764eafb894" returned: 0 in 0.238s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:14 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-90acfd65-a41f-44dc-a500-41646b22b4dc tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-quobyte-7bad0332-8f1e-4ddf-8c57-54764eafb894" released by "delete_volume" :: held 0.629s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:32:14 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-90acfd65-a41f-44dc-a500-41646b22b4dc tempest-VolumesSnapshotTestJSON-1891174813 None] Created reservations ['6cb4450c-d2cc-4988-b2f9-e1e65a6c22ed', 'dc1c27ef-9f54-46ca-8478-8572c76ca2a7', '8bf4ac6c-39cf-46de-8157-1da29c60c656', '3f11c367-bd25-4f1e-9d29-d933600a0d23'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:32:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-90acfd65-a41f-44dc-a500-41646b22b4dc tempest-VolumesSnapshotTestJSON-1891174813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:32:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-90acfd65-a41f-44dc-a500-41646b22b4dc tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:32:14 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-90acfd65-a41f-44dc-a500-41646b22b4dc tempest-VolumesSnapshotTestJSON-1891174813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:32:14 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-90acfd65-a41f-44dc-a500-41646b22b4dc tempest-VolumesSnapshotTestJSON-1891174813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:32:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-90acfd65-a41f-44dc-a500-41646b22b4dc tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:32:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-90acfd65-a41f-44dc-a500-41646b22b4dc tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:14 devstack sudo[104278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:32:14 devstack sudo[104278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:15 devstack sudo[104278]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-90acfd65-a41f-44dc-a500-41646b22b4dc tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.236s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:15 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-90acfd65-a41f-44dc-a500-41646b22b4dc tempest-VolumesSnapshotTestJSON-1891174813 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:32:15 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-90acfd65-a41f-44dc-a500-41646b22b4dc tempest-VolumesSnapshotTestJSON-1891174813 None] Deleted volume successfully. Jul 16 23:32:15 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-90acfd65-a41f-44dc-a500-41646b22b4dc tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-7bad0332-8f1e-4ddf-8c57-54764eafb894-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:32:15 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-10bc896d-7736-4374-8053-14eb703abdf5 tempest-VolumesSnapshotTestJSON-1891174813 None] Acquiring lock "cinder-ebd48b0b-aa95-46ac-8ba1-bf0bc5469f97-delete_snapshot" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:32:15 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-10bc896d-7736-4374-8053-14eb703abdf5 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-ebd48b0b-aa95-46ac-8ba1-bf0bc5469f97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:32:15 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-10bc896d-7736-4374-8053-14eb703abdf5 tempest-VolumesSnapshotTestJSON-1891174813 None] Acquiring lock "cinder-quobyte-7e399445-ca23-401b-a268-4473e0cf079b" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:32:15 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-10bc896d-7736-4374-8053-14eb703abdf5 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-quobyte-7e399445-ca23-401b-a268-4473e0cf079b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:32:15 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-10bc896d-7736-4374-8053-14eb703abdf5 tempest-VolumesSnapshotTestJSON-1891174813 None] Acquiring lock "cinder-quobyte-ebd48b0b-aa95-46ac-8ba1-bf0bc5469f97" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:32:15 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-10bc896d-7736-4374-8053-14eb703abdf5 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-quobyte-ebd48b0b-aa95-46ac-8ba1-bf0bc5469f97" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:32:15 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-10bc896d-7736-4374-8053-14eb703abdf5 tempest-VolumesSnapshotTestJSON-1891174813 None] Deleting offline snapshot ebd48b0b-aa95-46ac-8ba1-bf0bc5469f97 of volume 7e399445-ca23-401b-a268-4473e0cf079b {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:32:15 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-10bc896d-7736-4374-8053-14eb703abdf5 tempest-VolumesSnapshotTestJSON-1891174813 None] snapshot_file for this snap is: volume-7e399445-ca23-401b-a268-4473e0cf079b.ebd48b0b-aa95-46ac-8ba1-bf0bc5469f97 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:32:15 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f9be05-7220-494a-a380-5827b1689c80]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:32:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-10bc896d-7736-4374-8053-14eb703abdf5 tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b.ebd48b0b-aa95-46ac-8ba1-bf0bc5469f97 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:15 devstack sudo[104281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b.ebd48b0b-aa95-46ac-8ba1-bf0bc5469f97 Jul 16 23:32:15 devstack sudo[104281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:15 devstack sudo[104281]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-10bc896d-7736-4374-8053-14eb703abdf5 tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b.ebd48b0b-aa95-46ac-8ba1-bf0bc5469f97" returned: 0 in 0.356s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:15 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-10bc896d-7736-4374-8053-14eb703abdf5 tempest-VolumesSnapshotTestJSON-1891174813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e399445-ca23-401b-a268-4473e0cf079b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:32:15 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6543f8-89b3-40f5-8ca2-e95ec64d03dd]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:32:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-10bc896d-7736-4374-8053-14eb703abdf5 tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:15 devstack sudo[104286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b Jul 16 23:32:15 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:16 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-10bc896d-7736-4374-8053-14eb703abdf5 tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b" returned: 0 in 0.374s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-10bc896d-7736-4374-8053-14eb703abdf5 tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b.ebd48b0b-aa95-46ac-8ba1-bf0bc5469f97 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:16 devstack sudo[104291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b.ebd48b0b-aa95-46ac-8ba1-bf0bc5469f97 Jul 16 23:32:16 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:16 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-10bc896d-7736-4374-8053-14eb703abdf5 tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b.ebd48b0b-aa95-46ac-8ba1-bf0bc5469f97" returned: 0 in 0.340s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-10bc896d-7736-4374-8053-14eb703abdf5 tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b.ebd48b0b-aa95-46ac-8ba1-bf0bc5469f97 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:16 devstack sudo[104296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b.ebd48b0b-aa95-46ac-8ba1-bf0bc5469f97 Jul 16 23:32:16 devstack sudo[104296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:16 devstack sudo[104296]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-10bc896d-7736-4374-8053-14eb703abdf5 tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b.ebd48b0b-aa95-46ac-8ba1-bf0bc5469f97" returned: 0 in 0.260s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:16 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-10bc896d-7736-4374-8053-14eb703abdf5 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-quobyte-ebd48b0b-aa95-46ac-8ba1-bf0bc5469f97" released by "_delete_snapshot" :: held 1.437s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:32:16 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-10bc896d-7736-4374-8053-14eb703abdf5 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-quobyte-7e399445-ca23-401b-a268-4473e0cf079b" released by "delete_snapshot" :: held 1.460s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:32:16 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-10bc896d-7736-4374-8053-14eb703abdf5 tempest-VolumesSnapshotTestJSON-1891174813 None] Created reservations ['354364d6-2ee0-4bec-bbe7-d107855bb508', '95e6f05a-d962-476a-9df6-69e3486936b8', 'e28c48ba-38e4-498b-8628-786ca1bc7166', 'bcdfab29-82d5-406c-9f61-2d5bd4ab92de'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:32:16 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-10bc896d-7736-4374-8053-14eb703abdf5 tempest-VolumesSnapshotTestJSON-1891174813 None] Delete snapshot completed successfully. Jul 16 23:32:16 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-10bc896d-7736-4374-8053-14eb703abdf5 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-ebd48b0b-aa95-46ac-8ba1-bf0bc5469f97-delete_snapshot" released by "delete_snapshot" :: held 1.592s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:32:17 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0a5a64c6-ad66-4d47-8fed-8c927f74f58b tempest-VolumesSnapshotTestJSON-1891174813 None] Acquiring lock "cinder-7e399445-ca23-401b-a268-4473e0cf079b-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:32:17 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0a5a64c6-ad66-4d47-8fed-8c927f74f58b tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-7e399445-ca23-401b-a268-4473e0cf079b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:32:17 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0a5a64c6-ad66-4d47-8fed-8c927f74f58b tempest-VolumesSnapshotTestJSON-1891174813 None] Acquiring lock "cinder-quobyte-7e399445-ca23-401b-a268-4473e0cf079b" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:32:17 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0a5a64c6-ad66-4d47-8fed-8c927f74f58b tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-quobyte-7e399445-ca23-401b-a268-4473e0cf079b" acquired by "delete_volume" :: waited 0.018s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:32:17 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2cb18e5-8aa2-4b88-805e-aa4fce0748bc]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:32:17 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0a5a64c6-ad66-4d47-8fed-8c927f74f58b tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:17 devstack sudo[104299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b Jul 16 23:32:17 devstack sudo[104299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:17 devstack sudo[104299]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:17 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0a5a64c6-ad66-4d47-8fed-8c927f74f58b tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b" returned: 0 in 0.355s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:17 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0a5a64c6-ad66-4d47-8fed-8c927f74f58b tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:17 devstack sudo[104304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b Jul 16 23:32:17 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:18 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0a5a64c6-ad66-4d47-8fed-8c927f74f58b tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7e399445-ca23-401b-a268-4473e0cf079b" returned: 0 in 0.246s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:18 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0a5a64c6-ad66-4d47-8fed-8c927f74f58b tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-quobyte-7e399445-ca23-401b-a268-4473e0cf079b" released by "delete_volume" :: held 0.658s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:32:18 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-0a5a64c6-ad66-4d47-8fed-8c927f74f58b tempest-VolumesSnapshotTestJSON-1891174813 None] Created reservations ['8e644296-5036-4cfc-81d7-f978ac37a755', '19f8c449-c5b0-4df7-a37d-38f0d4a7eeb1', 'cc3f987d-7d98-4b64-b8f3-8dc8bfedf6e4', 'b1615039-2d20-4b30-9546-9c5338d26860'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:32:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0a5a64c6-ad66-4d47-8fed-8c927f74f58b tempest-VolumesSnapshotTestJSON-1891174813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:32:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0a5a64c6-ad66-4d47-8fed-8c927f74f58b tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:32:18 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0a5a64c6-ad66-4d47-8fed-8c927f74f58b tempest-VolumesSnapshotTestJSON-1891174813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:32:18 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0a5a64c6-ad66-4d47-8fed-8c927f74f58b tempest-VolumesSnapshotTestJSON-1891174813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:32:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0a5a64c6-ad66-4d47-8fed-8c927f74f58b tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:32:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0a5a64c6-ad66-4d47-8fed-8c927f74f58b tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:18 devstack sudo[104307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:32:18 devstack sudo[104307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:18 devstack sudo[104307]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0a5a64c6-ad66-4d47-8fed-8c927f74f58b tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.241s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:18 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-0a5a64c6-ad66-4d47-8fed-8c927f74f58b tempest-VolumesSnapshotTestJSON-1891174813 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:32:18 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-0a5a64c6-ad66-4d47-8fed-8c927f74f58b tempest-VolumesSnapshotTestJSON-1891174813 None] Deleted volume successfully. Jul 16 23:32:18 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0a5a64c6-ad66-4d47-8fed-8c927f74f58b tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-7e399445-ca23-401b-a268-4473e0cf079b-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:32:18 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-77c9d211-49a3-4b5f-abca-a519ac1990b2 tempest-VolumesSnapshotTestJSON-1891174813 None] Acquiring lock "cinder-903e6247-bc44-429b-93b9-fc6eccbacc8d-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:32:18 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-77c9d211-49a3-4b5f-abca-a519ac1990b2 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-903e6247-bc44-429b-93b9-fc6eccbacc8d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:32:18 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-77c9d211-49a3-4b5f-abca-a519ac1990b2 tempest-VolumesSnapshotTestJSON-1891174813 None] Acquiring lock "cinder-quobyte-903e6247-bc44-429b-93b9-fc6eccbacc8d" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:32:18 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-77c9d211-49a3-4b5f-abca-a519ac1990b2 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-quobyte-903e6247-bc44-429b-93b9-fc6eccbacc8d" acquired by "delete_volume" :: waited 0.014s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:32:18 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[095c2159-dcc8-47e6-a18d-16065660a877]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:32:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-77c9d211-49a3-4b5f-abca-a519ac1990b2 tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:18 devstack sudo[104310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d Jul 16 23:32:18 devstack sudo[104310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:19 devstack sudo[104310]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-77c9d211-49a3-4b5f-abca-a519ac1990b2 tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d" returned: 0 in 0.358s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-77c9d211-49a3-4b5f-abca-a519ac1990b2 tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:19 devstack sudo[104316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d Jul 16 23:32:19 devstack sudo[104316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:19 devstack sudo[104316]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-77c9d211-49a3-4b5f-abca-a519ac1990b2 tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-903e6247-bc44-429b-93b9-fc6eccbacc8d" returned: 0 in 0.243s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:19 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-77c9d211-49a3-4b5f-abca-a519ac1990b2 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-quobyte-903e6247-bc44-429b-93b9-fc6eccbacc8d" released by "delete_volume" :: held 0.657s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:32:19 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-77c9d211-49a3-4b5f-abca-a519ac1990b2 tempest-VolumesSnapshotTestJSON-1891174813 None] Created reservations ['f19c04f7-b8c3-4b7b-8e0f-7c485ca61b2b', '6d07f353-5326-470e-a3e7-939f92b10ff1', '0b600b12-b614-41a8-8cd3-b3dcaf8af7c2', 'da66c9e6-3eb5-46f8-af98-5379ad4aa3f1'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:32:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-77c9d211-49a3-4b5f-abca-a519ac1990b2 tempest-VolumesSnapshotTestJSON-1891174813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:32:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-77c9d211-49a3-4b5f-abca-a519ac1990b2 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:32:19 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-77c9d211-49a3-4b5f-abca-a519ac1990b2 tempest-VolumesSnapshotTestJSON-1891174813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:32:19 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-77c9d211-49a3-4b5f-abca-a519ac1990b2 tempest-VolumesSnapshotTestJSON-1891174813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:32:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-77c9d211-49a3-4b5f-abca-a519ac1990b2 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:32:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-77c9d211-49a3-4b5f-abca-a519ac1990b2 tempest-VolumesSnapshotTestJSON-1891174813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:19 devstack sudo[104319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:32:19 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:19 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-77c9d211-49a3-4b5f-abca-a519ac1990b2 tempest-VolumesSnapshotTestJSON-1891174813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.250s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:19 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-77c9d211-49a3-4b5f-abca-a519ac1990b2 tempest-VolumesSnapshotTestJSON-1891174813 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:32:19 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-77c9d211-49a3-4b5f-abca-a519ac1990b2 tempest-VolumesSnapshotTestJSON-1891174813 None] Deleted volume successfully. Jul 16 23:32:19 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-77c9d211-49a3-4b5f-abca-a519ac1990b2 tempest-VolumesSnapshotTestJSON-1891174813 None] Lock "cinder-903e6247-bc44-429b-93b9-fc6eccbacc8d-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:32:29 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:UPDATE=28,cinder:DELETE=3,cinder:SELECT=22,cinder:INSERT=9 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:32:29 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:UPDATE=33,cinder:SELECT=19,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:32:39 devstack cinder-volume[87607]: DEBUG oslo_service.periodic_task [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:32:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:32:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:32:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:32:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:32:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:32:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:39 devstack sudo[104326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:32:39 devstack sudo[104326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:39 devstack sudo[104326]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.264s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:39 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:32:39 devstack cinder-volume[87607]: DEBUG oslo_service.periodic_task [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running periodic task VolumeManager._thread_info {{(pid=87607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:32:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] thread count: 28 {{(pid=87607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 23:32:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] thread info: [<_MainThread(MainThread, started 139090403627136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 23:32:46 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fbb1977-070e-412a-9ab9-00c56913d6db tempest-TestInstancesWithCinderVolumes-1086060171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:32:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1fbb1977-070e-412a-9ab9-00c56913d6db tempest-TestInstancesWithCinderVolumes-1086060171 None] Flow 'volume_create_manager' (ba11c061-9f52-4220-80a3-06310df7f3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:32:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1fbb1977-070e-412a-9ab9-00c56913d6db tempest-TestInstancesWithCinderVolumes-1086060171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c75f6cc-94e3-4193-bbba-84e415a8ed93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:32:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1fbb1977-070e-412a-9ab9-00c56913d6db tempest-TestInstancesWithCinderVolumes-1086060171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c75f6cc-94e3-4193-bbba-84e415a8ed93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1387977143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a133ba7-0746-4d76-8906-8efcd3aa93d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a23009eee4b44493837c60d7ebe64975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:32:47Z,use_quota=True,user_id='9cc66dfaf85b4ef182321a5b1257759b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25456bb8-3cda-4812-af76-da31a3e00433),volume_type_id=25456bb8-3cda-4812-af76-da31a3e00433)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:32:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1fbb1977-070e-412a-9ab9-00c56913d6db tempest-TestInstancesWithCinderVolumes-1086060171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a428724e-ff65-4354-8464-005dbc9bf84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:32:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1fbb1977-070e-412a-9ab9-00c56913d6db tempest-TestInstancesWithCinderVolumes-1086060171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a428724e-ff65-4354-8464-005dbc9bf84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:32:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1fbb1977-070e-412a-9ab9-00c56913d6db tempest-TestInstancesWithCinderVolumes-1086060171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c683f3e2-0a1c-45a6-a1b4-01539ef762e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:32:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1fbb1977-070e-412a-9ab9-00c56913d6db tempest-TestInstancesWithCinderVolumes-1086060171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c683f3e2-0a1c-45a6-a1b4-01539ef762e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a133ba7-0746-4d76-8906-8efcd3aa93d8', 'volume_name': 'volume-0a133ba7-0746-4d76-8906-8efcd3aa93d8', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1fbb1977-070e-412a-9ab9-00c56913d6db tempest-TestInstancesWithCinderVolumes-1086060171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11ff119c-c970-4dcb-8c24-802f4e76e99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1fbb1977-070e-412a-9ab9-00c56913d6db tempest-TestInstancesWithCinderVolumes-1086060171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11ff119c-c970-4dcb-8c24-802f4e76e99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1fbb1977-070e-412a-9ab9-00c56913d6db tempest-TestInstancesWithCinderVolumes-1086060171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3b6aabc-56f2-4119-8fd9-f094bd8d39f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:32:47 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-1fbb1977-070e-412a-9ab9-00c56913d6db tempest-TestInstancesWithCinderVolumes-1086060171 None] Volume 0a133ba7-0746-4d76-8906-8efcd3aa93d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a133ba7-0746-4d76-8906-8efcd3aa93d8', 'volume_size': 1} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1fbb1977-070e-412a-9ab9-00c56913d6db tempest-TestInstancesWithCinderVolumes-1086060171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1fbb1977-070e-412a-9ab9-00c56913d6db tempest-TestInstancesWithCinderVolumes-1086060171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1fbb1977-070e-412a-9ab9-00c56913d6db tempest-TestInstancesWithCinderVolumes-1086060171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1387977143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a133ba7-0746-4d76-8906-8efcd3aa93d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a23009eee4b44493837c60d7ebe64975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:32:47Z,use_quota=True,user_id='9cc66dfaf85b4ef182321a5b1257759b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25456bb8-3cda-4812-af76-da31a3e00433),volume_type_id=25456bb8-3cda-4812-af76-da31a3e00433)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-1fbb1977-070e-412a-9ab9-00c56913d6db tempest-TestInstancesWithCinderVolumes-1086060171 None] Creating volume 0a133ba7-0746-4d76-8906-8efcd3aa93d8 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1fbb1977-070e-412a-9ab9-00c56913d6db tempest-TestInstancesWithCinderVolumes-1086060171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1fbb1977-070e-412a-9ab9-00c56913d6db tempest-TestInstancesWithCinderVolumes-1086060171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1fbb1977-070e-412a-9ab9-00c56913d6db tempest-TestInstancesWithCinderVolumes-1086060171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1fbb1977-070e-412a-9ab9-00c56913d6db tempest-TestInstancesWithCinderVolumes-1086060171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1fbb1977-070e-412a-9ab9-00c56913d6db tempest-TestInstancesWithCinderVolumes-1086060171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1fbb1977-070e-412a-9ab9-00c56913d6db tempest-TestInstancesWithCinderVolumes-1086060171 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:32:47 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-1fbb1977-070e-412a-9ab9-00c56913d6db tempest-TestInstancesWithCinderVolumes-1086060171 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1fbb1977-070e-412a-9ab9-00c56913d6db tempest-TestInstancesWithCinderVolumes-1086060171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0a133ba7-0746-4d76-8906-8efcd3aa93d8 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:47 devstack sudo[104368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0a133ba7-0746-4d76-8906-8efcd3aa93d8 1073741824 Jul 16 23:32:47 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f397a4e-1eda-49bb-ab8d-dac0adf98601 tempest-TestInstancesWithCinderVolumes-1086060171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-2f397a4e-1eda-49bb-ab8d-dac0adf98601 tempest-TestInstancesWithCinderVolumes-1086060171 None] Flow 'volume_create_manager' (3b7543e5-b674-4487-82f6-262b1fb496b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-2f397a4e-1eda-49bb-ab8d-dac0adf98601 tempest-TestInstancesWithCinderVolumes-1086060171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c705d674-92ad-4fd6-8a51-21b833ca948d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-2f397a4e-1eda-49bb-ab8d-dac0adf98601 tempest-TestInstancesWithCinderVolumes-1086060171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c705d674-92ad-4fd6-8a51-21b833ca948d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1911660678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c7c05e5-5c08-4ebf-89a0-410afc986d6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a23009eee4b44493837c60d7ebe64975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:32:47Z,use_quota=True,user_id='9cc66dfaf85b4ef182321a5b1257759b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5523b5f-283e-4473-baf3-74e914227a8a),volume_type_id=b5523b5f-283e-4473-baf3-74e914227a8a)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-2f397a4e-1eda-49bb-ab8d-dac0adf98601 tempest-TestInstancesWithCinderVolumes-1086060171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f653c62-7e8b-4ff2-9ddd-5f04f6c51b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-2f397a4e-1eda-49bb-ab8d-dac0adf98601 tempest-TestInstancesWithCinderVolumes-1086060171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f653c62-7e8b-4ff2-9ddd-5f04f6c51b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-2f397a4e-1eda-49bb-ab8d-dac0adf98601 tempest-TestInstancesWithCinderVolumes-1086060171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69bb6961-d72a-4343-a739-9ca026cf594a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-2f397a4e-1eda-49bb-ab8d-dac0adf98601 tempest-TestInstancesWithCinderVolumes-1086060171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69bb6961-d72a-4343-a739-9ca026cf594a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c7c05e5-5c08-4ebf-89a0-410afc986d6d', 'volume_name': 'volume-9c7c05e5-5c08-4ebf-89a0-410afc986d6d', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-2f397a4e-1eda-49bb-ab8d-dac0adf98601 tempest-TestInstancesWithCinderVolumes-1086060171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00a27650-966f-429c-8e5f-e85f382703ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-2f397a4e-1eda-49bb-ab8d-dac0adf98601 tempest-TestInstancesWithCinderVolumes-1086060171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00a27650-966f-429c-8e5f-e85f382703ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-2f397a4e-1eda-49bb-ab8d-dac0adf98601 tempest-TestInstancesWithCinderVolumes-1086060171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b75f8d6-9c6d-4508-894c-3c24191c76e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:32:47 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-2f397a4e-1eda-49bb-ab8d-dac0adf98601 tempest-TestInstancesWithCinderVolumes-1086060171 None] Volume 9c7c05e5-5c08-4ebf-89a0-410afc986d6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c7c05e5-5c08-4ebf-89a0-410afc986d6d', 'volume_size': 1} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-2f397a4e-1eda-49bb-ab8d-dac0adf98601 tempest-TestInstancesWithCinderVolumes-1086060171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:32:47 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1fbb1977-070e-412a-9ab9-00c56913d6db tempest-TestInstancesWithCinderVolumes-1086060171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0a133ba7-0746-4d76-8906-8efcd3aa93d8 1073741824" returned: 0 in 0.488s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1fbb1977-070e-412a-9ab9-00c56913d6db tempest-TestInstancesWithCinderVolumes-1086060171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0a133ba7-0746-4d76-8906-8efcd3aa93d8 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:47 devstack sudo[104374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0a133ba7-0746-4d76-8906-8efcd3aa93d8 Jul 16 23:32:47 devstack sudo[104374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:47 devstack sudo[104374]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1fbb1977-070e-412a-9ab9-00c56913d6db tempest-TestInstancesWithCinderVolumes-1086060171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0a133ba7-0746-4d76-8906-8efcd3aa93d8" returned: 0 in 0.246s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1fbb1977-070e-412a-9ab9-00c56913d6db tempest-TestInstancesWithCinderVolumes-1086060171 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1fbb1977-070e-412a-9ab9-00c56913d6db tempest-TestInstancesWithCinderVolumes-1086060171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-2f397a4e-1eda-49bb-ab8d-dac0adf98601 tempest-TestInstancesWithCinderVolumes-1086060171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.433s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-2f397a4e-1eda-49bb-ab8d-dac0adf98601 tempest-TestInstancesWithCinderVolumes-1086060171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1911660678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c7c05e5-5c08-4ebf-89a0-410afc986d6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a23009eee4b44493837c60d7ebe64975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:32:47Z,use_quota=True,user_id='9cc66dfaf85b4ef182321a5b1257759b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5523b5f-283e-4473-baf3-74e914227a8a),volume_type_id=b5523b5f-283e-4473-baf3-74e914227a8a)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-2f397a4e-1eda-49bb-ab8d-dac0adf98601 tempest-TestInstancesWithCinderVolumes-1086060171 None] Creating volume 9c7c05e5-5c08-4ebf-89a0-410afc986d6d {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-2f397a4e-1eda-49bb-ab8d-dac0adf98601 tempest-TestInstancesWithCinderVolumes-1086060171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-2f397a4e-1eda-49bb-ab8d-dac0adf98601 tempest-TestInstancesWithCinderVolumes-1086060171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-2f397a4e-1eda-49bb-ab8d-dac0adf98601 tempest-TestInstancesWithCinderVolumes-1086060171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-2f397a4e-1eda-49bb-ab8d-dac0adf98601 tempest-TestInstancesWithCinderVolumes-1086060171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-2f397a4e-1eda-49bb-ab8d-dac0adf98601 tempest-TestInstancesWithCinderVolumes-1086060171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-2f397a4e-1eda-49bb-ab8d-dac0adf98601 tempest-TestInstancesWithCinderVolumes-1086060171 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:32:47 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-2f397a4e-1eda-49bb-ab8d-dac0adf98601 tempest-TestInstancesWithCinderVolumes-1086060171 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2f397a4e-1eda-49bb-ab8d-dac0adf98601 tempest-TestInstancesWithCinderVolumes-1086060171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9c7c05e5-5c08-4ebf-89a0-410afc986d6d 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1fbb1977-070e-412a-9ab9-00c56913d6db tempest-TestInstancesWithCinderVolumes-1086060171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3b6aabc-56f2-4119-8fd9-f094bd8d39f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a133ba7-0746-4d76-8906-8efcd3aa93d8', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:32:47 devstack sudo[104377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9c7c05e5-5c08-4ebf-89a0-410afc986d6d 1073741824 Jul 16 23:32:47 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1fbb1977-070e-412a-9ab9-00c56913d6db tempest-TestInstancesWithCinderVolumes-1086060171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d1394f-ca9c-45b1-80e9-cd9ba4e3eefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:32:47 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-1fbb1977-070e-412a-9ab9-00c56913d6db tempest-TestInstancesWithCinderVolumes-1086060171 None] Volume volume-0a133ba7-0746-4d76-8906-8efcd3aa93d8 (0a133ba7-0746-4d76-8906-8efcd3aa93d8): created successfully Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1fbb1977-070e-412a-9ab9-00c56913d6db tempest-TestInstancesWithCinderVolumes-1086060171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d1394f-ca9c-45b1-80e9-cd9ba4e3eefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1fbb1977-070e-412a-9ab9-00c56913d6db tempest-TestInstancesWithCinderVolumes-1086060171 None] Flow 'volume_create_manager' (ba11c061-9f52-4220-80a3-06310df7f3ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:32:47 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-1fbb1977-070e-412a-9ab9-00c56913d6db tempest-TestInstancesWithCinderVolumes-1086060171 None] Created volume successfully. Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Flow 'volume_create_manager' (92054a76-475f-4c7f-98f5-b103d4023ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (801e9b0c-d153-4811-9230-e5cb4bdfdfd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (801e9b0c-d153-4811-9230-e5cb4bdfdfd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-656026411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=038e0d49-9233-46ae-9b97-e527ed0557cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a23009eee4b44493837c60d7ebe64975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:32:48Z,use_quota=True,user_id='9cc66dfaf85b4ef182321a5b1257759b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6744b6ae-b341-4ea2-9977-720f14963f9b),volume_type_id=6744b6ae-b341-4ea2-9977-720f14963f9b)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (004b89ac-13b6-48b4-8b01-fe31060a1f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (004b89ac-13b6-48b4-8b01-fe31060a1f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (764c2b60-1b05-46cf-9a49-ce180ab963d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:32:47 devstack cinder-volume[87607]: DEBUG cinder.image.glance [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Creating Keystone auth plugin from conf {{(pid=87607) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 16 23:32:48 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (764c2b60-1b05-46cf-9a49-ce180ab963d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '038e0d49-9233-46ae-9b97-e527ed0557cf', 'volume_name': 'volume-038e0d49-9233-46ae-9b97-e527ed0557cf', 'volume_size': 1, 'image_id': '4dadd5fa-f41c-4029-a995-cb1ae9301d2b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4dadd5fa-f41c-4029-a995-cb1ae9301d2b', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--194438595', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a23009eee4b44493837c60d7ebe64975', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4dadd5fa-f41c-4029-a995-cb1ae9301d2b', 'created_at': datetime.datetime(2026, 7, 16, 21, 32, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 21, 32, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4dadd5fa-f41c-4029-a995-cb1ae9301d2b/file', 'properties': {}}, 'image_service': }' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:32:48 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (424b0caf-d3ab-4de2-af79-9e6b05e6413d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:32:48 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (424b0caf-d3ab-4de2-af79-9e6b05e6413d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:32:48 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:48 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1ac7225-fa34-43f3-aeb0-f1f881623236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:32:48 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Volume 038e0d49-9233-46ae-9b97-e527ed0557cf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-038e0d49-9233-46ae-9b97-e527ed0557cf', 'volume_size': 1, 'image_id': '4dadd5fa-f41c-4029-a995-cb1ae9301d2b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4dadd5fa-f41c-4029-a995-cb1ae9301d2b', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--194438595', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a23009eee4b44493837c60d7ebe64975', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4dadd5fa-f41c-4029-a995-cb1ae9301d2b', 'created_at': datetime.datetime(2026, 7, 16, 21, 32, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 21, 32, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4dadd5fa-f41c-4029-a995-cb1ae9301d2b/file', 'properties': {}}, 'image_service': } Jul 16 23:32:48 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Trying to clone 038e0d49-9233-46ae-9b97-e527ed0557cf from image 4dadd5fa-f41c-4029-a995-cb1ae9301d2b at location (None, [{'url': 'file:///opt/stack/data/glance/images/4dadd5fa-f41c-4029-a995-cb1ae9301d2b', 'metadata': {}}]). {{(pid=87607) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 16 23:32:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2f397a4e-1eda-49bb-ab8d-dac0adf98601 tempest-TestInstancesWithCinderVolumes-1086060171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9c7c05e5-5c08-4ebf-89a0-410afc986d6d 1073741824" returned: 0 in 0.469s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2f397a4e-1eda-49bb-ab8d-dac0adf98601 tempest-TestInstancesWithCinderVolumes-1086060171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9c7c05e5-5c08-4ebf-89a0-410afc986d6d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:48 devstack sudo[104383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9c7c05e5-5c08-4ebf-89a0-410afc986d6d Jul 16 23:32:48 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:48 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2f397a4e-1eda-49bb-ab8d-dac0adf98601 tempest-TestInstancesWithCinderVolumes-1086060171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9c7c05e5-5c08-4ebf-89a0-410afc986d6d" returned: 0 in 0.256s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:48 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-2f397a4e-1eda-49bb-ab8d-dac0adf98601 tempest-TestInstancesWithCinderVolumes-1086060171 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:32:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-2f397a4e-1eda-49bb-ab8d-dac0adf98601 tempest-TestInstancesWithCinderVolumes-1086060171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:32:48 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-2f397a4e-1eda-49bb-ab8d-dac0adf98601 tempest-TestInstancesWithCinderVolumes-1086060171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b75f8d6-9c6d-4508-894c-3c24191c76e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c7c05e5-5c08-4ebf-89a0-410afc986d6d', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:32:48 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-2f397a4e-1eda-49bb-ab8d-dac0adf98601 tempest-TestInstancesWithCinderVolumes-1086060171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2964854f-d8da-44fc-b405-e55eea6bf66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:32:48 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-2f397a4e-1eda-49bb-ab8d-dac0adf98601 tempest-TestInstancesWithCinderVolumes-1086060171 None] Volume volume-9c7c05e5-5c08-4ebf-89a0-410afc986d6d (9c7c05e5-5c08-4ebf-89a0-410afc986d6d): created successfully Jul 16 23:32:48 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-2f397a4e-1eda-49bb-ab8d-dac0adf98601 tempest-TestInstancesWithCinderVolumes-1086060171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2964854f-d8da-44fc-b405-e55eea6bf66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:32:48 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-2f397a4e-1eda-49bb-ab8d-dac0adf98601 tempest-TestInstancesWithCinderVolumes-1086060171 None] Flow 'volume_create_manager' (3b7543e5-b674-4487-82f6-262b1fb496b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:32:48 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-2f397a4e-1eda-49bb-ab8d-dac0adf98601 tempest-TestInstancesWithCinderVolumes-1086060171 None] Created volume successfully. Jul 16 23:32:51 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4dadd5fa-f41c-4029-a995-cb1ae9301d2b_ylf9zevpdevstack@QuobyteHD, size 20.69 MB, duration 2.73 sec {{(pid=87607) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 16 23:32:51 devstack cinder-volume[87607]: INFO cinder.image.image_utils [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Image download 20.69 MB at 7.57 MB/s Jul 16 23:32:51 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[512e0d33-8705-4f1a-858d-66ca38920504]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:32:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dadd5fa-f41c-4029-a995-cb1ae9301d2b_ylf9zevpdevstack@QuobyteHD {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:51 devstack sudo[104393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dadd5fa-f41c-4029-a995-cb1ae9301d2b_ylf9zevpdevstack@QuobyteHD Jul 16 23:32:51 devstack sudo[104393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:51 devstack sudo[104393]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dadd5fa-f41c-4029-a995-cb1ae9301d2b_ylf9zevpdevstack@QuobyteHD" returned: 0 in 0.312s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:51 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Temporary image 4dadd5fa-f41c-4029-a995-cb1ae9301d2b is fetched for user 9cc66dfaf85b4ef182321a5b1257759b. {{(pid=87607) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 16 23:32:51 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7a895b-9c59-43b7-a6b3-efa1e8cdd3c4]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:32:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dadd5fa-f41c-4029-a995-cb1ae9301d2b_ylf9zevpdevstack@QuobyteHD {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:51 devstack sudo[104398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dadd5fa-f41c-4029-a995-cb1ae9301d2b_ylf9zevpdevstack@QuobyteHD Jul 16 23:32:51 devstack sudo[104398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:51 devstack sudo[104398]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dadd5fa-f41c-4029-a995-cb1ae9301d2b_ylf9zevpdevstack@QuobyteHD" returned: 0 in 0.333s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:32:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:32:51 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-656026411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=038e0d49-9233-46ae-9b97-e527ed0557cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a23009eee4b44493837c60d7ebe64975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:32:48Z,use_quota=True,user_id='9cc66dfaf85b4ef182321a5b1257759b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6744b6ae-b341-4ea2-9977-720f14963f9b),volume_type_id=6744b6ae-b341-4ea2-9977-720f14963f9b)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:32:51 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Creating volume 038e0d49-9233-46ae-9b97-e527ed0557cf {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:32:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:32:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:32:51 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:32:51 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:32:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:32:51 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:32:51 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:32:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-038e0d49-9233-46ae-9b97-e527ed0557cf 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:51 devstack sudo[104403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-038e0d49-9233-46ae-9b97-e527ed0557cf 1073741824 Jul 16 23:32:51 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:52 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-038e0d49-9233-46ae-9b97-e527ed0557cf 1073741824" returned: 0 in 0.404s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-038e0d49-9233-46ae-9b97-e527ed0557cf {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:52 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-038e0d49-9233-46ae-9b97-e527ed0557cf Jul 16 23:32:52 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:52 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-038e0d49-9233-46ae-9b97-e527ed0557cf" returned: 0 in 0.248s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:52 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:32:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:32:52 devstack cinder-volume[87607]: DEBUG cinder.volume.volume_utils [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Attempting download of 4dadd5fa-f41c-4029-a995-cb1ae9301d2b ((None, [{'url': 'file:///opt/stack/data/glance/images/4dadd5fa-f41c-4029-a995-cb1ae9301d2b', 'metadata': {}}])) to volume 038e0d49-9233-46ae-9b97-e527ed0557cf. {{(pid=87607) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 16 23:32:52 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f6ddbf-a9d2-44c3-8e14-5a8ce2bb41a0]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:32:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4dadd5fa-f41c-4029-a995-cb1ae9301d2b_bib3b0nb {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:52 devstack sudo[104412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4dadd5fa-f41c-4029-a995-cb1ae9301d2b_bib3b0nb Jul 16 23:32:52 devstack sudo[104412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:52 devstack sudo[104412]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4dadd5fa-f41c-4029-a995-cb1ae9301d2b_bib3b0nb" returned: 0 in 0.335s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4dadd5fa-f41c-4029-a995-cb1ae9301d2b_bib3b0nb {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:53 devstack sudo[104416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4dadd5fa-f41c-4029-a995-cb1ae9301d2b_bib3b0nb Jul 16 23:32:53 devstack sudo[104416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:53 devstack sudo[104416]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4dadd5fa-f41c-4029-a995-cb1ae9301d2b_bib3b0nb" returned: 1 in 0.324s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4dadd5fa-f41c-4029-a995-cb1ae9301d2b_bib3b0nb' failed. Not Retrying. {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 23:32:53 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[242a018a-903c-4cdd-8cfd-1cc584c919b6]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:32:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dadd5fa-f41c-4029-a995-cb1ae9301d2b_ylf9zevpdevstack@QuobyteHD {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:53 devstack sudo[104420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dadd5fa-f41c-4029-a995-cb1ae9301d2b_ylf9zevpdevstack@QuobyteHD Jul 16 23:32:53 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:53 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dadd5fa-f41c-4029-a995-cb1ae9301d2b_ylf9zevpdevstack@QuobyteHD" returned: 0 in 0.323s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:53 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] 4dadd5fa-f41c-4029-a995-cb1ae9301d2b was qcow2, converting to qcow2 {{(pid=87607) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 16 23:32:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4dadd5fa-f41c-4029-a995-cb1ae9301d2b_ylf9zevpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-038e0d49-9233-46ae-9b97-e527ed0557cf {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:53 devstack sudo[104425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4dadd5fa-f41c-4029-a995-cb1ae9301d2b_ylf9zevpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-038e0d49-9233-46ae-9b97-e527ed0557cf Jul 16 23:32:53 devstack sudo[104425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:55 devstack sudo[104425]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4dadd5fa-f41c-4029-a995-cb1ae9301d2b_ylf9zevpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-038e0d49-9233-46ae-9b97-e527ed0557cf" returned: 0 in 1.482s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:55 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4dadd5fa-f41c-4029-a995-cb1ae9301d2b_ylf9zevpdevstack@QuobyteHD, size 112.00 MB, duration 1.48 sec, destination /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-038e0d49-9233-46ae-9b97-e527ed0557cf {{(pid=87607) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 23:32:55 devstack cinder-volume[87607]: INFO cinder.image.image_utils [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Converted 112.00 MB image at 75.52 MB/s Jul 16 23:32:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-038e0d49-9233-46ae-9b97-e527ed0557cf 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:32:55 devstack sudo[104434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-038e0d49-9233-46ae-9b97-e527ed0557cf 1G Jul 16 23:32:55 devstack sudo[104434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:32:55 devstack sudo[104434]: pam_unix(sudo:session): session closed for user root Jul 16 23:32:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-038e0d49-9233-46ae-9b97-e527ed0557cf 1G" returned: 0 in 0.314s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:32:55 devstack cinder-volume[87607]: DEBUG cinder.volume.volume_utils [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Downloaded image 4dadd5fa-f41c-4029-a995-cb1ae9301d2b ((None, [{'url': 'file:///opt/stack/data/glance/images/4dadd5fa-f41c-4029-a995-cb1ae9301d2b', 'metadata': {}}])) to volume 038e0d49-9233-46ae-9b97-e527ed0557cf successfully. {{(pid=87607) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 16 23:32:55 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Temporary image 4dadd5fa-f41c-4029-a995-cb1ae9301d2b for user 9cc66dfaf85b4ef182321a5b1257759b is deleted. {{(pid=87607) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 16 23:32:55 devstack cinder-volume[87607]: DEBUG cinder.volume.volume_utils [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Marking volume 038e0d49-9233-46ae-9b97-e527ed0557cf as bootable. {{(pid=87607) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 16 23:32:55 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Copying metadata from image 4dadd5fa-f41c-4029-a995-cb1ae9301d2b to 038e0d49-9233-46ae-9b97-e527ed0557cf. {{(pid=87607) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 16 23:32:55 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Creating volume glance metadata for volume 038e0d49-9233-46ae-9b97-e527ed0557cf backed by image 4dadd5fa-f41c-4029-a995-cb1ae9301d2b with: {'image_id': '4dadd5fa-f41c-4029-a995-cb1ae9301d2b', 'image_name': 'tempest-scenario-img--194438595', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87607) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 16 23:32:55 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1ac7225-fa34-43f3-aeb0-f1f881623236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-038e0d49-9233-46ae-9b97-e527ed0557cf', 'volume_size': 1, 'image_id': '4dadd5fa-f41c-4029-a995-cb1ae9301d2b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4dadd5fa-f41c-4029-a995-cb1ae9301d2b', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--194438595', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a23009eee4b44493837c60d7ebe64975', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4dadd5fa-f41c-4029-a995-cb1ae9301d2b', 'created_at': datetime.datetime(2026, 7, 16, 21, 32, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 21, 32, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4dadd5fa-f41c-4029-a995-cb1ae9301d2b/file', 'properties': {}}, 'image_service': }' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:32:55 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e385b37-ba6f-4ff7-b308-8953c726baf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:32:55 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Volume volume-038e0d49-9233-46ae-9b97-e527ed0557cf (038e0d49-9233-46ae-9b97-e527ed0557cf): created successfully Jul 16 23:32:55 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e385b37-ba6f-4ff7-b308-8953c726baf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:32:55 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Flow 'volume_create_manager' (92054a76-475f-4c7f-98f5-b103d4023ee5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:32:55 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-cef73b71-4e70-485e-9205-7048414ac20d tempest-TestInstancesWithCinderVolumes-1086060171 None] Created volume successfully. Jul 16 23:32:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-86c7dc42-fb27-41bc-9c84-dea690094b88 req-411c24d1-5c92-46bc-8d70-561c90e8881d tempest-TestInstancesWithCinderVolumes-1086060171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:32:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-86c7dc42-fb27-41bc-9c84-dea690094b88 req-411c24d1-5c92-46bc-8d70-561c90e8881d tempest-TestInstancesWithCinderVolumes-1086060171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:32:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-86c7dc42-fb27-41bc-9c84-dea690094b88 req-411c24d1-5c92-46bc-8d70-561c90e8881d tempest-TestInstancesWithCinderVolumes-1086060171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:32:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-86c7dc42-fb27-41bc-9c84-dea690094b88 req-411c24d1-5c92-46bc-8d70-561c90e8881d tempest-TestInstancesWithCinderVolumes-1086060171 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72', 'name': 'volume-038e0d49-9233-46ae-9b97-e527ed0557cf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c42a75d7-777d-49f7-a262-32bea4060a15', 'enforce_multipath': True} {{(pid=87607) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 23:32:58 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-86c7dc42-fb27-41bc-9c84-dea690094b88 req-411c24d1-5c92-46bc-8d70-561c90e8881d tempest-TestInstancesWithCinderVolumes-1086060171 None] attachment_update completed successfully. Jul 16 23:33:08 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:SELECT=18,cinder:UPDATE=12,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:33:08 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:UPDATE=13,cinder:SELECT=19,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:33:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-edd34ae3-cdee-4b9c-8a87-a08f27b4a423 req-d45136c6-3304-4fd1-a300-00e7b261c128 tempest-TestInstancesWithCinderVolumes-1086060171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:33:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-edd34ae3-cdee-4b9c-8a87-a08f27b4a423 req-d45136c6-3304-4fd1-a300-00e7b261c128 tempest-TestInstancesWithCinderVolumes-1086060171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:33:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-edd34ae3-cdee-4b9c-8a87-a08f27b4a423 req-d45136c6-3304-4fd1-a300-00e7b261c128 tempest-TestInstancesWithCinderVolumes-1086060171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:33:29 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-edd34ae3-cdee-4b9c-8a87-a08f27b4a423 req-d45136c6-3304-4fd1-a300-00e7b261c128 tempest-TestInstancesWithCinderVolumes-1086060171 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72', 'name': 'volume-0a133ba7-0746-4d76-8906-8efcd3aa93d8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e5e90bb9-01a8-46ff-a5cf-2419526341a7', 'enforce_multipath': True} {{(pid=87607) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 23:33:29 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-edd34ae3-cdee-4b9c-8a87-a08f27b4a423 req-d45136c6-3304-4fd1-a300-00e7b261c128 tempest-TestInstancesWithCinderVolumes-1086060171 None] attachment_update completed successfully. Jul 16 23:33:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-1840d3b6-2a97-4792-b3eb-49e59c86769c req-99845d3d-4e81-41be-8813-95a05a437625 tempest-TestInstancesWithCinderVolumes-1086060171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:33:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-1840d3b6-2a97-4792-b3eb-49e59c86769c req-99845d3d-4e81-41be-8813-95a05a437625 tempest-TestInstancesWithCinderVolumes-1086060171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:33:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-1840d3b6-2a97-4792-b3eb-49e59c86769c req-99845d3d-4e81-41be-8813-95a05a437625 tempest-TestInstancesWithCinderVolumes-1086060171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:33:31 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-1840d3b6-2a97-4792-b3eb-49e59c86769c req-99845d3d-4e81-41be-8813-95a05a437625 tempest-TestInstancesWithCinderVolumes-1086060171 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72', 'name': 'volume-9c7c05e5-5c08-4ebf-89a0-410afc986d6d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ee197ac9-9db5-46c2-a285-267ccddf71fe', 'enforce_multipath': True} {{(pid=87607) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 23:33:31 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-1840d3b6-2a97-4792-b3eb-49e59c86769c req-99845d3d-4e81-41be-8813-95a05a437625 tempest-TestInstancesWithCinderVolumes-1086060171 None] attachment_update completed successfully. Jul 16 23:33:35 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-26a752db-3ad0-4145-906a-85af27c78b06 req-e401b52d-c6d8-43ea-9560-4993c8445b4f tempest-TestInstancesWithCinderVolumes-1086060171 None] Terminate volume connection completed successfully. Jul 16 23:33:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-26a752db-3ad0-4145-906a-85af27c78b06 req-e401b52d-c6d8-43ea-9560-4993c8445b4f tempest-TestInstancesWithCinderVolumes-1086060171 None] Deleting attachment e5e90bb9-01a8-46ff-a5cf-2419526341a7. {{(pid=87607) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 23:33:36 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-43ca3681-c554-45d6-b3a3-51891b69c48b tempest-TestInstancesWithCinderVolumes-1086060171 None] Acquiring lock "cinder-0a133ba7-0746-4d76-8906-8efcd3aa93d8-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:33:36 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-43ca3681-c554-45d6-b3a3-51891b69c48b tempest-TestInstancesWithCinderVolumes-1086060171 None] Lock "cinder-0a133ba7-0746-4d76-8906-8efcd3aa93d8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:33:36 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-43ca3681-c554-45d6-b3a3-51891b69c48b tempest-TestInstancesWithCinderVolumes-1086060171 None] Acquiring lock "cinder-quobyte-0a133ba7-0746-4d76-8906-8efcd3aa93d8" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:33:36 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-43ca3681-c554-45d6-b3a3-51891b69c48b tempest-TestInstancesWithCinderVolumes-1086060171 None] Lock "cinder-quobyte-0a133ba7-0746-4d76-8906-8efcd3aa93d8" acquired by "delete_volume" :: waited 0.014s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:33:36 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd53c17-c6c1-4a77-a13a-ccffd99e181a]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:33:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-43ca3681-c554-45d6-b3a3-51891b69c48b tempest-TestInstancesWithCinderVolumes-1086060171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0a133ba7-0746-4d76-8906-8efcd3aa93d8 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:33:36 devstack sudo[105023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0a133ba7-0746-4d76-8906-8efcd3aa93d8 Jul 16 23:33:36 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:33:36 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root Jul 16 23:33:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-43ca3681-c554-45d6-b3a3-51891b69c48b tempest-TestInstancesWithCinderVolumes-1086060171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0a133ba7-0746-4d76-8906-8efcd3aa93d8" returned: 0 in 0.377s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:33:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-43ca3681-c554-45d6-b3a3-51891b69c48b tempest-TestInstancesWithCinderVolumes-1086060171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0a133ba7-0746-4d76-8906-8efcd3aa93d8 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:33:36 devstack sudo[105028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0a133ba7-0746-4d76-8906-8efcd3aa93d8 Jul 16 23:33:36 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:33:37 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root Jul 16 23:33:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-43ca3681-c554-45d6-b3a3-51891b69c48b tempest-TestInstancesWithCinderVolumes-1086060171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0a133ba7-0746-4d76-8906-8efcd3aa93d8" returned: 0 in 0.257s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:33:37 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-43ca3681-c554-45d6-b3a3-51891b69c48b tempest-TestInstancesWithCinderVolumes-1086060171 None] Lock "cinder-quobyte-0a133ba7-0746-4d76-8906-8efcd3aa93d8" released by "delete_volume" :: held 0.675s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:33:37 devstack cinder-volume[87607]: WARNING cinder.quota [None req-43ca3681-c554-45d6-b3a3-51891b69c48b tempest-TestInstancesWithCinderVolumes-1086060171 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1171490601-2124953530 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1171490601-2124953530, it is now deprecated. Please use the default quota class for default quota. Jul 16 23:33:37 devstack cinder-volume[87607]: WARNING cinder.quota [None req-43ca3681-c554-45d6-b3a3-51891b69c48b tempest-TestInstancesWithCinderVolumes-1086060171 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1171490601-2124953530 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1171490601-2124953530, it is now deprecated. Please use the default quota class for default quota. Jul 16 23:33:37 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-43ca3681-c554-45d6-b3a3-51891b69c48b tempest-TestInstancesWithCinderVolumes-1086060171 None] Created reservations ['b0b6eecf-e5e6-4fdf-9587-f65a449a0fc0', 'd7aa77d8-d20c-4610-9e72-5793a34f196a', '1764c7fc-409e-4928-a21b-a1935a1b8499', '085d078b-efc7-4716-a5a6-90072d25c433'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:33:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-43ca3681-c554-45d6-b3a3-51891b69c48b tempest-TestInstancesWithCinderVolumes-1086060171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:33:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-43ca3681-c554-45d6-b3a3-51891b69c48b tempest-TestInstancesWithCinderVolumes-1086060171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:33:37 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-43ca3681-c554-45d6-b3a3-51891b69c48b tempest-TestInstancesWithCinderVolumes-1086060171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:33:37 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-43ca3681-c554-45d6-b3a3-51891b69c48b tempest-TestInstancesWithCinderVolumes-1086060171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:33:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-43ca3681-c554-45d6-b3a3-51891b69c48b tempest-TestInstancesWithCinderVolumes-1086060171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:33:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-43ca3681-c554-45d6-b3a3-51891b69c48b tempest-TestInstancesWithCinderVolumes-1086060171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:33:37 devstack sudo[105031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:33:37 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:33:37 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root Jul 16 23:33:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-43ca3681-c554-45d6-b3a3-51891b69c48b tempest-TestInstancesWithCinderVolumes-1086060171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.259s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:33:37 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-43ca3681-c554-45d6-b3a3-51891b69c48b tempest-TestInstancesWithCinderVolumes-1086060171 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:33:37 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-43ca3681-c554-45d6-b3a3-51891b69c48b tempest-TestInstancesWithCinderVolumes-1086060171 None] Deleted volume successfully. Jul 16 23:33:37 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-43ca3681-c554-45d6-b3a3-51891b69c48b tempest-TestInstancesWithCinderVolumes-1086060171 None] Lock "cinder-0a133ba7-0746-4d76-8906-8efcd3aa93d8-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:33:39 devstack cinder-volume[87607]: DEBUG oslo_service.periodic_task [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:33:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:33:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:33:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:33:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:33:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:33:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:33:39 devstack sudo[105058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:33:39 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:33:39 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-70d86293-fb8f-4065-ae2b-9d06298e2e05 req-e8999ed1-4bfa-4e09-8e30-51ac27276018 tempest-TestInstancesWithCinderVolumes-1086060171 None] Terminate volume connection completed successfully. Jul 16 23:33:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-70d86293-fb8f-4065-ae2b-9d06298e2e05 req-e8999ed1-4bfa-4e09-8e30-51ac27276018 tempest-TestInstancesWithCinderVolumes-1086060171 None] Deleting attachment ee197ac9-9db5-46c2-a285-267ccddf71fe. {{(pid=87607) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 23:33:39 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root Jul 16 23:33:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.241s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:33:39 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:33:39 devstack cinder-volume[87607]: DEBUG oslo_service.periodic_task [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running periodic task VolumeManager._thread_info {{(pid=87607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:33:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] thread count: 28 {{(pid=87607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 23:33:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] thread info: [<_MainThread(MainThread, started 139090403627136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 23:33:40 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1c8854e8-7d89-4179-9315-2dc528b90b40 tempest-TestInstancesWithCinderVolumes-1086060171 None] Acquiring lock "cinder-9c7c05e5-5c08-4ebf-89a0-410afc986d6d-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:33:40 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1c8854e8-7d89-4179-9315-2dc528b90b40 tempest-TestInstancesWithCinderVolumes-1086060171 None] Lock "cinder-9c7c05e5-5c08-4ebf-89a0-410afc986d6d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:33:40 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1c8854e8-7d89-4179-9315-2dc528b90b40 tempest-TestInstancesWithCinderVolumes-1086060171 None] Acquiring lock "cinder-quobyte-9c7c05e5-5c08-4ebf-89a0-410afc986d6d" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:33:40 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1c8854e8-7d89-4179-9315-2dc528b90b40 tempest-TestInstancesWithCinderVolumes-1086060171 None] Lock "cinder-quobyte-9c7c05e5-5c08-4ebf-89a0-410afc986d6d" acquired by "delete_volume" :: waited 0.017s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:33:40 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[c017846c-9644-4ba3-aff8-40b58b84909a]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:33:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1c8854e8-7d89-4179-9315-2dc528b90b40 tempest-TestInstancesWithCinderVolumes-1086060171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9c7c05e5-5c08-4ebf-89a0-410afc986d6d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:33:40 devstack sudo[105095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9c7c05e5-5c08-4ebf-89a0-410afc986d6d Jul 16 23:33:40 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:33:40 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root Jul 16 23:33:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1c8854e8-7d89-4179-9315-2dc528b90b40 tempest-TestInstancesWithCinderVolumes-1086060171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9c7c05e5-5c08-4ebf-89a0-410afc986d6d" returned: 0 in 0.388s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:33:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1c8854e8-7d89-4179-9315-2dc528b90b40 tempest-TestInstancesWithCinderVolumes-1086060171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9c7c05e5-5c08-4ebf-89a0-410afc986d6d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:33:40 devstack sudo[105102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9c7c05e5-5c08-4ebf-89a0-410afc986d6d Jul 16 23:33:40 devstack sudo[105102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:33:41 devstack sudo[105102]: pam_unix(sudo:session): session closed for user root Jul 16 23:33:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1c8854e8-7d89-4179-9315-2dc528b90b40 tempest-TestInstancesWithCinderVolumes-1086060171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9c7c05e5-5c08-4ebf-89a0-410afc986d6d" returned: 0 in 0.252s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:33:41 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1c8854e8-7d89-4179-9315-2dc528b90b40 tempest-TestInstancesWithCinderVolumes-1086060171 None] Lock "cinder-quobyte-9c7c05e5-5c08-4ebf-89a0-410afc986d6d" released by "delete_volume" :: held 0.686s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:33:41 devstack cinder-volume[87607]: WARNING cinder.quota [None req-1c8854e8-7d89-4179-9315-2dc528b90b40 tempest-TestInstancesWithCinderVolumes-1086060171 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-552627266-2027577577 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-552627266-2027577577, it is now deprecated. Please use the default quota class for default quota. Jul 16 23:33:41 devstack cinder-volume[87607]: WARNING cinder.quota [None req-1c8854e8-7d89-4179-9315-2dc528b90b40 tempest-TestInstancesWithCinderVolumes-1086060171 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-552627266-2027577577 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-552627266-2027577577, it is now deprecated. Please use the default quota class for default quota. Jul 16 23:33:41 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-1c8854e8-7d89-4179-9315-2dc528b90b40 tempest-TestInstancesWithCinderVolumes-1086060171 None] Created reservations ['d0447dff-46f3-4485-83d3-01e66c536050', '3371d4d4-af3b-4189-adaf-303c706e34cc', '4e032812-94a4-48da-9e30-11592827e316', 'a0e5cafd-3880-4c78-8a4b-6e30045434b7'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:33:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1c8854e8-7d89-4179-9315-2dc528b90b40 tempest-TestInstancesWithCinderVolumes-1086060171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:33:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1c8854e8-7d89-4179-9315-2dc528b90b40 tempest-TestInstancesWithCinderVolumes-1086060171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:33:41 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1c8854e8-7d89-4179-9315-2dc528b90b40 tempest-TestInstancesWithCinderVolumes-1086060171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:33:41 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1c8854e8-7d89-4179-9315-2dc528b90b40 tempest-TestInstancesWithCinderVolumes-1086060171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:33:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1c8854e8-7d89-4179-9315-2dc528b90b40 tempest-TestInstancesWithCinderVolumes-1086060171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:33:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1c8854e8-7d89-4179-9315-2dc528b90b40 tempest-TestInstancesWithCinderVolumes-1086060171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:33:41 devstack sudo[105105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:33:41 devstack sudo[105105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:33:41 devstack sudo[105105]: pam_unix(sudo:session): session closed for user root Jul 16 23:33:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1c8854e8-7d89-4179-9315-2dc528b90b40 tempest-TestInstancesWithCinderVolumes-1086060171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.276s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:33:41 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-1c8854e8-7d89-4179-9315-2dc528b90b40 tempest-TestInstancesWithCinderVolumes-1086060171 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:33:41 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-1c8854e8-7d89-4179-9315-2dc528b90b40 tempest-TestInstancesWithCinderVolumes-1086060171 None] Deleted volume successfully. Jul 16 23:33:41 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1c8854e8-7d89-4179-9315-2dc528b90b40 tempest-TestInstancesWithCinderVolumes-1086060171 None] Lock "cinder-9c7c05e5-5c08-4ebf-89a0-410afc986d6d-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:33:43 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-19776c29-6bad-4793-b0b5-3d1c293faf8b req-36b5fe04-2be6-4abb-a0fe-dd3e2f9315b4 tempest-TestInstancesWithCinderVolumes-1086060171 None] Terminate volume connection completed successfully. Jul 16 23:33:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-19776c29-6bad-4793-b0b5-3d1c293faf8b req-36b5fe04-2be6-4abb-a0fe-dd3e2f9315b4 tempest-TestInstancesWithCinderVolumes-1086060171 None] Deleting attachment c42a75d7-777d-49f7-a262-32bea4060a15. {{(pid=87607) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 23:33:45 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0bb27a0c-4c68-4277-9c5d-eb4538248a9f tempest-TestInstancesWithCinderVolumes-1086060171 None] Acquiring lock "cinder-038e0d49-9233-46ae-9b97-e527ed0557cf-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:33:45 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0bb27a0c-4c68-4277-9c5d-eb4538248a9f tempest-TestInstancesWithCinderVolumes-1086060171 None] Lock "cinder-038e0d49-9233-46ae-9b97-e527ed0557cf-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:33:45 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0bb27a0c-4c68-4277-9c5d-eb4538248a9f tempest-TestInstancesWithCinderVolumes-1086060171 None] Acquiring lock "cinder-quobyte-038e0d49-9233-46ae-9b97-e527ed0557cf" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:33:45 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0bb27a0c-4c68-4277-9c5d-eb4538248a9f tempest-TestInstancesWithCinderVolumes-1086060171 None] Lock "cinder-quobyte-038e0d49-9233-46ae-9b97-e527ed0557cf" acquired by "delete_volume" :: waited 0.016s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:33:45 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[9214efd7-903a-47f3-b3be-6114b91d8e0c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:33:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0bb27a0c-4c68-4277-9c5d-eb4538248a9f tempest-TestInstancesWithCinderVolumes-1086060171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-038e0d49-9233-46ae-9b97-e527ed0557cf {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:33:45 devstack sudo[105137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-038e0d49-9233-46ae-9b97-e527ed0557cf Jul 16 23:33:45 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:33:45 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root Jul 16 23:33:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0bb27a0c-4c68-4277-9c5d-eb4538248a9f tempest-TestInstancesWithCinderVolumes-1086060171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-038e0d49-9233-46ae-9b97-e527ed0557cf" returned: 0 in 0.350s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:33:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0bb27a0c-4c68-4277-9c5d-eb4538248a9f tempest-TestInstancesWithCinderVolumes-1086060171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-038e0d49-9233-46ae-9b97-e527ed0557cf {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:33:45 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-038e0d49-9233-46ae-9b97-e527ed0557cf Jul 16 23:33:45 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:33:45 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Jul 16 23:33:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0bb27a0c-4c68-4277-9c5d-eb4538248a9f tempest-TestInstancesWithCinderVolumes-1086060171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-038e0d49-9233-46ae-9b97-e527ed0557cf" returned: 0 in 0.237s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:33:45 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0bb27a0c-4c68-4277-9c5d-eb4538248a9f tempest-TestInstancesWithCinderVolumes-1086060171 None] Lock "cinder-quobyte-038e0d49-9233-46ae-9b97-e527ed0557cf" released by "delete_volume" :: held 0.621s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:33:45 devstack cinder-volume[87607]: WARNING cinder.quota [None req-0bb27a0c-4c68-4277-9c5d-eb4538248a9f tempest-TestInstancesWithCinderVolumes-1086060171 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-121661858-451500381 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-121661858-451500381, it is now deprecated. Please use the default quota class for default quota. Jul 16 23:33:45 devstack cinder-volume[87607]: WARNING cinder.quota [None req-0bb27a0c-4c68-4277-9c5d-eb4538248a9f tempest-TestInstancesWithCinderVolumes-1086060171 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-121661858-451500381 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-121661858-451500381, it is now deprecated. Please use the default quota class for default quota. Jul 16 23:33:45 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-0bb27a0c-4c68-4277-9c5d-eb4538248a9f tempest-TestInstancesWithCinderVolumes-1086060171 None] Created reservations ['cee5645b-0bc3-4ea3-8cdd-6b65fa271d67', '282bff4e-5363-4243-beae-9d2fa95b8b72', '7c707c5f-cb7b-4b25-bd89-5bc3cec853ca', '591f630f-4107-4f76-83ab-720a30cec0d8'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:33:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0bb27a0c-4c68-4277-9c5d-eb4538248a9f tempest-TestInstancesWithCinderVolumes-1086060171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:33:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0bb27a0c-4c68-4277-9c5d-eb4538248a9f tempest-TestInstancesWithCinderVolumes-1086060171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:33:45 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0bb27a0c-4c68-4277-9c5d-eb4538248a9f tempest-TestInstancesWithCinderVolumes-1086060171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:33:45 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0bb27a0c-4c68-4277-9c5d-eb4538248a9f tempest-TestInstancesWithCinderVolumes-1086060171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:33:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0bb27a0c-4c68-4277-9c5d-eb4538248a9f tempest-TestInstancesWithCinderVolumes-1086060171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:33:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0bb27a0c-4c68-4277-9c5d-eb4538248a9f tempest-TestInstancesWithCinderVolumes-1086060171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:33:45 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:33:45 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:33:46 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Jul 16 23:33:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0bb27a0c-4c68-4277-9c5d-eb4538248a9f tempest-TestInstancesWithCinderVolumes-1086060171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.234s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:33:46 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-0bb27a0c-4c68-4277-9c5d-eb4538248a9f tempest-TestInstancesWithCinderVolumes-1086060171 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:33:46 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-0bb27a0c-4c68-4277-9c5d-eb4538248a9f tempest-TestInstancesWithCinderVolumes-1086060171 None] Deleted volume successfully. Jul 16 23:33:46 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0bb27a0c-4c68-4277-9c5d-eb4538248a9f tempest-TestInstancesWithCinderVolumes-1086060171 None] Lock "cinder-038e0d49-9233-46ae-9b97-e527ed0557cf-delete_volume" released by "delete_volume" :: held 1.032s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:33:55 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:SELECT=29,cinder:UPDATE=30,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:33:56 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:SELECT=33,cinder:UPDATE=24,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:34:39 devstack cinder-volume[87607]: DEBUG oslo_service.periodic_task [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:34:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:34:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:34:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:34:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:34:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:34:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:34:39 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:34:39 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:34:39 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Jul 16 23:34:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.265s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:34:39 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:34:39 devstack cinder-volume[87607]: DEBUG oslo_service.periodic_task [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running periodic task VolumeManager._thread_info {{(pid=87607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:34:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] thread count: 28 {{(pid=87607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 23:34:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] thread info: [<_MainThread(MainThread, started 139090403627136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 23:34:43 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7e6d154-f0ff-4f25-8c8f-609c11ae35d1 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:34:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e7e6d154-f0ff-4f25-8c8f-609c11ae35d1 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Flow 'volume_create_manager' (fb03145f-1efc-4d96-9591-4f4fc23d6ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:34:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e7e6d154-f0ff-4f25-8c8f-609c11ae35d1 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fce97b1-964b-4d7a-aeee-4e13ea1bdd45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:34:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e7e6d154-f0ff-4f25-8c8f-609c11ae35d1 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fce97b1-964b-4d7a-aeee-4e13ea1bdd45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-696601721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20a41f8e-f566-4af7-9c2c-fc1481a5c8d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8388c6b8a6f460e95c00934d63a7b12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:34:44Z,use_quota=True,user_id='583027a3c9134e6da17015c333777c6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:34:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e7e6d154-f0ff-4f25-8c8f-609c11ae35d1 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c74726-375d-435d-bb30-6d8bd607a7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:34:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e7e6d154-f0ff-4f25-8c8f-609c11ae35d1 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c74726-375d-435d-bb30-6d8bd607a7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:34:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e7e6d154-f0ff-4f25-8c8f-609c11ae35d1 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d40c0c1-dd93-4e11-b7e2-e31eddd65c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:34:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e7e6d154-f0ff-4f25-8c8f-609c11ae35d1 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d40c0c1-dd93-4e11-b7e2-e31eddd65c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20a41f8e-f566-4af7-9c2c-fc1481a5c8d2', 'volume_name': 'volume-20a41f8e-f566-4af7-9c2c-fc1481a5c8d2', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:34:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e7e6d154-f0ff-4f25-8c8f-609c11ae35d1 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b9fa069-6177-453c-b31e-d6de1c8b7f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:34:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e7e6d154-f0ff-4f25-8c8f-609c11ae35d1 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b9fa069-6177-453c-b31e-d6de1c8b7f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:34:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e7e6d154-f0ff-4f25-8c8f-609c11ae35d1 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abf4ac6c-8ea4-439f-a797-b5d844384f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:34:43 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-e7e6d154-f0ff-4f25-8c8f-609c11ae35d1 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Volume 20a41f8e-f566-4af7-9c2c-fc1481a5c8d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20a41f8e-f566-4af7-9c2c-fc1481a5c8d2', 'volume_size': 1} Jul 16 23:34:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e7e6d154-f0ff-4f25-8c8f-609c11ae35d1 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:34:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e7e6d154-f0ff-4f25-8c8f-609c11ae35d1 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:34:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e7e6d154-f0ff-4f25-8c8f-609c11ae35d1 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-696601721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20a41f8e-f566-4af7-9c2c-fc1481a5c8d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8388c6b8a6f460e95c00934d63a7b12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:34:44Z,use_quota=True,user_id='583027a3c9134e6da17015c333777c6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:34:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-e7e6d154-f0ff-4f25-8c8f-609c11ae35d1 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Creating volume 20a41f8e-f566-4af7-9c2c-fc1481a5c8d2 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:34:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e7e6d154-f0ff-4f25-8c8f-609c11ae35d1 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:34:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e7e6d154-f0ff-4f25-8c8f-609c11ae35d1 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:34:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e7e6d154-f0ff-4f25-8c8f-609c11ae35d1 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:34:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e7e6d154-f0ff-4f25-8c8f-609c11ae35d1 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:34:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e7e6d154-f0ff-4f25-8c8f-609c11ae35d1 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:34:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e7e6d154-f0ff-4f25-8c8f-609c11ae35d1 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:34:43 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-e7e6d154-f0ff-4f25-8c8f-609c11ae35d1 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:34:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e7e6d154-f0ff-4f25-8c8f-609c11ae35d1 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20a41f8e-f566-4af7-9c2c-fc1481a5c8d2 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:34:43 devstack sudo[105317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20a41f8e-f566-4af7-9c2c-fc1481a5c8d2 1073741824 Jul 16 23:34:43 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:34:44 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root Jul 16 23:34:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e7e6d154-f0ff-4f25-8c8f-609c11ae35d1 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20a41f8e-f566-4af7-9c2c-fc1481a5c8d2 1073741824" returned: 0 in 0.405s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:34:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e7e6d154-f0ff-4f25-8c8f-609c11ae35d1 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20a41f8e-f566-4af7-9c2c-fc1481a5c8d2 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:34:44 devstack sudo[105322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20a41f8e-f566-4af7-9c2c-fc1481a5c8d2 Jul 16 23:34:44 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:34:44 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root Jul 16 23:34:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e7e6d154-f0ff-4f25-8c8f-609c11ae35d1 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20a41f8e-f566-4af7-9c2c-fc1481a5c8d2" returned: 0 in 0.239s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:34:44 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e7e6d154-f0ff-4f25-8c8f-609c11ae35d1 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:34:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e7e6d154-f0ff-4f25-8c8f-609c11ae35d1 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:34:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e7e6d154-f0ff-4f25-8c8f-609c11ae35d1 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abf4ac6c-8ea4-439f-a797-b5d844384f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20a41f8e-f566-4af7-9c2c-fc1481a5c8d2', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:34:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e7e6d154-f0ff-4f25-8c8f-609c11ae35d1 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f138b2fb-77d1-463b-84f1-8b0b469610f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:34:44 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-e7e6d154-f0ff-4f25-8c8f-609c11ae35d1 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Volume volume-20a41f8e-f566-4af7-9c2c-fc1481a5c8d2 (20a41f8e-f566-4af7-9c2c-fc1481a5c8d2): created successfully Jul 16 23:34:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e7e6d154-f0ff-4f25-8c8f-609c11ae35d1 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f138b2fb-77d1-463b-84f1-8b0b469610f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:34:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e7e6d154-f0ff-4f25-8c8f-609c11ae35d1 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Flow 'volume_create_manager' (fb03145f-1efc-4d96-9591-4f4fc23d6ff2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:34:44 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-e7e6d154-f0ff-4f25-8c8f-609c11ae35d1 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Created volume successfully. Jul 16 23:34:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-22f4bc3b-8241-4ae4-ad62-c696c8aa2827 req-77b2b40c-f03f-4f20-9414-abbad6a98b78 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:34:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-22f4bc3b-8241-4ae4-ad62-c696c8aa2827 req-77b2b40c-f03f-4f20-9414-abbad6a98b78 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:34:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [req-22f4bc3b-8241-4ae4-ad62-c696c8aa2827 req-77b2b40c-f03f-4f20-9414-abbad6a98b78 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:34:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-22f4bc3b-8241-4ae4-ad62-c696c8aa2827 req-77b2b40c-f03f-4f20-9414-abbad6a98b78 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72', 'name': 'volume-20a41f8e-f566-4af7-9c2c-fc1481a5c8d2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cca8c179-9953-40eb-b52a-c5ccbce517bc', 'enforce_multipath': True} {{(pid=87607) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 23:34:45 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-22f4bc3b-8241-4ae4-ad62-c696c8aa2827 req-77b2b40c-f03f-4f20-9414-abbad6a98b78 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] attachment_update completed successfully. Jul 16 23:34:47 devstack cinder-volume[87607]: INFO cinder.volume.manager [req-e2a5ff95-bc1e-4c3b-a399-3179e67a2b5d req-45ce4b3d-a7c8-45e7-a6dd-8b95d0b4431f tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Terminate volume connection completed successfully. Jul 16 23:34:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [req-e2a5ff95-bc1e-4c3b-a399-3179e67a2b5d req-45ce4b3d-a7c8-45e7-a6dd-8b95d0b4431f tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Deleting attachment cca8c179-9953-40eb-b52a-c5ccbce517bc. {{(pid=87607) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 23:34:48 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-5cfc59db-68bb-4fa0-9a87-5498a41476f4 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Acquiring lock "cinder-20a41f8e-f566-4af7-9c2c-fc1481a5c8d2-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:34:48 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-5cfc59db-68bb-4fa0-9a87-5498a41476f4 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Lock "cinder-20a41f8e-f566-4af7-9c2c-fc1481a5c8d2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:34:48 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-5cfc59db-68bb-4fa0-9a87-5498a41476f4 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Acquiring lock "cinder-quobyte-20a41f8e-f566-4af7-9c2c-fc1481a5c8d2" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:34:48 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-5cfc59db-68bb-4fa0-9a87-5498a41476f4 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Lock "cinder-quobyte-20a41f8e-f566-4af7-9c2c-fc1481a5c8d2" acquired by "delete_volume" :: waited 0.015s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:34:48 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb73b9d-76e6-4d55-a3c1-273be66523eb]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:34:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5cfc59db-68bb-4fa0-9a87-5498a41476f4 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20a41f8e-f566-4af7-9c2c-fc1481a5c8d2 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:34:48 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20a41f8e-f566-4af7-9c2c-fc1481a5c8d2 Jul 16 23:34:48 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:34:48 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Jul 16 23:34:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5cfc59db-68bb-4fa0-9a87-5498a41476f4 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20a41f8e-f566-4af7-9c2c-fc1481a5c8d2" returned: 0 in 0.347s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:34:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5cfc59db-68bb-4fa0-9a87-5498a41476f4 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20a41f8e-f566-4af7-9c2c-fc1481a5c8d2 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:34:48 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20a41f8e-f566-4af7-9c2c-fc1481a5c8d2 Jul 16 23:34:48 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:34:49 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Jul 16 23:34:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5cfc59db-68bb-4fa0-9a87-5498a41476f4 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-20a41f8e-f566-4af7-9c2c-fc1481a5c8d2" returned: 0 in 0.240s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:34:49 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-5cfc59db-68bb-4fa0-9a87-5498a41476f4 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Lock "cinder-quobyte-20a41f8e-f566-4af7-9c2c-fc1481a5c8d2" released by "delete_volume" :: held 0.624s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:34:49 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-5cfc59db-68bb-4fa0-9a87-5498a41476f4 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Created reservations ['eb369d4a-16ce-4175-a3ba-fc47146ef5e8', 'd05a1a2b-7c39-4613-8d97-faf99e8ae552', 'fbb8428e-9492-4bbb-989d-44d5f8a314b1', '43a7d3a6-294d-4935-86bb-519150e6e8cf'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:34:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5cfc59db-68bb-4fa0-9a87-5498a41476f4 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:34:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5cfc59db-68bb-4fa0-9a87-5498a41476f4 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:34:49 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-5cfc59db-68bb-4fa0-9a87-5498a41476f4 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:34:49 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-5cfc59db-68bb-4fa0-9a87-5498a41476f4 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:34:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5cfc59db-68bb-4fa0-9a87-5498a41476f4 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:34:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5cfc59db-68bb-4fa0-9a87-5498a41476f4 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:34:49 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:34:49 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:34:49 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Jul 16 23:34:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5cfc59db-68bb-4fa0-9a87-5498a41476f4 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.230s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:34:49 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-5cfc59db-68bb-4fa0-9a87-5498a41476f4 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:34:49 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-5cfc59db-68bb-4fa0-9a87-5498a41476f4 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Deleted volume successfully. Jul 16 23:34:49 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-5cfc59db-68bb-4fa0-9a87-5498a41476f4 tempest-TestServerVolumeAttachScenarioOldVersion-1052355707 None] Lock "cinder-20a41f8e-f566-4af7-9c2c-fc1481a5c8d2-delete_volume" released by "delete_volume" :: held 1.026s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:34:59 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:UPDATE=11,cinder:INSERT=4,cinder:DELETE=2,cinder:SELECT=14 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:35:01 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-756d9338-e175-434a-85c5-f4c62f9ad041 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:35:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-756d9338-e175-434a-85c5-f4c62f9ad041 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Flow 'volume_create_manager' (af8d1800-ddf1-48b5-b13c-133a852dcc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:35:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-756d9338-e175-434a-85c5-f4c62f9ad041 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d3d7f13-68f7-45e5-9aba-f04706102f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-756d9338-e175-434a-85c5-f4c62f9ad041 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d3d7f13-68f7-45e5-9aba-f04706102f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1638047952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6074a37-d0cb-411c-915f-904eb140ebed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42ba76c4603d4c6a8ee970e85f15bbd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:35:02Z,use_quota=True,user_id='15577571deac4897b2b0b9566a1d8ffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-756d9338-e175-434a-85c5-f4c62f9ad041 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c10f504a-6332-444a-b941-b3bc46273e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-756d9338-e175-434a-85c5-f4c62f9ad041 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c10f504a-6332-444a-b941-b3bc46273e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-756d9338-e175-434a-85c5-f4c62f9ad041 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2cddc0f-4dde-46a4-9510-6ace1a65a154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-756d9338-e175-434a-85c5-f4c62f9ad041 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2cddc0f-4dde-46a4-9510-6ace1a65a154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6074a37-d0cb-411c-915f-904eb140ebed', 'volume_name': 'volume-b6074a37-d0cb-411c-915f-904eb140ebed', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-756d9338-e175-434a-85c5-f4c62f9ad041 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ae98b1b-7606-4243-8c6c-6d1f23a87f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-756d9338-e175-434a-85c5-f4c62f9ad041 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ae98b1b-7606-4243-8c6c-6d1f23a87f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-756d9338-e175-434a-85c5-f4c62f9ad041 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7983b695-4162-4b22-b56d-a8d8412b9144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:01 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-756d9338-e175-434a-85c5-f4c62f9ad041 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Volume b6074a37-d0cb-411c-915f-904eb140ebed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6074a37-d0cb-411c-915f-904eb140ebed', 'volume_size': 1} Jul 16 23:35:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-756d9338-e175-434a-85c5-f4c62f9ad041 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-756d9338-e175-434a-85c5-f4c62f9ad041 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:01 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-756d9338-e175-434a-85c5-f4c62f9ad041 tempest-CreateVolumesFromSnapshotTest-1160753816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1638047952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6074a37-d0cb-411c-915f-904eb140ebed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42ba76c4603d4c6a8ee970e85f15bbd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:35:02Z,use_quota=True,user_id='15577571deac4897b2b0b9566a1d8ffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:35:01 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-756d9338-e175-434a-85c5-f4c62f9ad041 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Creating volume b6074a37-d0cb-411c-915f-904eb140ebed {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:35:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-756d9338-e175-434a-85c5-f4c62f9ad041 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-756d9338-e175-434a-85c5-f4c62f9ad041 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:01 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-756d9338-e175-434a-85c5-f4c62f9ad041 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:35:01 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-756d9338-e175-434a-85c5-f4c62f9ad041 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:35:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-756d9338-e175-434a-85c5-f4c62f9ad041 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:01 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-756d9338-e175-434a-85c5-f4c62f9ad041 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:35:01 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-756d9338-e175-434a-85c5-f4c62f9ad041 tempest-CreateVolumesFromSnapshotTest-1160753816 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:35:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-756d9338-e175-434a-85c5-f4c62f9ad041 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:01 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed 1073741824 Jul 16 23:35:01 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:02 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-756d9338-e175-434a-85c5-f4c62f9ad041 tempest-CreateVolumesFromSnapshotTest-1160753816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed 1073741824" returned: 0 in 0.451s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-756d9338-e175-434a-85c5-f4c62f9ad041 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:02 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed Jul 16 23:35:02 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:02 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-756d9338-e175-434a-85c5-f4c62f9ad041 tempest-CreateVolumesFromSnapshotTest-1160753816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed" returned: 0 in 0.227s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:02 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-756d9338-e175-434a-85c5-f4c62f9ad041 tempest-CreateVolumesFromSnapshotTest-1160753816 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:35:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-756d9338-e175-434a-85c5-f4c62f9ad041 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-756d9338-e175-434a-85c5-f4c62f9ad041 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7983b695-4162-4b22-b56d-a8d8412b9144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6074a37-d0cb-411c-915f-904eb140ebed', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-756d9338-e175-434a-85c5-f4c62f9ad041 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9653c1ba-4037-468c-b948-e7bf9f8cabc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:02 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-756d9338-e175-434a-85c5-f4c62f9ad041 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Volume volume-b6074a37-d0cb-411c-915f-904eb140ebed (b6074a37-d0cb-411c-915f-904eb140ebed): created successfully Jul 16 23:35:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-756d9338-e175-434a-85c5-f4c62f9ad041 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9653c1ba-4037-468c-b948-e7bf9f8cabc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-756d9338-e175-434a-85c5-f4c62f9ad041 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Flow 'volume_create_manager' (af8d1800-ddf1-48b5-b13c-133a852dcc8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:35:02 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-756d9338-e175-434a-85c5-f4c62f9ad041 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Created volume successfully. Jul 16 23:35:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7b817400-3b22-4a7e-b378-c053f73ff3c9 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7b817400-3b22-4a7e-b378-c053f73ff3c9 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:02 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-7b817400-3b22-4a7e-b378-c053f73ff3c9 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Creating offline snapshot 359704aa-9fc6-4915-8e87-55431b4e1e5b of volume b6074a37-d0cb-411c-915f-904eb140ebed {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:35:02 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[5023f290-d69c-4bfd-9fb1-b8aac9e4a28c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:35:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7b817400-3b22-4a7e-b378-c053f73ff3c9 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:03 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed Jul 16 23:35:03 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:03 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7b817400-3b22-4a7e-b378-c053f73ff3c9 tempest-CreateVolumesFromSnapshotTest-1160753816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed" returned: 0 in 0.338s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7b817400-3b22-4a7e-b378-c053f73ff3c9 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed.359704aa-9fc6-4915-8e87-55431b4e1e5b 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:03 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed.359704aa-9fc6-4915-8e87-55431b4e1e5b 1G Jul 16 23:35:03 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:03 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7b817400-3b22-4a7e-b378-c053f73ff3c9 tempest-CreateVolumesFromSnapshotTest-1160753816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed.359704aa-9fc6-4915-8e87-55431b4e1e5b 1G" returned: 0 in 0.356s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7b817400-3b22-4a7e-b378-c053f73ff3c9 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6074a37-d0cb-411c-915f-904eb140ebed -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed.359704aa-9fc6-4915-8e87-55431b4e1e5b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:03 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6074a37-d0cb-411c-915f-904eb140ebed -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed.359704aa-9fc6-4915-8e87-55431b4e1e5b Jul 16 23:35:03 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:03 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7b817400-3b22-4a7e-b378-c053f73ff3c9 tempest-CreateVolumesFromSnapshotTest-1160753816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6074a37-d0cb-411c-915f-904eb140ebed -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed.359704aa-9fc6-4915-8e87-55431b4e1e5b" returned: 0 in 0.298s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:03 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-7b817400-3b22-4a7e-b378-c053f73ff3c9 tempest-CreateVolumesFromSnapshotTest-1160753816 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed.359704aa-9fc6-4915-8e87-55431b4e1e5b is being set with open permissions: ugo+rw Jul 16 23:35:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7b817400-3b22-4a7e-b378-c053f73ff3c9 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed.359704aa-9fc6-4915-8e87-55431b4e1e5b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:04 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed.359704aa-9fc6-4915-8e87-55431b4e1e5b Jul 16 23:35:04 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:04 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7b817400-3b22-4a7e-b378-c053f73ff3c9 tempest-CreateVolumesFromSnapshotTest-1160753816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed.359704aa-9fc6-4915-8e87-55431b4e1e5b" returned: 0 in 0.245s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7b817400-3b22-4a7e-b378-c053f73ff3c9 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:04 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed.info Jul 16 23:35:04 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:04 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7b817400-3b22-4a7e-b378-c053f73ff3c9 tempest-CreateVolumesFromSnapshotTest-1160753816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed.info" returned: 0 in 0.253s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:04 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-7b817400-3b22-4a7e-b378-c053f73ff3c9 tempest-CreateVolumesFromSnapshotTest-1160753816 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed.info is being set with open permissions: ugo+rw Jul 16 23:35:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7b817400-3b22-4a7e-b378-c053f73ff3c9 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:04 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed.info Jul 16 23:35:04 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:04 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7b817400-3b22-4a7e-b378-c053f73ff3c9 tempest-CreateVolumesFromSnapshotTest-1160753816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed.info" returned: 0 in 0.244s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7b817400-3b22-4a7e-b378-c053f73ff3c9 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.811s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:04 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-7b817400-3b22-4a7e-b378-c053f73ff3c9 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Create snapshot completed successfully Jul 16 23:35:05 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cfc011c-d349-4398-9cf4-ab12fad60222 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:35:05 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3cfc011c-d349-4398-9cf4-ab12fad60222 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Flow 'volume_create_manager' (4ae7d361-7011-456d-86e9-dc1603c25e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:35:05 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3cfc011c-d349-4398-9cf4-ab12fad60222 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb8a22b7-a646-4880-acfb-f8a1293a0215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:05 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3cfc011c-d349-4398-9cf4-ab12fad60222 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb8a22b7-a646-4880-acfb-f8a1293a0215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1940366683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f1f73aa-f8ce-441d-9e50-fe9155aa3e0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42ba76c4603d4c6a8ee970e85f15bbd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:35:05Z,use_quota=True,user_id='15577571deac4897b2b0b9566a1d8ffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:05 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3cfc011c-d349-4398-9cf4-ab12fad60222 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bb07efa-9366-4abb-87cd-244cd07926fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:05 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3cfc011c-d349-4398-9cf4-ab12fad60222 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bb07efa-9366-4abb-87cd-244cd07926fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:05 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3cfc011c-d349-4398-9cf4-ab12fad60222 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5445e16f-2efe-477c-950b-19c9740f5a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:05 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3cfc011c-d349-4398-9cf4-ab12fad60222 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5445e16f-2efe-477c-950b-19c9740f5a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f1f73aa-f8ce-441d-9e50-fe9155aa3e0b', 'volume_name': 'volume-3f1f73aa-f8ce-441d-9e50-fe9155aa3e0b', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:05 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3cfc011c-d349-4398-9cf4-ab12fad60222 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f334adab-e3ac-4e94-a891-8c4c9dae532c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:05 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3cfc011c-d349-4398-9cf4-ab12fad60222 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f334adab-e3ac-4e94-a891-8c4c9dae532c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:05 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3cfc011c-d349-4398-9cf4-ab12fad60222 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e14fd878-7a0d-446f-b222-bb9947841d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:05 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-3cfc011c-d349-4398-9cf4-ab12fad60222 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Volume 3f1f73aa-f8ce-441d-9e50-fe9155aa3e0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f1f73aa-f8ce-441d-9e50-fe9155aa3e0b', 'volume_size': 1} Jul 16 23:35:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3cfc011c-d349-4398-9cf4-ab12fad60222 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3cfc011c-d349-4398-9cf4-ab12fad60222 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:05 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3cfc011c-d349-4398-9cf4-ab12fad60222 tempest-CreateVolumesFromSnapshotTest-1160753816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1940366683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f1f73aa-f8ce-441d-9e50-fe9155aa3e0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42ba76c4603d4c6a8ee970e85f15bbd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:35:05Z,use_quota=True,user_id='15577571deac4897b2b0b9566a1d8ffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:35:05 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-3cfc011c-d349-4398-9cf4-ab12fad60222 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Creating volume 3f1f73aa-f8ce-441d-9e50-fe9155aa3e0b {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:35:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3cfc011c-d349-4398-9cf4-ab12fad60222 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3cfc011c-d349-4398-9cf4-ab12fad60222 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:05 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3cfc011c-d349-4398-9cf4-ab12fad60222 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:35:05 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3cfc011c-d349-4398-9cf4-ab12fad60222 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:35:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3cfc011c-d349-4398-9cf4-ab12fad60222 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:05 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3cfc011c-d349-4398-9cf4-ab12fad60222 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:35:05 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-3cfc011c-d349-4398-9cf4-ab12fad60222 tempest-CreateVolumesFromSnapshotTest-1160753816 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:35:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3cfc011c-d349-4398-9cf4-ab12fad60222 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3f1f73aa-f8ce-441d-9e50-fe9155aa3e0b 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:05 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3f1f73aa-f8ce-441d-9e50-fe9155aa3e0b 1073741824 Jul 16 23:35:05 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:05 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-290ab388-e9fc-4ecf-9e35-7a615cd99797 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:35:05 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-290ab388-e9fc-4ecf-9e35-7a615cd99797 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Flow 'volume_create_manager' (68ea2578-58f1-40bc-b894-553d915b103c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:35:05 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-290ab388-e9fc-4ecf-9e35-7a615cd99797 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a719db-45ac-4f39-a8e6-3839e98b01df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:05 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-290ab388-e9fc-4ecf-9e35-7a615cd99797 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a719db-45ac-4f39-a8e6-3839e98b01df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:35:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1466521622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26a320e2-e456-4bee-b395-7f911883394c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42ba76c4603d4c6a8ee970e85f15bbd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:35:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:35:06Z,use_quota=True,user_id='15577571deac4897b2b0b9566a1d8ffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:05 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-290ab388-e9fc-4ecf-9e35-7a615cd99797 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd2acbe8-77d8-484d-b141-c9f8e670ccac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:05 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-290ab388-e9fc-4ecf-9e35-7a615cd99797 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd2acbe8-77d8-484d-b141-c9f8e670ccac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:05 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-290ab388-e9fc-4ecf-9e35-7a615cd99797 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (928f581b-b9d2-4268-bd79-29444d71678f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:05 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-290ab388-e9fc-4ecf-9e35-7a615cd99797 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (928f581b-b9d2-4268-bd79-29444d71678f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26a320e2-e456-4bee-b395-7f911883394c', 'volume_name': 'volume-26a320e2-e456-4bee-b395-7f911883394c', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:05 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-290ab388-e9fc-4ecf-9e35-7a615cd99797 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0454d65e-75a0-431a-9a18-809724604d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:05 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-290ab388-e9fc-4ecf-9e35-7a615cd99797 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0454d65e-75a0-431a-9a18-809724604d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:05 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-290ab388-e9fc-4ecf-9e35-7a615cd99797 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bf3b6ed-74c4-4f8c-89bf-001c06feef8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:05 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-290ab388-e9fc-4ecf-9e35-7a615cd99797 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Volume 26a320e2-e456-4bee-b395-7f911883394c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26a320e2-e456-4bee-b395-7f911883394c', 'volume_size': 1} Jul 16 23:35:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-290ab388-e9fc-4ecf-9e35-7a615cd99797 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:06 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3cfc011c-d349-4398-9cf4-ab12fad60222 tempest-CreateVolumesFromSnapshotTest-1160753816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3f1f73aa-f8ce-441d-9e50-fe9155aa3e0b 1073741824" returned: 0 in 0.535s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3cfc011c-d349-4398-9cf4-ab12fad60222 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3f1f73aa-f8ce-441d-9e50-fe9155aa3e0b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:06 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3f1f73aa-f8ce-441d-9e50-fe9155aa3e0b Jul 16 23:35:06 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-57b6ed38-4aac-48fb-9783-103d865efe2f tempest-CreateVolumesFromSnapshotTest-1160753816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-57b6ed38-4aac-48fb-9783-103d865efe2f tempest-CreateVolumesFromSnapshotTest-1160753816 None] Flow 'volume_create_manager' (c3705b55-50ad-49f0-a00e-1458f2e4b7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-57b6ed38-4aac-48fb-9783-103d865efe2f tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (073475ad-1c6b-4d74-960c-ddc304d3bc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-57b6ed38-4aac-48fb-9783-103d865efe2f tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (073475ad-1c6b-4d74-960c-ddc304d3bc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:35:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1452368540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c591715-290c-43ea-831b-cb107b9270df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42ba76c4603d4c6a8ee970e85f15bbd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:35:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:35:06Z,use_quota=True,user_id='15577571deac4897b2b0b9566a1d8ffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-57b6ed38-4aac-48fb-9783-103d865efe2f tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e79ed866-2e73-4306-b3b1-cd39d623a593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-57b6ed38-4aac-48fb-9783-103d865efe2f tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e79ed866-2e73-4306-b3b1-cd39d623a593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-57b6ed38-4aac-48fb-9783-103d865efe2f tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (250cec0f-0c5d-4224-868d-42ef4946052b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-57b6ed38-4aac-48fb-9783-103d865efe2f tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (250cec0f-0c5d-4224-868d-42ef4946052b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c591715-290c-43ea-831b-cb107b9270df', 'volume_name': 'volume-6c591715-290c-43ea-831b-cb107b9270df', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-57b6ed38-4aac-48fb-9783-103d865efe2f tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0f28766-1c3f-474a-81d5-b2e483726f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-57b6ed38-4aac-48fb-9783-103d865efe2f tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0f28766-1c3f-474a-81d5-b2e483726f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-57b6ed38-4aac-48fb-9783-103d865efe2f tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00bceeb1-c2da-4d02-b418-cc535d9f8d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:06 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-57b6ed38-4aac-48fb-9783-103d865efe2f tempest-CreateVolumesFromSnapshotTest-1160753816 None] Volume 6c591715-290c-43ea-831b-cb107b9270df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c591715-290c-43ea-831b-cb107b9270df', 'volume_size': 1} Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-57b6ed38-4aac-48fb-9783-103d865efe2f tempest-CreateVolumesFromSnapshotTest-1160753816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:06 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3cfc011c-d349-4398-9cf4-ab12fad60222 tempest-CreateVolumesFromSnapshotTest-1160753816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3f1f73aa-f8ce-441d-9e50-fe9155aa3e0b" returned: 0 in 0.284s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3cfc011c-d349-4398-9cf4-ab12fad60222 tempest-CreateVolumesFromSnapshotTest-1160753816 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3cfc011c-d349-4398-9cf4-ab12fad60222 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-290ab388-e9fc-4ecf-9e35-7a615cd99797 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.500s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-290ab388-e9fc-4ecf-9e35-7a615cd99797 tempest-CreateVolumesFromSnapshotTest-1160753816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:35:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1466521622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26a320e2-e456-4bee-b395-7f911883394c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42ba76c4603d4c6a8ee970e85f15bbd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:35:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:35:06Z,use_quota=True,user_id='15577571deac4897b2b0b9566a1d8ffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-290ab388-e9fc-4ecf-9e35-7a615cd99797 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Creating volume 26a320e2-e456-4bee-b395-7f911883394c {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-290ab388-e9fc-4ecf-9e35-7a615cd99797 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-290ab388-e9fc-4ecf-9e35-7a615cd99797 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-290ab388-e9fc-4ecf-9e35-7a615cd99797 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-290ab388-e9fc-4ecf-9e35-7a615cd99797 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-290ab388-e9fc-4ecf-9e35-7a615cd99797 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-290ab388-e9fc-4ecf-9e35-7a615cd99797 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:35:06 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-290ab388-e9fc-4ecf-9e35-7a615cd99797 tempest-CreateVolumesFromSnapshotTest-1160753816 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-290ab388-e9fc-4ecf-9e35-7a615cd99797 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-26a320e2-e456-4bee-b395-7f911883394c 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3cfc011c-d349-4398-9cf4-ab12fad60222 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e14fd878-7a0d-446f-b222-bb9947841d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f1f73aa-f8ce-441d-9e50-fe9155aa3e0b', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:06 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-26a320e2-e456-4bee-b395-7f911883394c 1073741824 Jul 16 23:35:06 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3cfc011c-d349-4398-9cf4-ab12fad60222 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f901eecb-bb1b-4833-93d2-83b6d37e7ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:06 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-3cfc011c-d349-4398-9cf4-ab12fad60222 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Volume volume-3f1f73aa-f8ce-441d-9e50-fe9155aa3e0b (3f1f73aa-f8ce-441d-9e50-fe9155aa3e0b): created successfully Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3cfc011c-d349-4398-9cf4-ab12fad60222 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f901eecb-bb1b-4833-93d2-83b6d37e7ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3cfc011c-d349-4398-9cf4-ab12fad60222 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Flow 'volume_create_manager' (4ae7d361-7011-456d-86e9-dc1603c25e80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:35:06 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-3cfc011c-d349-4398-9cf4-ab12fad60222 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Created volume successfully. Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a2dd778-6806-420b-bbb8-a9bceb12c5e6 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3a2dd778-6806-420b-bbb8-a9bceb12c5e6 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Flow 'volume_create_manager' (d35be1b0-faa7-45ce-865c-6b42c2784302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3a2dd778-6806-420b-bbb8-a9bceb12c5e6 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4435e98-4df7-437e-be88-1b7c5337a24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3a2dd778-6806-420b-bbb8-a9bceb12c5e6 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4435e98-4df7-437e-be88-1b7c5337a24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:35:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1220938816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c43f7d02-8ab8-40ad-98dd-45803281153f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42ba76c4603d4c6a8ee970e85f15bbd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:35:07Z,use_quota=True,user_id='15577571deac4897b2b0b9566a1d8ffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3a2dd778-6806-420b-bbb8-a9bceb12c5e6 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07f53224-270f-45df-812c-6eb264f02269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3a2dd778-6806-420b-bbb8-a9bceb12c5e6 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07f53224-270f-45df-812c-6eb264f02269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3a2dd778-6806-420b-bbb8-a9bceb12c5e6 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccc4698e-8445-49d3-95b6-0e5597c947a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3a2dd778-6806-420b-bbb8-a9bceb12c5e6 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccc4698e-8445-49d3-95b6-0e5597c947a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c43f7d02-8ab8-40ad-98dd-45803281153f', 'volume_name': 'volume-c43f7d02-8ab8-40ad-98dd-45803281153f', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3a2dd778-6806-420b-bbb8-a9bceb12c5e6 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0743507-c50f-42a0-9220-80c38933f0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3a2dd778-6806-420b-bbb8-a9bceb12c5e6 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0743507-c50f-42a0-9220-80c38933f0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3a2dd778-6806-420b-bbb8-a9bceb12c5e6 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (841ada51-c7b2-43b0-ad3c-9878766bf09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:06 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-3a2dd778-6806-420b-bbb8-a9bceb12c5e6 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Volume c43f7d02-8ab8-40ad-98dd-45803281153f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c43f7d02-8ab8-40ad-98dd-45803281153f', 'volume_size': 1} Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3a2dd778-6806-420b-bbb8-a9bceb12c5e6 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-273bd25f-40f1-4d96-a973-c53fef833367 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-273bd25f-40f1-4d96-a973-c53fef833367 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Flow 'volume_create_manager' (1436d1f7-cb81-41ea-bbfd-eed29c0e6aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-273bd25f-40f1-4d96-a973-c53fef833367 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1c529f2-4edc-4a39-bf54-55fb391d5f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:06 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-290ab388-e9fc-4ecf-9e35-7a615cd99797 tempest-CreateVolumesFromSnapshotTest-1160753816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-26a320e2-e456-4bee-b395-7f911883394c 1073741824" returned: 0 in 0.524s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-273bd25f-40f1-4d96-a973-c53fef833367 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1c529f2-4edc-4a39-bf54-55fb391d5f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1610115825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72a5cc60-64d3-4593-839e-c064c179af85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42ba76c4603d4c6a8ee970e85f15bbd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:35:07Z,use_quota=True,user_id='15577571deac4897b2b0b9566a1d8ffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-273bd25f-40f1-4d96-a973-c53fef833367 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e82acb1-f2dc-4ef6-9790-fbb544179c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-273bd25f-40f1-4d96-a973-c53fef833367 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e82acb1-f2dc-4ef6-9790-fbb544179c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-273bd25f-40f1-4d96-a973-c53fef833367 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0adeeacf-744e-483a-960f-1a5ad3d19642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-273bd25f-40f1-4d96-a973-c53fef833367 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0adeeacf-744e-483a-960f-1a5ad3d19642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72a5cc60-64d3-4593-839e-c064c179af85', 'volume_name': 'volume-72a5cc60-64d3-4593-839e-c064c179af85', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-273bd25f-40f1-4d96-a973-c53fef833367 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3f31105-d781-445e-a623-0df4d2122aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-273bd25f-40f1-4d96-a973-c53fef833367 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3f31105-d781-445e-a623-0df4d2122aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-273bd25f-40f1-4d96-a973-c53fef833367 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (663c02c9-5baa-4ec6-be29-4833e4a5d50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:07 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-273bd25f-40f1-4d96-a973-c53fef833367 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Volume 72a5cc60-64d3-4593-839e-c064c179af85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72a5cc60-64d3-4593-839e-c064c179af85', 'volume_size': 1} Jul 16 23:35:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-273bd25f-40f1-4d96-a973-c53fef833367 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-290ab388-e9fc-4ecf-9e35-7a615cd99797 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-26a320e2-e456-4bee-b395-7f911883394c {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:07 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-26a320e2-e456-4bee-b395-7f911883394c Jul 16 23:35:07 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:07 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-290ab388-e9fc-4ecf-9e35-7a615cd99797 tempest-CreateVolumesFromSnapshotTest-1160753816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-26a320e2-e456-4bee-b395-7f911883394c" returned: 0 in 0.245s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:07 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-290ab388-e9fc-4ecf-9e35-7a615cd99797 tempest-CreateVolumesFromSnapshotTest-1160753816 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:35:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-290ab388-e9fc-4ecf-9e35-7a615cd99797 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-57b6ed38-4aac-48fb-9783-103d865efe2f tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.966s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:07 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-57b6ed38-4aac-48fb-9783-103d865efe2f tempest-CreateVolumesFromSnapshotTest-1160753816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:35:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1452368540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c591715-290c-43ea-831b-cb107b9270df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42ba76c4603d4c6a8ee970e85f15bbd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:35:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:35:06Z,use_quota=True,user_id='15577571deac4897b2b0b9566a1d8ffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:35:07 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-57b6ed38-4aac-48fb-9783-103d865efe2f tempest-CreateVolumesFromSnapshotTest-1160753816 None] Creating volume 6c591715-290c-43ea-831b-cb107b9270df {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:35:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-57b6ed38-4aac-48fb-9783-103d865efe2f tempest-CreateVolumesFromSnapshotTest-1160753816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-57b6ed38-4aac-48fb-9783-103d865efe2f tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:07 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-57b6ed38-4aac-48fb-9783-103d865efe2f tempest-CreateVolumesFromSnapshotTest-1160753816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:35:07 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-57b6ed38-4aac-48fb-9783-103d865efe2f tempest-CreateVolumesFromSnapshotTest-1160753816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:35:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-57b6ed38-4aac-48fb-9783-103d865efe2f tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:07 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-57b6ed38-4aac-48fb-9783-103d865efe2f tempest-CreateVolumesFromSnapshotTest-1160753816 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:35:07 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-57b6ed38-4aac-48fb-9783-103d865efe2f tempest-CreateVolumesFromSnapshotTest-1160753816 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:35:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-57b6ed38-4aac-48fb-9783-103d865efe2f tempest-CreateVolumesFromSnapshotTest-1160753816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6c591715-290c-43ea-831b-cb107b9270df 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-290ab388-e9fc-4ecf-9e35-7a615cd99797 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bf3b6ed-74c4-4f8c-89bf-001c06feef8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26a320e2-e456-4bee-b395-7f911883394c', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:07 devstack sudo[105850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6c591715-290c-43ea-831b-cb107b9270df 1073741824 Jul 16 23:35:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-290ab388-e9fc-4ecf-9e35-7a615cd99797 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14cb23df-339e-4db9-bc33-c8d98883b97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:07 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:07 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-290ab388-e9fc-4ecf-9e35-7a615cd99797 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Volume volume-26a320e2-e456-4bee-b395-7f911883394c (26a320e2-e456-4bee-b395-7f911883394c): created successfully Jul 16 23:35:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-290ab388-e9fc-4ecf-9e35-7a615cd99797 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14cb23df-339e-4db9-bc33-c8d98883b97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-290ab388-e9fc-4ecf-9e35-7a615cd99797 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Flow 'volume_create_manager' (68ea2578-58f1-40bc-b894-553d915b103c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:35:07 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-290ab388-e9fc-4ecf-9e35-7a615cd99797 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Created volume successfully. Jul 16 23:35:07 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-57b6ed38-4aac-48fb-9783-103d865efe2f tempest-CreateVolumesFromSnapshotTest-1160753816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6c591715-290c-43ea-831b-cb107b9270df 1073741824" returned: 0 in 0.403s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-57b6ed38-4aac-48fb-9783-103d865efe2f tempest-CreateVolumesFromSnapshotTest-1160753816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6c591715-290c-43ea-831b-cb107b9270df {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:07 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6c591715-290c-43ea-831b-cb107b9270df Jul 16 23:35:07 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:08 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-57b6ed38-4aac-48fb-9783-103d865efe2f tempest-CreateVolumesFromSnapshotTest-1160753816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6c591715-290c-43ea-831b-cb107b9270df" returned: 0 in 0.247s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:08 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-57b6ed38-4aac-48fb-9783-103d865efe2f tempest-CreateVolumesFromSnapshotTest-1160753816 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:35:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-57b6ed38-4aac-48fb-9783-103d865efe2f tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3a2dd778-6806-420b-bbb8-a9bceb12c5e6 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.313s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:08 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3a2dd778-6806-420b-bbb8-a9bceb12c5e6 tempest-CreateVolumesFromSnapshotTest-1160753816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:35:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1220938816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c43f7d02-8ab8-40ad-98dd-45803281153f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42ba76c4603d4c6a8ee970e85f15bbd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:35:07Z,use_quota=True,user_id='15577571deac4897b2b0b9566a1d8ffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:35:08 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-3a2dd778-6806-420b-bbb8-a9bceb12c5e6 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Creating volume c43f7d02-8ab8-40ad-98dd-45803281153f {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:35:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3a2dd778-6806-420b-bbb8-a9bceb12c5e6 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3a2dd778-6806-420b-bbb8-a9bceb12c5e6 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:08 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3a2dd778-6806-420b-bbb8-a9bceb12c5e6 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:35:08 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3a2dd778-6806-420b-bbb8-a9bceb12c5e6 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:35:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3a2dd778-6806-420b-bbb8-a9bceb12c5e6 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:08 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3a2dd778-6806-420b-bbb8-a9bceb12c5e6 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:35:08 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-3a2dd778-6806-420b-bbb8-a9bceb12c5e6 tempest-CreateVolumesFromSnapshotTest-1160753816 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:35:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3a2dd778-6806-420b-bbb8-a9bceb12c5e6 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-c43f7d02-8ab8-40ad-98dd-45803281153f 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:08 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-57b6ed38-4aac-48fb-9783-103d865efe2f tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00bceeb1-c2da-4d02-b418-cc535d9f8d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c591715-290c-43ea-831b-cb107b9270df', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:08 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-c43f7d02-8ab8-40ad-98dd-45803281153f 1073741824 Jul 16 23:35:08 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-57b6ed38-4aac-48fb-9783-103d865efe2f tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b347b3b9-4b54-4b6f-801c-69a58c4e9b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:08 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:08 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-57b6ed38-4aac-48fb-9783-103d865efe2f tempest-CreateVolumesFromSnapshotTest-1160753816 None] Volume volume-6c591715-290c-43ea-831b-cb107b9270df (6c591715-290c-43ea-831b-cb107b9270df): created successfully Jul 16 23:35:08 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-57b6ed38-4aac-48fb-9783-103d865efe2f tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b347b3b9-4b54-4b6f-801c-69a58c4e9b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:08 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-57b6ed38-4aac-48fb-9783-103d865efe2f tempest-CreateVolumesFromSnapshotTest-1160753816 None] Flow 'volume_create_manager' (c3705b55-50ad-49f0-a00e-1458f2e4b7ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:35:08 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-57b6ed38-4aac-48fb-9783-103d865efe2f tempest-CreateVolumesFromSnapshotTest-1160753816 None] Created volume successfully. Jul 16 23:35:08 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3a2dd778-6806-420b-bbb8-a9bceb12c5e6 tempest-CreateVolumesFromSnapshotTest-1160753816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-c43f7d02-8ab8-40ad-98dd-45803281153f 1073741824" returned: 0 in 0.405s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3a2dd778-6806-420b-bbb8-a9bceb12c5e6 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-c43f7d02-8ab8-40ad-98dd-45803281153f {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:08 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-c43f7d02-8ab8-40ad-98dd-45803281153f Jul 16 23:35:08 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:08 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3a2dd778-6806-420b-bbb8-a9bceb12c5e6 tempest-CreateVolumesFromSnapshotTest-1160753816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-c43f7d02-8ab8-40ad-98dd-45803281153f" returned: 0 in 0.237s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:08 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3a2dd778-6806-420b-bbb8-a9bceb12c5e6 tempest-CreateVolumesFromSnapshotTest-1160753816 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:35:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3a2dd778-6806-420b-bbb8-a9bceb12c5e6 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-273bd25f-40f1-4d96-a973-c53fef833367 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.652s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:08 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-273bd25f-40f1-4d96-a973-c53fef833367 tempest-CreateVolumesFromSnapshotTest-1160753816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1610115825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72a5cc60-64d3-4593-839e-c064c179af85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42ba76c4603d4c6a8ee970e85f15bbd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:35:07Z,use_quota=True,user_id='15577571deac4897b2b0b9566a1d8ffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:35:08 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-273bd25f-40f1-4d96-a973-c53fef833367 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Creating volume 72a5cc60-64d3-4593-839e-c064c179af85 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:35:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-273bd25f-40f1-4d96-a973-c53fef833367 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-273bd25f-40f1-4d96-a973-c53fef833367 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:08 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-273bd25f-40f1-4d96-a973-c53fef833367 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:35:08 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-273bd25f-40f1-4d96-a973-c53fef833367 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:35:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-273bd25f-40f1-4d96-a973-c53fef833367 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:08 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-273bd25f-40f1-4d96-a973-c53fef833367 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:35:08 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-273bd25f-40f1-4d96-a973-c53fef833367 tempest-CreateVolumesFromSnapshotTest-1160753816 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:35:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-273bd25f-40f1-4d96-a973-c53fef833367 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72a5cc60-64d3-4593-839e-c064c179af85 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:08 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3a2dd778-6806-420b-bbb8-a9bceb12c5e6 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (841ada51-c7b2-43b0-ad3c-9878766bf09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c43f7d02-8ab8-40ad-98dd-45803281153f', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:08 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72a5cc60-64d3-4593-839e-c064c179af85 1073741824 Jul 16 23:35:08 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:08 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3a2dd778-6806-420b-bbb8-a9bceb12c5e6 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6e9f17c-95c1-49df-9980-e58780d90cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:08 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-3a2dd778-6806-420b-bbb8-a9bceb12c5e6 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Volume volume-c43f7d02-8ab8-40ad-98dd-45803281153f (c43f7d02-8ab8-40ad-98dd-45803281153f): created successfully Jul 16 23:35:08 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3a2dd778-6806-420b-bbb8-a9bceb12c5e6 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6e9f17c-95c1-49df-9980-e58780d90cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:08 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3a2dd778-6806-420b-bbb8-a9bceb12c5e6 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Flow 'volume_create_manager' (d35be1b0-faa7-45ce-865c-6b42c2784302) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:35:08 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-3a2dd778-6806-420b-bbb8-a9bceb12c5e6 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Created volume successfully. Jul 16 23:35:09 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-273bd25f-40f1-4d96-a973-c53fef833367 tempest-CreateVolumesFromSnapshotTest-1160753816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72a5cc60-64d3-4593-839e-c064c179af85 1073741824" returned: 0 in 0.462s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-273bd25f-40f1-4d96-a973-c53fef833367 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72a5cc60-64d3-4593-839e-c064c179af85 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:09 devstack sudo[105873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72a5cc60-64d3-4593-839e-c064c179af85 Jul 16 23:35:09 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:09 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-273bd25f-40f1-4d96-a973-c53fef833367 tempest-CreateVolumesFromSnapshotTest-1160753816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72a5cc60-64d3-4593-839e-c064c179af85" returned: 0 in 0.242s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:09 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-273bd25f-40f1-4d96-a973-c53fef833367 tempest-CreateVolumesFromSnapshotTest-1160753816 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:35:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-273bd25f-40f1-4d96-a973-c53fef833367 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:09 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-273bd25f-40f1-4d96-a973-c53fef833367 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (663c02c9-5baa-4ec6-be29-4833e4a5d50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72a5cc60-64d3-4593-839e-c064c179af85', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:09 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-273bd25f-40f1-4d96-a973-c53fef833367 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f109cd56-63f4-49eb-bdf1-dde1eda3313c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:09 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-273bd25f-40f1-4d96-a973-c53fef833367 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Volume volume-72a5cc60-64d3-4593-839e-c064c179af85 (72a5cc60-64d3-4593-839e-c064c179af85): created successfully Jul 16 23:35:09 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-273bd25f-40f1-4d96-a973-c53fef833367 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f109cd56-63f4-49eb-bdf1-dde1eda3313c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:09 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-273bd25f-40f1-4d96-a973-c53fef833367 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Flow 'volume_create_manager' (1436d1f7-cb81-41ea-bbfd-eed29c0e6aed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:35:09 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-273bd25f-40f1-4d96-a973-c53fef833367 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Created volume successfully. Jul 16 23:35:10 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4d5065fc-bbab-4ed7-8c5d-610999c1c2d7 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Acquiring lock "cinder-72a5cc60-64d3-4593-839e-c064c179af85-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:35:10 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4d5065fc-bbab-4ed7-8c5d-610999c1c2d7 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "cinder-72a5cc60-64d3-4593-839e-c064c179af85-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:35:10 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4d5065fc-bbab-4ed7-8c5d-610999c1c2d7 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Acquiring lock "cinder-quobyte-72a5cc60-64d3-4593-839e-c064c179af85" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:35:10 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4d5065fc-bbab-4ed7-8c5d-610999c1c2d7 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "cinder-quobyte-72a5cc60-64d3-4593-839e-c064c179af85" acquired by "delete_volume" :: waited 0.017s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:35:10 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90a8420-e48b-4056-9795-a27aed170665]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:35:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4d5065fc-bbab-4ed7-8c5d-610999c1c2d7 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72a5cc60-64d3-4593-839e-c064c179af85 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:10 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72a5cc60-64d3-4593-839e-c064c179af85 Jul 16 23:35:10 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:10 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4d5065fc-bbab-4ed7-8c5d-610999c1c2d7 tempest-CreateVolumesFromSnapshotTest-1160753816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72a5cc60-64d3-4593-839e-c064c179af85" returned: 0 in 0.352s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4d5065fc-bbab-4ed7-8c5d-610999c1c2d7 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72a5cc60-64d3-4593-839e-c064c179af85 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:10 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72a5cc60-64d3-4593-839e-c064c179af85 Jul 16 23:35:10 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:11 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4d5065fc-bbab-4ed7-8c5d-610999c1c2d7 tempest-CreateVolumesFromSnapshotTest-1160753816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-72a5cc60-64d3-4593-839e-c064c179af85" returned: 0 in 0.246s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:11 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4d5065fc-bbab-4ed7-8c5d-610999c1c2d7 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "cinder-quobyte-72a5cc60-64d3-4593-839e-c064c179af85" released by "delete_volume" :: held 0.644s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:35:11 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-4d5065fc-bbab-4ed7-8c5d-610999c1c2d7 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Created reservations ['0d7dc271-49bc-4d12-a3ba-0fe4dd8e9341', '9381c0c0-c58d-43e6-bf70-fc841da8b91f', '134ab026-b361-4b7c-aba2-7d37c03b2c8e', '364b1218-3075-4c93-bc1f-76038e96c0dd'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:35:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4d5065fc-bbab-4ed7-8c5d-610999c1c2d7 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4d5065fc-bbab-4ed7-8c5d-610999c1c2d7 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:11 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4d5065fc-bbab-4ed7-8c5d-610999c1c2d7 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:35:11 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4d5065fc-bbab-4ed7-8c5d-610999c1c2d7 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:35:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4d5065fc-bbab-4ed7-8c5d-610999c1c2d7 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4d5065fc-bbab-4ed7-8c5d-610999c1c2d7 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:11 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:35:11 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:11 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4d5065fc-bbab-4ed7-8c5d-610999c1c2d7 tempest-CreateVolumesFromSnapshotTest-1160753816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.236s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:11 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-4d5065fc-bbab-4ed7-8c5d-610999c1c2d7 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:35:11 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-4d5065fc-bbab-4ed7-8c5d-610999c1c2d7 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Deleted volume successfully. Jul 16 23:35:11 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4d5065fc-bbab-4ed7-8c5d-610999c1c2d7 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "cinder-72a5cc60-64d3-4593-839e-c064c179af85-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:35:11 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e45b5362-6019-4d30-8569-393b068b02ca tempest-CreateVolumesFromSnapshotTest-1160753816 None] Acquiring lock "cinder-c43f7d02-8ab8-40ad-98dd-45803281153f-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:35:11 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e45b5362-6019-4d30-8569-393b068b02ca tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "cinder-c43f7d02-8ab8-40ad-98dd-45803281153f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:35:11 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e45b5362-6019-4d30-8569-393b068b02ca tempest-CreateVolumesFromSnapshotTest-1160753816 None] Acquiring lock "cinder-quobyte-c43f7d02-8ab8-40ad-98dd-45803281153f" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:35:11 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e45b5362-6019-4d30-8569-393b068b02ca tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "cinder-quobyte-c43f7d02-8ab8-40ad-98dd-45803281153f" acquired by "delete_volume" :: waited 0.013s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:35:11 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5e0df2-eac6-4ee8-80fc-43cda694afa0]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:35:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e45b5362-6019-4d30-8569-393b068b02ca tempest-CreateVolumesFromSnapshotTest-1160753816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-c43f7d02-8ab8-40ad-98dd-45803281153f {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:11 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-c43f7d02-8ab8-40ad-98dd-45803281153f Jul 16 23:35:11 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:11 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e45b5362-6019-4d30-8569-393b068b02ca tempest-CreateVolumesFromSnapshotTest-1160753816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-c43f7d02-8ab8-40ad-98dd-45803281153f" returned: 0 in 0.344s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e45b5362-6019-4d30-8569-393b068b02ca tempest-CreateVolumesFromSnapshotTest-1160753816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-c43f7d02-8ab8-40ad-98dd-45803281153f {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:12 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-c43f7d02-8ab8-40ad-98dd-45803281153f Jul 16 23:35:12 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:12 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e45b5362-6019-4d30-8569-393b068b02ca tempest-CreateVolumesFromSnapshotTest-1160753816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-c43f7d02-8ab8-40ad-98dd-45803281153f" returned: 0 in 0.238s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:12 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e45b5362-6019-4d30-8569-393b068b02ca tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "cinder-quobyte-c43f7d02-8ab8-40ad-98dd-45803281153f" released by "delete_volume" :: held 0.622s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:35:12 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-e45b5362-6019-4d30-8569-393b068b02ca tempest-CreateVolumesFromSnapshotTest-1160753816 None] Created reservations ['22a6c900-557a-4a36-bf07-03016a9ffdad', 'dec3364e-412b-490d-831a-d6c395e46cff', 'ca96b36b-fa40-4b34-87ab-70c434a19ac1', '224a7801-5f2e-4c13-ba6f-3936c9a31f7e'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:35:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e45b5362-6019-4d30-8569-393b068b02ca tempest-CreateVolumesFromSnapshotTest-1160753816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e45b5362-6019-4d30-8569-393b068b02ca tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:12 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e45b5362-6019-4d30-8569-393b068b02ca tempest-CreateVolumesFromSnapshotTest-1160753816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:35:12 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e45b5362-6019-4d30-8569-393b068b02ca tempest-CreateVolumesFromSnapshotTest-1160753816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:35:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e45b5362-6019-4d30-8569-393b068b02ca tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e45b5362-6019-4d30-8569-393b068b02ca tempest-CreateVolumesFromSnapshotTest-1160753816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:12 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:35:12 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:12 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e45b5362-6019-4d30-8569-393b068b02ca tempest-CreateVolumesFromSnapshotTest-1160753816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.236s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:12 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-e45b5362-6019-4d30-8569-393b068b02ca tempest-CreateVolumesFromSnapshotTest-1160753816 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:35:12 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-e45b5362-6019-4d30-8569-393b068b02ca tempest-CreateVolumesFromSnapshotTest-1160753816 None] Deleted volume successfully. Jul 16 23:35:12 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e45b5362-6019-4d30-8569-393b068b02ca tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "cinder-c43f7d02-8ab8-40ad-98dd-45803281153f-delete_volume" released by "delete_volume" :: held 1.042s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:35:12 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1fc6f44e-e871-464e-9792-a189da96ef8d tempest-CreateVolumesFromSnapshotTest-1160753816 None] Acquiring lock "cinder-6c591715-290c-43ea-831b-cb107b9270df-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:35:12 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1fc6f44e-e871-464e-9792-a189da96ef8d tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "cinder-6c591715-290c-43ea-831b-cb107b9270df-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:35:12 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1fc6f44e-e871-464e-9792-a189da96ef8d tempest-CreateVolumesFromSnapshotTest-1160753816 None] Acquiring lock "cinder-quobyte-6c591715-290c-43ea-831b-cb107b9270df" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:35:12 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1fc6f44e-e871-464e-9792-a189da96ef8d tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "cinder-quobyte-6c591715-290c-43ea-831b-cb107b9270df" acquired by "delete_volume" :: waited 0.014s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:35:12 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[85435c72-163d-42c4-ad31-c3e316d0c30e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:35:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1fc6f44e-e871-464e-9792-a189da96ef8d tempest-CreateVolumesFromSnapshotTest-1160753816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6c591715-290c-43ea-831b-cb107b9270df {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:12 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6c591715-290c-43ea-831b-cb107b9270df Jul 16 23:35:12 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:13 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1fc6f44e-e871-464e-9792-a189da96ef8d tempest-CreateVolumesFromSnapshotTest-1160753816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6c591715-290c-43ea-831b-cb107b9270df" returned: 0 in 0.340s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1fc6f44e-e871-464e-9792-a189da96ef8d tempest-CreateVolumesFromSnapshotTest-1160753816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6c591715-290c-43ea-831b-cb107b9270df {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:13 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6c591715-290c-43ea-831b-cb107b9270df Jul 16 23:35:13 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:13 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1fc6f44e-e871-464e-9792-a189da96ef8d tempest-CreateVolumesFromSnapshotTest-1160753816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6c591715-290c-43ea-831b-cb107b9270df" returned: 0 in 0.235s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:13 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1fc6f44e-e871-464e-9792-a189da96ef8d tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "cinder-quobyte-6c591715-290c-43ea-831b-cb107b9270df" released by "delete_volume" :: held 0.611s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:35:13 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-1fc6f44e-e871-464e-9792-a189da96ef8d tempest-CreateVolumesFromSnapshotTest-1160753816 None] Created reservations ['3eec1992-25fe-47e7-a81a-ef3e6b1026e5', 'dd4691ca-9617-4630-a31a-77f658fd697b', '775a7a20-e7f0-419a-b4fa-0e5d461b0366', '0f65ec94-f4f5-42ec-b3dc-ac5b7a66024f'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:35:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1fc6f44e-e871-464e-9792-a189da96ef8d tempest-CreateVolumesFromSnapshotTest-1160753816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1fc6f44e-e871-464e-9792-a189da96ef8d tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:13 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1fc6f44e-e871-464e-9792-a189da96ef8d tempest-CreateVolumesFromSnapshotTest-1160753816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:35:13 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1fc6f44e-e871-464e-9792-a189da96ef8d tempest-CreateVolumesFromSnapshotTest-1160753816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:35:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1fc6f44e-e871-464e-9792-a189da96ef8d tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1fc6f44e-e871-464e-9792-a189da96ef8d tempest-CreateVolumesFromSnapshotTest-1160753816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:13 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:35:13 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:13 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1fc6f44e-e871-464e-9792-a189da96ef8d tempest-CreateVolumesFromSnapshotTest-1160753816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.241s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:13 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-1fc6f44e-e871-464e-9792-a189da96ef8d tempest-CreateVolumesFromSnapshotTest-1160753816 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:35:13 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-1fc6f44e-e871-464e-9792-a189da96ef8d tempest-CreateVolumesFromSnapshotTest-1160753816 None] Deleted volume successfully. Jul 16 23:35:13 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1fc6f44e-e871-464e-9792-a189da96ef8d tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "cinder-6c591715-290c-43ea-831b-cb107b9270df-delete_volume" released by "delete_volume" :: held 1.037s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:35:13 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f65ee5ab-15ce-490c-af66-36c6ee66fc48 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Acquiring lock "cinder-26a320e2-e456-4bee-b395-7f911883394c-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:35:13 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f65ee5ab-15ce-490c-af66-36c6ee66fc48 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "cinder-26a320e2-e456-4bee-b395-7f911883394c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:35:13 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f65ee5ab-15ce-490c-af66-36c6ee66fc48 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Acquiring lock "cinder-quobyte-26a320e2-e456-4bee-b395-7f911883394c" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:35:13 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f65ee5ab-15ce-490c-af66-36c6ee66fc48 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "cinder-quobyte-26a320e2-e456-4bee-b395-7f911883394c" acquired by "delete_volume" :: waited 0.018s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:35:13 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[672ce052-de5f-49fe-8336-8aa6b867893a]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:35:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f65ee5ab-15ce-490c-af66-36c6ee66fc48 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-26a320e2-e456-4bee-b395-7f911883394c {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:14 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-26a320e2-e456-4bee-b395-7f911883394c Jul 16 23:35:14 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:14 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f65ee5ab-15ce-490c-af66-36c6ee66fc48 tempest-CreateVolumesFromSnapshotTest-1160753816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-26a320e2-e456-4bee-b395-7f911883394c" returned: 0 in 0.361s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f65ee5ab-15ce-490c-af66-36c6ee66fc48 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-26a320e2-e456-4bee-b395-7f911883394c {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:14 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-26a320e2-e456-4bee-b395-7f911883394c Jul 16 23:35:14 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:14 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f65ee5ab-15ce-490c-af66-36c6ee66fc48 tempest-CreateVolumesFromSnapshotTest-1160753816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-26a320e2-e456-4bee-b395-7f911883394c" returned: 0 in 0.248s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:14 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f65ee5ab-15ce-490c-af66-36c6ee66fc48 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "cinder-quobyte-26a320e2-e456-4bee-b395-7f911883394c" released by "delete_volume" :: held 0.652s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:35:14 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-f65ee5ab-15ce-490c-af66-36c6ee66fc48 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Created reservations ['e71a2b5b-7259-4f8a-8de4-7051bd4d90d1', '3d7cc0b1-a1c5-4e17-adce-c7714da03ee9', 'e9a202e9-cf3c-46a8-8e35-9b148bac993e', 'c4c15761-2835-49e9-83d6-3af2bbd07ba8'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:35:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f65ee5ab-15ce-490c-af66-36c6ee66fc48 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f65ee5ab-15ce-490c-af66-36c6ee66fc48 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:14 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f65ee5ab-15ce-490c-af66-36c6ee66fc48 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:35:14 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f65ee5ab-15ce-490c-af66-36c6ee66fc48 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:35:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f65ee5ab-15ce-490c-af66-36c6ee66fc48 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f65ee5ab-15ce-490c-af66-36c6ee66fc48 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:14 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:35:14 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:14 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f65ee5ab-15ce-490c-af66-36c6ee66fc48 tempest-CreateVolumesFromSnapshotTest-1160753816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.252s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:14 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-f65ee5ab-15ce-490c-af66-36c6ee66fc48 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:35:14 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-f65ee5ab-15ce-490c-af66-36c6ee66fc48 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Deleted volume successfully. Jul 16 23:35:14 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f65ee5ab-15ce-490c-af66-36c6ee66fc48 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "cinder-26a320e2-e456-4bee-b395-7f911883394c-delete_volume" released by "delete_volume" :: held 1.115s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:35:15 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-3b4fd6d5-f484-4112-8044-9c1dc2efb0d1 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Acquiring lock "cinder-3f1f73aa-f8ce-441d-9e50-fe9155aa3e0b-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:35:15 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-3b4fd6d5-f484-4112-8044-9c1dc2efb0d1 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "cinder-3f1f73aa-f8ce-441d-9e50-fe9155aa3e0b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:35:15 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-3b4fd6d5-f484-4112-8044-9c1dc2efb0d1 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Acquiring lock "cinder-quobyte-3f1f73aa-f8ce-441d-9e50-fe9155aa3e0b" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:35:15 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-3b4fd6d5-f484-4112-8044-9c1dc2efb0d1 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "cinder-quobyte-3f1f73aa-f8ce-441d-9e50-fe9155aa3e0b" acquired by "delete_volume" :: waited 0.016s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:35:15 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d53409-483b-4807-b0dc-bc7b52bc59a2]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:35:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3b4fd6d5-f484-4112-8044-9c1dc2efb0d1 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3f1f73aa-f8ce-441d-9e50-fe9155aa3e0b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:15 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3f1f73aa-f8ce-441d-9e50-fe9155aa3e0b Jul 16 23:35:15 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:15 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3b4fd6d5-f484-4112-8044-9c1dc2efb0d1 tempest-CreateVolumesFromSnapshotTest-1160753816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3f1f73aa-f8ce-441d-9e50-fe9155aa3e0b" returned: 0 in 0.360s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3b4fd6d5-f484-4112-8044-9c1dc2efb0d1 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3f1f73aa-f8ce-441d-9e50-fe9155aa3e0b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:15 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3f1f73aa-f8ce-441d-9e50-fe9155aa3e0b Jul 16 23:35:15 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:15 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3b4fd6d5-f484-4112-8044-9c1dc2efb0d1 tempest-CreateVolumesFromSnapshotTest-1160753816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3f1f73aa-f8ce-441d-9e50-fe9155aa3e0b" returned: 0 in 0.242s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:15 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-3b4fd6d5-f484-4112-8044-9c1dc2efb0d1 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "cinder-quobyte-3f1f73aa-f8ce-441d-9e50-fe9155aa3e0b" released by "delete_volume" :: held 0.643s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:35:15 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-3b4fd6d5-f484-4112-8044-9c1dc2efb0d1 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Created reservations ['949d0509-6b99-4c0a-8407-0e5f978be696', '313e59a6-d76a-47a2-bdf3-4590607114a8', '551b4fa3-0565-4f10-abdd-de5b104a2a65', '017bec64-6785-4f40-aab0-4567339bc73b'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:35:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3b4fd6d5-f484-4112-8044-9c1dc2efb0d1 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3b4fd6d5-f484-4112-8044-9c1dc2efb0d1 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:15 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3b4fd6d5-f484-4112-8044-9c1dc2efb0d1 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:35:15 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3b4fd6d5-f484-4112-8044-9c1dc2efb0d1 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:35:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3b4fd6d5-f484-4112-8044-9c1dc2efb0d1 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3b4fd6d5-f484-4112-8044-9c1dc2efb0d1 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:15 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:35:15 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:16 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3b4fd6d5-f484-4112-8044-9c1dc2efb0d1 tempest-CreateVolumesFromSnapshotTest-1160753816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.242s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:16 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-3b4fd6d5-f484-4112-8044-9c1dc2efb0d1 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:35:16 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-3b4fd6d5-f484-4112-8044-9c1dc2efb0d1 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Deleted volume successfully. Jul 16 23:35:16 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-3b4fd6d5-f484-4112-8044-9c1dc2efb0d1 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "cinder-3f1f73aa-f8ce-441d-9e50-fe9155aa3e0b-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:35:16 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0906cc31-dab7-4ed1-8837-6d1e93030806 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Acquiring lock "cinder-359704aa-9fc6-4915-8e87-55431b4e1e5b-delete_snapshot" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:35:16 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0906cc31-dab7-4ed1-8837-6d1e93030806 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "cinder-359704aa-9fc6-4915-8e87-55431b4e1e5b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:35:16 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0906cc31-dab7-4ed1-8837-6d1e93030806 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Acquiring lock "cinder-quobyte-b6074a37-d0cb-411c-915f-904eb140ebed" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:35:16 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0906cc31-dab7-4ed1-8837-6d1e93030806 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "cinder-quobyte-b6074a37-d0cb-411c-915f-904eb140ebed" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:35:16 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0906cc31-dab7-4ed1-8837-6d1e93030806 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Acquiring lock "cinder-quobyte-359704aa-9fc6-4915-8e87-55431b4e1e5b" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:35:16 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0906cc31-dab7-4ed1-8837-6d1e93030806 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "cinder-quobyte-359704aa-9fc6-4915-8e87-55431b4e1e5b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:35:16 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-0906cc31-dab7-4ed1-8837-6d1e93030806 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Deleting offline snapshot 359704aa-9fc6-4915-8e87-55431b4e1e5b of volume b6074a37-d0cb-411c-915f-904eb140ebed {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:35:16 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-0906cc31-dab7-4ed1-8837-6d1e93030806 tempest-CreateVolumesFromSnapshotTest-1160753816 None] snapshot_file for this snap is: volume-b6074a37-d0cb-411c-915f-904eb140ebed.359704aa-9fc6-4915-8e87-55431b4e1e5b {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:35:16 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa2c487-0d57-4e04-9b05-1c5c602e0829]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:35:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0906cc31-dab7-4ed1-8837-6d1e93030806 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed.359704aa-9fc6-4915-8e87-55431b4e1e5b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:16 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed.359704aa-9fc6-4915-8e87-55431b4e1e5b Jul 16 23:35:16 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:16 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0906cc31-dab7-4ed1-8837-6d1e93030806 tempest-CreateVolumesFromSnapshotTest-1160753816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed.359704aa-9fc6-4915-8e87-55431b4e1e5b" returned: 0 in 0.345s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:16 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-0906cc31-dab7-4ed1-8837-6d1e93030806 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6074a37-d0cb-411c-915f-904eb140ebed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:35:16 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d16e7b2-fcb1-44b0-9f6a-fec26f04abb1]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:35:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0906cc31-dab7-4ed1-8837-6d1e93030806 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:16 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed Jul 16 23:35:16 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:16 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:17 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0906cc31-dab7-4ed1-8837-6d1e93030806 tempest-CreateVolumesFromSnapshotTest-1160753816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed" returned: 0 in 0.366s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:17 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0906cc31-dab7-4ed1-8837-6d1e93030806 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed.359704aa-9fc6-4915-8e87-55431b4e1e5b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:17 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed.359704aa-9fc6-4915-8e87-55431b4e1e5b Jul 16 23:35:17 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:17 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:17 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0906cc31-dab7-4ed1-8837-6d1e93030806 tempest-CreateVolumesFromSnapshotTest-1160753816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed.359704aa-9fc6-4915-8e87-55431b4e1e5b" returned: 0 in 0.320s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:17 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0906cc31-dab7-4ed1-8837-6d1e93030806 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed.359704aa-9fc6-4915-8e87-55431b4e1e5b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:17 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed.359704aa-9fc6-4915-8e87-55431b4e1e5b Jul 16 23:35:17 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:17 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:17 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0906cc31-dab7-4ed1-8837-6d1e93030806 tempest-CreateVolumesFromSnapshotTest-1160753816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed.359704aa-9fc6-4915-8e87-55431b4e1e5b" returned: 0 in 0.248s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:17 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0906cc31-dab7-4ed1-8837-6d1e93030806 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "cinder-quobyte-359704aa-9fc6-4915-8e87-55431b4e1e5b" released by "_delete_snapshot" :: held 1.376s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:35:17 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0906cc31-dab7-4ed1-8837-6d1e93030806 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "cinder-quobyte-b6074a37-d0cb-411c-915f-904eb140ebed" released by "delete_snapshot" :: held 1.398s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:35:17 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-0906cc31-dab7-4ed1-8837-6d1e93030806 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Created reservations ['bd58de47-3c9b-4aeb-b763-42b96c421333', '599afefd-e118-4ce0-b71d-de68ca3d0189', '51967b57-bc3e-4791-a393-94b3f3df8d7e', 'a69568f1-59a5-4a5d-b7f9-54d77f460fa2'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:35:17 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-0906cc31-dab7-4ed1-8837-6d1e93030806 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Delete snapshot completed successfully. Jul 16 23:35:17 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0906cc31-dab7-4ed1-8837-6d1e93030806 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "cinder-359704aa-9fc6-4915-8e87-55431b4e1e5b-delete_snapshot" released by "delete_snapshot" :: held 1.522s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:35:18 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-04bd66db-16f6-487d-876c-bdb338a041d8 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Acquiring lock "cinder-b6074a37-d0cb-411c-915f-904eb140ebed-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:35:18 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-04bd66db-16f6-487d-876c-bdb338a041d8 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "cinder-b6074a37-d0cb-411c-915f-904eb140ebed-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:35:18 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-04bd66db-16f6-487d-876c-bdb338a041d8 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Acquiring lock "cinder-quobyte-b6074a37-d0cb-411c-915f-904eb140ebed" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:35:18 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-04bd66db-16f6-487d-876c-bdb338a041d8 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "cinder-quobyte-b6074a37-d0cb-411c-915f-904eb140ebed" acquired by "delete_volume" :: waited 0.017s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:35:18 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[b672c30c-78c0-4ee2-b684-aa943689384e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:35:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-04bd66db-16f6-487d-876c-bdb338a041d8 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:18 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed Jul 16 23:35:18 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:18 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-04bd66db-16f6-487d-876c-bdb338a041d8 tempest-CreateVolumesFromSnapshotTest-1160753816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed" returned: 0 in 0.368s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-04bd66db-16f6-487d-876c-bdb338a041d8 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:18 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed Jul 16 23:35:18 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:19 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-04bd66db-16f6-487d-876c-bdb338a041d8 tempest-CreateVolumesFromSnapshotTest-1160753816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-b6074a37-d0cb-411c-915f-904eb140ebed" returned: 0 in 0.259s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:19 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-04bd66db-16f6-487d-876c-bdb338a041d8 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "cinder-quobyte-b6074a37-d0cb-411c-915f-904eb140ebed" released by "delete_volume" :: held 0.685s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:35:19 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-04bd66db-16f6-487d-876c-bdb338a041d8 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Created reservations ['8c25711b-4471-4963-bf0c-aabccf1236ee', 'af827688-f463-464b-b5f0-1da0fa0b9bd0', '961f765e-a250-488c-8834-558d90f2ff95', 'a61bf4b0-e2f8-4315-8d30-52a6858a5af5'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:35:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-04bd66db-16f6-487d-876c-bdb338a041d8 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-04bd66db-16f6-487d-876c-bdb338a041d8 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:19 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-04bd66db-16f6-487d-876c-bdb338a041d8 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:35:19 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-04bd66db-16f6-487d-876c-bdb338a041d8 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:35:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-04bd66db-16f6-487d-876c-bdb338a041d8 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-04bd66db-16f6-487d-876c-bdb338a041d8 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:19 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:35:19 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:19 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-04bd66db-16f6-487d-876c-bdb338a041d8 tempest-CreateVolumesFromSnapshotTest-1160753816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.240s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:19 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-04bd66db-16f6-487d-876c-bdb338a041d8 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:35:19 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-04bd66db-16f6-487d-876c-bdb338a041d8 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Deleted volume successfully. Jul 16 23:35:19 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-04bd66db-16f6-487d-876c-bdb338a041d8 tempest-CreateVolumesFromSnapshotTest-1160753816 None] Lock "cinder-b6074a37-d0cb-411c-915f-904eb140ebed-delete_volume" released by "delete_volume" :: held 1.135s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:35:29 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:SELECT=55,cinder:UPDATE=70,cinder:INSERT=16,cinder:DELETE=5 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:35:29 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:SELECT=63,cinder:UPDATE=91,cinder:INSERT=20,cinder:DELETE=8 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:35:35 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-c221c5d5-96f7-4e09-9df2-dd79c74be41b tempest-CreateVolumesFromSnapshotTest-1783062093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:35:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c221c5d5-96f7-4e09-9df2-dd79c74be41b tempest-CreateVolumesFromSnapshotTest-1783062093 None] Flow 'volume_create_manager' (aa6ec353-e76a-4b47-aa3d-61eb83fded0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:35:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c221c5d5-96f7-4e09-9df2-dd79c74be41b tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78f1cb55-aea7-449e-9206-c98f347aa3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c221c5d5-96f7-4e09-9df2-dd79c74be41b tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78f1cb55-aea7-449e-9206-c98f347aa3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1631399089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=533de4c3-1c21-4eb0-8575-28f23aaf766d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1161d2533b2844408eeb0416ec6ccfef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:35:35Z,use_quota=True,user_id='a8bc8d7bfda14700aef42f15a4ed5ac6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c221c5d5-96f7-4e09-9df2-dd79c74be41b tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01a665ae-c62d-497c-a198-2facef5818a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c221c5d5-96f7-4e09-9df2-dd79c74be41b tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01a665ae-c62d-497c-a198-2facef5818a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c221c5d5-96f7-4e09-9df2-dd79c74be41b tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9dd1d3b-8014-40aa-b519-ee7dd2aab4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c221c5d5-96f7-4e09-9df2-dd79c74be41b tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9dd1d3b-8014-40aa-b519-ee7dd2aab4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '533de4c3-1c21-4eb0-8575-28f23aaf766d', 'volume_name': 'volume-533de4c3-1c21-4eb0-8575-28f23aaf766d', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c221c5d5-96f7-4e09-9df2-dd79c74be41b tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11559018-64df-4441-bbcd-276235b54736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c221c5d5-96f7-4e09-9df2-dd79c74be41b tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11559018-64df-4441-bbcd-276235b54736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c221c5d5-96f7-4e09-9df2-dd79c74be41b tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf7fe373-769a-4f2d-a296-59ff9a4750ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:35 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-c221c5d5-96f7-4e09-9df2-dd79c74be41b tempest-CreateVolumesFromSnapshotTest-1783062093 None] Volume 533de4c3-1c21-4eb0-8575-28f23aaf766d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-533de4c3-1c21-4eb0-8575-28f23aaf766d', 'volume_size': 1} Jul 16 23:35:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c221c5d5-96f7-4e09-9df2-dd79c74be41b tempest-CreateVolumesFromSnapshotTest-1783062093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c221c5d5-96f7-4e09-9df2-dd79c74be41b tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:35 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-c221c5d5-96f7-4e09-9df2-dd79c74be41b tempest-CreateVolumesFromSnapshotTest-1783062093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1631399089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=533de4c3-1c21-4eb0-8575-28f23aaf766d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1161d2533b2844408eeb0416ec6ccfef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:35:35Z,use_quota=True,user_id='a8bc8d7bfda14700aef42f15a4ed5ac6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:35:35 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-c221c5d5-96f7-4e09-9df2-dd79c74be41b tempest-CreateVolumesFromSnapshotTest-1783062093 None] Creating volume 533de4c3-1c21-4eb0-8575-28f23aaf766d {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:35:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c221c5d5-96f7-4e09-9df2-dd79c74be41b tempest-CreateVolumesFromSnapshotTest-1783062093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c221c5d5-96f7-4e09-9df2-dd79c74be41b tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:35 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-c221c5d5-96f7-4e09-9df2-dd79c74be41b tempest-CreateVolumesFromSnapshotTest-1783062093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:35:35 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-c221c5d5-96f7-4e09-9df2-dd79c74be41b tempest-CreateVolumesFromSnapshotTest-1783062093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:35:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c221c5d5-96f7-4e09-9df2-dd79c74be41b tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:35 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-c221c5d5-96f7-4e09-9df2-dd79c74be41b tempest-CreateVolumesFromSnapshotTest-1783062093 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:35:35 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-c221c5d5-96f7-4e09-9df2-dd79c74be41b tempest-CreateVolumesFromSnapshotTest-1783062093 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:35:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c221c5d5-96f7-4e09-9df2-dd79c74be41b tempest-CreateVolumesFromSnapshotTest-1783062093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:35 devstack sudo[106005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d 1073741824 Jul 16 23:35:35 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:35 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b59c3e4-53dd-4d25-ae12-7fd5c817436a tempest-VolumeDependencyTests-490071870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:35:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1b59c3e4-53dd-4d25-ae12-7fd5c817436a tempest-VolumeDependencyTests-490071870 None] Flow 'volume_create_manager' (ca88eddc-8fb9-48d1-a042-f55cfc42cf72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:35:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1b59c3e4-53dd-4d25-ae12-7fd5c817436a tempest-VolumeDependencyTests-490071870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c638335-ddb5-4252-87ee-fde97177d883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1b59c3e4-53dd-4d25-ae12-7fd5c817436a tempest-VolumeDependencyTests-490071870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c638335-ddb5-4252-87ee-fde97177d883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1771710627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce1cd0f9-0783-4251-9641-78a312cd2079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='438fbd72d24d4282822e03c178ce7f58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:35:36Z,use_quota=True,user_id='a2f0fbceaf4c4673beb2e7f61a4456d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1b59c3e4-53dd-4d25-ae12-7fd5c817436a tempest-VolumeDependencyTests-490071870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c40173f-0018-4a8c-826a-56a9cdc2226a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1b59c3e4-53dd-4d25-ae12-7fd5c817436a tempest-VolumeDependencyTests-490071870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c40173f-0018-4a8c-826a-56a9cdc2226a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1b59c3e4-53dd-4d25-ae12-7fd5c817436a tempest-VolumeDependencyTests-490071870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6434333-50ed-486a-9b98-55a7f7bb0fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1b59c3e4-53dd-4d25-ae12-7fd5c817436a tempest-VolumeDependencyTests-490071870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6434333-50ed-486a-9b98-55a7f7bb0fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce1cd0f9-0783-4251-9641-78a312cd2079', 'volume_name': 'volume-ce1cd0f9-0783-4251-9641-78a312cd2079', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1b59c3e4-53dd-4d25-ae12-7fd5c817436a tempest-VolumeDependencyTests-490071870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbfd1b1d-e168-4060-a573-92887b99175a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1b59c3e4-53dd-4d25-ae12-7fd5c817436a tempest-VolumeDependencyTests-490071870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbfd1b1d-e168-4060-a573-92887b99175a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:35 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1b59c3e4-53dd-4d25-ae12-7fd5c817436a tempest-VolumeDependencyTests-490071870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68cf2ad0-67aa-4a17-818c-4e147b827dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:35 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-1b59c3e4-53dd-4d25-ae12-7fd5c817436a tempest-VolumeDependencyTests-490071870 None] Volume ce1cd0f9-0783-4251-9641-78a312cd2079: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce1cd0f9-0783-4251-9641-78a312cd2079', 'volume_size': 1} Jul 16 23:35:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1b59c3e4-53dd-4d25-ae12-7fd5c817436a tempest-VolumeDependencyTests-490071870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:36 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c221c5d5-96f7-4e09-9df2-dd79c74be41b tempest-CreateVolumesFromSnapshotTest-1783062093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d 1073741824" returned: 0 in 0.570s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c221c5d5-96f7-4e09-9df2-dd79c74be41b tempest-CreateVolumesFromSnapshotTest-1783062093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:36 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d Jul 16 23:35:36 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:36 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c221c5d5-96f7-4e09-9df2-dd79c74be41b tempest-CreateVolumesFromSnapshotTest-1783062093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d" returned: 0 in 0.288s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:36 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-c221c5d5-96f7-4e09-9df2-dd79c74be41b tempest-CreateVolumesFromSnapshotTest-1783062093 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:35:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c221c5d5-96f7-4e09-9df2-dd79c74be41b tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1b59c3e4-53dd-4d25-ae12-7fd5c817436a tempest-VolumeDependencyTests-490071870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.673s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:36 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1b59c3e4-53dd-4d25-ae12-7fd5c817436a tempest-VolumeDependencyTests-490071870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1771710627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce1cd0f9-0783-4251-9641-78a312cd2079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='438fbd72d24d4282822e03c178ce7f58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:35:36Z,use_quota=True,user_id='a2f0fbceaf4c4673beb2e7f61a4456d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:35:36 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-1b59c3e4-53dd-4d25-ae12-7fd5c817436a tempest-VolumeDependencyTests-490071870 None] Creating volume ce1cd0f9-0783-4251-9641-78a312cd2079 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:35:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1b59c3e4-53dd-4d25-ae12-7fd5c817436a tempest-VolumeDependencyTests-490071870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1b59c3e4-53dd-4d25-ae12-7fd5c817436a tempest-VolumeDependencyTests-490071870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:36 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1b59c3e4-53dd-4d25-ae12-7fd5c817436a tempest-VolumeDependencyTests-490071870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:35:36 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1b59c3e4-53dd-4d25-ae12-7fd5c817436a tempest-VolumeDependencyTests-490071870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:35:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1b59c3e4-53dd-4d25-ae12-7fd5c817436a tempest-VolumeDependencyTests-490071870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:36 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1b59c3e4-53dd-4d25-ae12-7fd5c817436a tempest-VolumeDependencyTests-490071870 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:35:36 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-1b59c3e4-53dd-4d25-ae12-7fd5c817436a tempest-VolumeDependencyTests-490071870 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:35:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1b59c3e4-53dd-4d25-ae12-7fd5c817436a tempest-VolumeDependencyTests-490071870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:36 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c221c5d5-96f7-4e09-9df2-dd79c74be41b tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf7fe373-769a-4f2d-a296-59ff9a4750ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-533de4c3-1c21-4eb0-8575-28f23aaf766d', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:36 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079 1073741824 Jul 16 23:35:36 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c221c5d5-96f7-4e09-9df2-dd79c74be41b tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0e2bc62-d71a-400d-9420-4327af2d22c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:36 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:36 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-c221c5d5-96f7-4e09-9df2-dd79c74be41b tempest-CreateVolumesFromSnapshotTest-1783062093 None] Volume volume-533de4c3-1c21-4eb0-8575-28f23aaf766d (533de4c3-1c21-4eb0-8575-28f23aaf766d): created successfully Jul 16 23:35:36 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c221c5d5-96f7-4e09-9df2-dd79c74be41b tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0e2bc62-d71a-400d-9420-4327af2d22c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:36 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c221c5d5-96f7-4e09-9df2-dd79c74be41b tempest-CreateVolumesFromSnapshotTest-1783062093 None] Flow 'volume_create_manager' (aa6ec353-e76a-4b47-aa3d-61eb83fded0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:35:36 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-c221c5d5-96f7-4e09-9df2-dd79c74be41b tempest-CreateVolumesFromSnapshotTest-1783062093 None] Created volume successfully. Jul 16 23:35:37 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1b59c3e4-53dd-4d25-ae12-7fd5c817436a tempest-VolumeDependencyTests-490071870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079 1073741824" returned: 0 in 0.590s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1b59c3e4-53dd-4d25-ae12-7fd5c817436a tempest-VolumeDependencyTests-490071870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:37 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079 Jul 16 23:35:37 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:37 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1b59c3e4-53dd-4d25-ae12-7fd5c817436a tempest-VolumeDependencyTests-490071870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079" returned: 0 in 0.292s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:37 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1b59c3e4-53dd-4d25-ae12-7fd5c817436a tempest-VolumeDependencyTests-490071870 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:35:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1b59c3e4-53dd-4d25-ae12-7fd5c817436a tempest-VolumeDependencyTests-490071870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:37 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1b59c3e4-53dd-4d25-ae12-7fd5c817436a tempest-VolumeDependencyTests-490071870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68cf2ad0-67aa-4a17-818c-4e147b827dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce1cd0f9-0783-4251-9641-78a312cd2079', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:37 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1b59c3e4-53dd-4d25-ae12-7fd5c817436a tempest-VolumeDependencyTests-490071870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23e02d1d-8561-44c1-9b26-8b6d3fd98efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:37 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-1b59c3e4-53dd-4d25-ae12-7fd5c817436a tempest-VolumeDependencyTests-490071870 None] Volume volume-ce1cd0f9-0783-4251-9641-78a312cd2079 (ce1cd0f9-0783-4251-9641-78a312cd2079): created successfully Jul 16 23:35:37 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1b59c3e4-53dd-4d25-ae12-7fd5c817436a tempest-VolumeDependencyTests-490071870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23e02d1d-8561-44c1-9b26-8b6d3fd98efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:37 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-1b59c3e4-53dd-4d25-ae12-7fd5c817436a tempest-VolumeDependencyTests-490071870 None] Flow 'volume_create_manager' (ca88eddc-8fb9-48d1-a042-f55cfc42cf72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:35:37 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-1b59c3e4-53dd-4d25-ae12-7fd5c817436a tempest-VolumeDependencyTests-490071870 None] Created volume successfully. Jul 16 23:35:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a2e5167a-06a4-47c1-b835-dd6603c14c1f tempest-CreateVolumesFromSnapshotTest-1783062093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a2e5167a-06a4-47c1-b835-dd6603c14c1f tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:37 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-a2e5167a-06a4-47c1-b835-dd6603c14c1f tempest-CreateVolumesFromSnapshotTest-1783062093 None] Creating offline snapshot 3ccb9c91-2657-4e01-9178-4bbe09d5fd05 of volume 533de4c3-1c21-4eb0-8575-28f23aaf766d {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:35:38 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8bab3b-1934-4568-ae86-b78cce0bacf9]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:35:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a2e5167a-06a4-47c1-b835-dd6603c14c1f tempest-CreateVolumesFromSnapshotTest-1783062093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:38 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d Jul 16 23:35:38 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-31971dcc-6524-4124-9ab7-d7d1d8be19d2 tempest-VolumeDependencyTests-490071870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:38 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a2e5167a-06a4-47c1-b835-dd6603c14c1f tempest-CreateVolumesFromSnapshotTest-1783062093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d" returned: 0 in 0.514s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a2e5167a-06a4-47c1-b835-dd6603c14c1f tempest-CreateVolumesFromSnapshotTest-1783062093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d.3ccb9c91-2657-4e01-9178-4bbe09d5fd05 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:38 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d.3ccb9c91-2657-4e01-9178-4bbe09d5fd05 1G Jul 16 23:35:38 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:38 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:35:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Flow 'volume_create_manager' (4cd6161c-3ff9-4c39-8a54-46168cf789df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:35:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f33d1c13-c6d4-4eb2-8d46-9d47a9872e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f33d1c13-c6d4-4eb2-8d46-9d47a9872e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a44dbcfa-f7de-4e4d-9336-ade4b656f83c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c539cbbc093438c8a9fb5a0d97d1640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:35:39Z,use_quota=True,user_id='69ea110f49ca488aa79d6f6c4c1bb48a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0f46d98-ff49-487b-82b4-71e17bac8b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0f46d98-ff49-487b-82b4-71e17bac8b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f412d7b-5c68-4ffa-9863-94759f921ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:38 devstack cinder-volume[87607]: DEBUG cinder.image.glance [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Creating Keystone auth plugin from conf {{(pid=87607) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 16 23:35:39 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a2e5167a-06a4-47c1-b835-dd6603c14c1f tempest-CreateVolumesFromSnapshotTest-1783062093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d.3ccb9c91-2657-4e01-9178-4bbe09d5fd05 1G" returned: 0 in 0.514s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a2e5167a-06a4-47c1-b835-dd6603c14c1f tempest-CreateVolumesFromSnapshotTest-1783062093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-533de4c3-1c21-4eb0-8575-28f23aaf766d -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d.3ccb9c91-2657-4e01-9178-4bbe09d5fd05 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:39 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-533de4c3-1c21-4eb0-8575-28f23aaf766d -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d.3ccb9c91-2657-4e01-9178-4bbe09d5fd05 Jul 16 23:35:39 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f412d7b-5c68-4ffa-9863-94759f921ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a44dbcfa-f7de-4e4d-9336-ade4b656f83c', 'volume_name': 'volume-a44dbcfa-f7de-4e4d-9336-ade4b656f83c', 'volume_size': 1, 'image_id': '8117e3cc-4744-40f7-9bf8-bf4c0256cc0b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8117e3cc-4744-40f7-9bf8-bf4c0256cc0b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f602cc86b5c9a9283fc242d4dc4e6443', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2c539cbbc093438c8a9fb5a0d97d1640', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c641f4e076984a54126fab68dd735e17b747dc4274fe8ce2e9d9edf40906e7457811163b2e2824736a25ab52ac5d818c951e6efdde5b8dddd559cb32d08beeac', 'id': '8117e3cc-4744-40f7-9bf8-bf4c0256cc0b', 'created_at': datetime.datetime(2026, 7, 16, 21, 35, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 21, 35, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8117e3cc-4744-40f7-9bf8-bf4c0256cc0b/file', 'properties': {}}, 'image_service': }' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55e09c28-0e8a-497f-9362-288a872ff7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55e09c28-0e8a-497f-9362-288a872ff7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f88c261f-092e-4496-9572-edca64ffb9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:39 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Volume a44dbcfa-f7de-4e4d-9336-ade4b656f83c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a44dbcfa-f7de-4e4d-9336-ade4b656f83c', 'volume_size': 1, 'image_id': '8117e3cc-4744-40f7-9bf8-bf4c0256cc0b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8117e3cc-4744-40f7-9bf8-bf4c0256cc0b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f602cc86b5c9a9283fc242d4dc4e6443', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2c539cbbc093438c8a9fb5a0d97d1640', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c641f4e076984a54126fab68dd735e17b747dc4274fe8ce2e9d9edf40906e7457811163b2e2824736a25ab52ac5d818c951e6efdde5b8dddd559cb32d08beeac', 'id': '8117e3cc-4744-40f7-9bf8-bf4c0256cc0b', 'created_at': datetime.datetime(2026, 7, 16, 21, 35, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 21, 35, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8117e3cc-4744-40f7-9bf8-bf4c0256cc0b/file', 'properties': {}}, 'image_service': } Jul 16 23:35:39 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Trying to clone a44dbcfa-f7de-4e4d-9336-ade4b656f83c from image 8117e3cc-4744-40f7-9bf8-bf4c0256cc0b at location (None, [{'url': 'file:///opt/stack/data/glance/images/8117e3cc-4744-40f7-9bf8-bf4c0256cc0b', 'metadata': {}}]). {{(pid=87607) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 16 23:35:39 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a2e5167a-06a4-47c1-b835-dd6603c14c1f tempest-CreateVolumesFromSnapshotTest-1783062093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-533de4c3-1c21-4eb0-8575-28f23aaf766d -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d.3ccb9c91-2657-4e01-9178-4bbe09d5fd05" returned: 0 in 0.321s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:39 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-a2e5167a-06a4-47c1-b835-dd6603c14c1f tempest-CreateVolumesFromSnapshotTest-1783062093 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d.3ccb9c91-2657-4e01-9178-4bbe09d5fd05 is being set with open permissions: ugo+rw Jul 16 23:35:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a2e5167a-06a4-47c1-b835-dd6603c14c1f tempest-CreateVolumesFromSnapshotTest-1783062093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d.3ccb9c91-2657-4e01-9178-4bbe09d5fd05 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:39 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d.3ccb9c91-2657-4e01-9178-4bbe09d5fd05 Jul 16 23:35:39 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:39 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8117e3cc-4744-40f7-9bf8-bf4c0256cc0b_mic7ki_3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87607) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 16 23:35:39 devstack cinder-volume[87607]: INFO cinder.image.image_utils [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Image download 0.00 MB at 0.00 MB/s Jul 16 23:35:39 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6648e6f-e0d4-4ab0-8de5-9eadc4bc5d02]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:35:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8117e3cc-4744-40f7-9bf8-bf4c0256cc0b_mic7ki_3devstack@QuobyteHD {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:39 devstack cinder-volume[87607]: DEBUG oslo_service.periodic_task [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:35:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:35:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:35:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:39 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:35:39 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:39 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8117e3cc-4744-40f7-9bf8-bf4c0256cc0b_mic7ki_3devstack@QuobyteHD Jul 16 23:35:39 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:39 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a2e5167a-06a4-47c1-b835-dd6603c14c1f tempest-CreateVolumesFromSnapshotTest-1783062093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d.3ccb9c91-2657-4e01-9178-4bbe09d5fd05" returned: 0 in 0.270s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a2e5167a-06a4-47c1-b835-dd6603c14c1f tempest-CreateVolumesFromSnapshotTest-1783062093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:39 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d.info Jul 16 23:35:39 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:39 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.309s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:39 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:35:39 devstack cinder-volume[87607]: DEBUG oslo_service.periodic_task [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running periodic task VolumeManager._thread_info {{(pid=87607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:35:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] thread count: 28 {{(pid=87607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 23:35:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] thread info: [<_MainThread(MainThread, started 139090403627136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 23:35:39 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8117e3cc-4744-40f7-9bf8-bf4c0256cc0b_mic7ki_3devstack@QuobyteHD" returned: 0 in 0.402s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8117e3cc-4744-40f7-9bf8-bf4c0256cc0b_mic7ki_3devstack@QuobyteHD {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:39 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a2e5167a-06a4-47c1-b835-dd6603c14c1f tempest-CreateVolumesFromSnapshotTest-1783062093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d.info" returned: 0 in 0.324s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:39 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-a2e5167a-06a4-47c1-b835-dd6603c14c1f tempest-CreateVolumesFromSnapshotTest-1783062093 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d.info is being set with open permissions: ugo+rw Jul 16 23:35:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a2e5167a-06a4-47c1-b835-dd6603c14c1f tempest-CreateVolumesFromSnapshotTest-1783062093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:40 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8117e3cc-4744-40f7-9bf8-bf4c0256cc0b_mic7ki_3devstack@QuobyteHD Jul 16 23:35:40 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:40 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d.info Jul 16 23:35:40 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:40 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:40 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8117e3cc-4744-40f7-9bf8-bf4c0256cc0b_mic7ki_3devstack@QuobyteHD" returned: 1 in 0.424s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8117e3cc-4744-40f7-9bf8-bf4c0256cc0b_mic7ki_3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 23:35:40 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Temporary image 8117e3cc-4744-40f7-9bf8-bf4c0256cc0b is fetched for user 69ea110f49ca488aa79d6f6c4c1bb48a. {{(pid=87607) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 16 23:35:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a2e5167a-06a4-47c1-b835-dd6603c14c1f tempest-CreateVolumesFromSnapshotTest-1783062093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d.info" returned: 0 in 0.291s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a2e5167a-06a4-47c1-b835-dd6603c14c1f tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.354s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-31971dcc-6524-4124-9ab7-d7d1d8be19d2 tempest-VolumeDependencyTests-490071870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.988s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:40 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:35:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Flow 'volume_create_manager' (33f10f05-082b-4087-b9a5-38743a2cecb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:35:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01cd6311-a2ba-455d-8dd2-6a93a2c86c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:40 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-31971dcc-6524-4124-9ab7-d7d1d8be19d2 tempest-VolumeDependencyTests-490071870 None] Creating offline snapshot ade476f3-8b9d-423a-8793-680f22ae83e8 of volume ce1cd0f9-0783-4251-9641-78a312cd2079 {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:35:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01cd6311-a2ba-455d-8dd2-6a93a2c86c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:35:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c4f4653-b0ef-4909-9395-9252cf78383f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5003458c2014856a0f13542b0c0e216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:35:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:35:40Z,use_quota=True,user_id='2ba678881c474bc98623ff764a3b4a10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8848f66e-b146-42d6-a9f3-2fc687aaceef),volume_type_id=8848f66e-b146-42d6-a9f3-2fc687aaceef)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b78c88d-b626-4138-83d0-32760e686cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b78c88d-b626-4138-83d0-32760e686cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b6b93af-2de8-4fd9-9223-66e31aa68232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:40 devstack cinder-volume[87607]: DEBUG cinder.image.glance [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Creating Keystone auth plugin from conf {{(pid=87607) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 16 23:35:40 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e76685-19a0-45d6-837a-ad2db3f6d6e3]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:35:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-31971dcc-6524-4124-9ab7-d7d1d8be19d2 tempest-VolumeDependencyTests-490071870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:40 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-a2e5167a-06a4-47c1-b835-dd6603c14c1f tempest-CreateVolumesFromSnapshotTest-1783062093 None] Create snapshot completed successfully Jul 16 23:35:40 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[25496097-b30d-4435-b439-05913d06de42]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:35:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8117e3cc-4744-40f7-9bf8-bf4c0256cc0b_mic7ki_3devstack@QuobyteHD {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:40 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079 Jul 16 23:35:40 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:40 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8117e3cc-4744-40f7-9bf8-bf4c0256cc0b_mic7ki_3devstack@QuobyteHD Jul 16 23:35:40 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b6b93af-2de8-4fd9-9223-66e31aa68232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9c4f4653-b0ef-4909-9395-9252cf78383f', 'volume_name': 'volume-9c4f4653-b0ef-4909-9395-9252cf78383f', 'volume_size': 1, 'image_id': 'a40cecb7-3df7-41e8-b02a-02f996da4ee2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a40cecb7-3df7-41e8-b02a-02f996da4ee2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '19901a209367df03bb9ec0d73d325c0c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c5003458c2014856a0f13542b0c0e216', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd22f09f477202543c2e137a88c7e4a10f08f81ed1c36d306b8fee51c1c815274a8dfd21b955af357238edbdb6320dc4815b262b0f810d1bc739c5b2698db3064', 'id': 'a40cecb7-3df7-41e8-b02a-02f996da4ee2', 'created_at': datetime.datetime(2026, 7, 16, 21, 35, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 21, 35, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a40cecb7-3df7-41e8-b02a-02f996da4ee2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61fd3b61-0d77-4947-9c81-69d93fdaf664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61fd3b61-0d77-4947-9c81-69d93fdaf664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a73938e-c7e2-46af-95cb-868568d9af82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:40 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Volume 9c4f4653-b0ef-4909-9395-9252cf78383f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9c4f4653-b0ef-4909-9395-9252cf78383f', 'volume_size': 1, 'image_id': 'a40cecb7-3df7-41e8-b02a-02f996da4ee2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a40cecb7-3df7-41e8-b02a-02f996da4ee2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '19901a209367df03bb9ec0d73d325c0c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c5003458c2014856a0f13542b0c0e216', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd22f09f477202543c2e137a88c7e4a10f08f81ed1c36d306b8fee51c1c815274a8dfd21b955af357238edbdb6320dc4815b262b0f810d1bc739c5b2698db3064', 'id': 'a40cecb7-3df7-41e8-b02a-02f996da4ee2', 'created_at': datetime.datetime(2026, 7, 16, 21, 35, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 21, 35, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a40cecb7-3df7-41e8-b02a-02f996da4ee2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 16 23:35:40 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Trying to clone 9c4f4653-b0ef-4909-9395-9252cf78383f from image a40cecb7-3df7-41e8-b02a-02f996da4ee2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a40cecb7-3df7-41e8-b02a-02f996da4ee2', 'metadata': {}}]). {{(pid=87607) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 16 23:35:40 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a40cecb7-3df7-41e8-b02a-02f996da4ee2_j5cr9jdydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87607) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 16 23:35:40 devstack cinder-volume[87607]: INFO cinder.image.image_utils [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Image download 0.00 MB at 0.00 MB/s Jul 16 23:35:40 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[811480bc-5133-4e48-a195-0684daaae1fe]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:35:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a40cecb7-3df7-41e8-b02a-02f996da4ee2_j5cr9jdydevstack@QuobyteHD {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:40 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8117e3cc-4744-40f7-9bf8-bf4c0256cc0b_mic7ki_3devstack@QuobyteHD" returned: 0 in 0.371s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:40 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8117e3cc-4744-40f7-9bf8-bf4c0256cc0b_mic7ki_3devstack@QuobyteHD {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-31971dcc-6524-4124-9ab7-d7d1d8be19d2 tempest-VolumeDependencyTests-490071870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079" returned: 0 in 0.425s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-31971dcc-6524-4124-9ab7-d7d1d8be19d2 tempest-VolumeDependencyTests-490071870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079.ade476f3-8b9d-423a-8793-680f22ae83e8 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:40 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079.ade476f3-8b9d-423a-8793-680f22ae83e8 1G Jul 16 23:35:40 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:40 devstack sudo[106070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a40cecb7-3df7-41e8-b02a-02f996da4ee2_j5cr9jdydevstack@QuobyteHD Jul 16 23:35:40 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:40 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8117e3cc-4744-40f7-9bf8-bf4c0256cc0b_mic7ki_3devstack@QuobyteHD Jul 16 23:35:40 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:41 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a40cecb7-3df7-41e8-b02a-02f996da4ee2_j5cr9jdydevstack@QuobyteHD" returned: 0 in 0.391s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a40cecb7-3df7-41e8-b02a-02f996da4ee2_j5cr9jdydevstack@QuobyteHD {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:41 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8117e3cc-4744-40f7-9bf8-bf4c0256cc0b_mic7ki_3devstack@QuobyteHD" returned: 1 in 0.412s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8117e3cc-4744-40f7-9bf8-bf4c0256cc0b_mic7ki_3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 23:35:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:41 devstack sudo[106118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a40cecb7-3df7-41e8-b02a-02f996da4ee2_j5cr9jdydevstack@QuobyteHD Jul 16 23:35:41 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:41 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-31971dcc-6524-4124-9ab7-d7d1d8be19d2 tempest-VolumeDependencyTests-490071870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079.ade476f3-8b9d-423a-8793-680f22ae83e8 1G" returned: 0 in 0.565s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-31971dcc-6524-4124-9ab7-d7d1d8be19d2 tempest-VolumeDependencyTests-490071870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce1cd0f9-0783-4251-9641-78a312cd2079 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079.ade476f3-8b9d-423a-8793-680f22ae83e8 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:41 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce1cd0f9-0783-4251-9641-78a312cd2079 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079.ade476f3-8b9d-423a-8793-680f22ae83e8 Jul 16 23:35:41 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:41 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a40cecb7-3df7-41e8-b02a-02f996da4ee2_j5cr9jdydevstack@QuobyteHD" returned: 1 in 0.382s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a40cecb7-3df7-41e8-b02a-02f996da4ee2_j5cr9jdydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 23:35:41 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Temporary image a40cecb7-3df7-41e8-b02a-02f996da4ee2 is fetched for user 2ba678881c474bc98623ff764a3b4a10. {{(pid=87607) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 16 23:35:41 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca036525-7823-4e0f-ab0f-f6f717fffe00]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:35:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a40cecb7-3df7-41e8-b02a-02f996da4ee2_j5cr9jdydevstack@QuobyteHD {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:41 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-204f084e-1140-4e3e-8fc5-52eaac22ef55 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:35:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-204f084e-1140-4e3e-8fc5-52eaac22ef55 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Flow 'volume_create_manager' (a51da0a7-022b-44d9-bcda-0551c6c638b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:35:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-204f084e-1140-4e3e-8fc5-52eaac22ef55 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c8aed77-69db-4bf3-a80a-9693777eb2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:41 devstack sudo[106127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a40cecb7-3df7-41e8-b02a-02f996da4ee2_j5cr9jdydevstack@QuobyteHD Jul 16 23:35:41 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:41 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-204f084e-1140-4e3e-8fc5-52eaac22ef55 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c8aed77-69db-4bf3-a80a-9693777eb2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1481309631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8914b56a-e0c5-45d3-8add-abea79b4d793,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1161d2533b2844408eeb0416ec6ccfef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:35:42Z,use_quota=True,user_id='a8bc8d7bfda14700aef42f15a4ed5ac6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-204f084e-1140-4e3e-8fc5-52eaac22ef55 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ef74b72-73eb-42a3-bf74-24f8c12e0500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-204f084e-1140-4e3e-8fc5-52eaac22ef55 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ef74b72-73eb-42a3-bf74-24f8c12e0500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-204f084e-1140-4e3e-8fc5-52eaac22ef55 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c9bf94c-cbc9-46b4-98f5-cbc06ad85b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-204f084e-1140-4e3e-8fc5-52eaac22ef55 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c9bf94c-cbc9-46b4-98f5-cbc06ad85b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8914b56a-e0c5-45d3-8add-abea79b4d793', 'volume_name': 'volume-8914b56a-e0c5-45d3-8add-abea79b4d793', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-204f084e-1140-4e3e-8fc5-52eaac22ef55 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af56f144-9737-4317-acf8-9f6da480fca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-204f084e-1140-4e3e-8fc5-52eaac22ef55 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af56f144-9737-4317-acf8-9f6da480fca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:41 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-204f084e-1140-4e3e-8fc5-52eaac22ef55 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19089a78-978f-433b-9e38-dae5e4439993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:41 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-204f084e-1140-4e3e-8fc5-52eaac22ef55 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Volume 8914b56a-e0c5-45d3-8add-abea79b4d793: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8914b56a-e0c5-45d3-8add-abea79b4d793', 'volume_size': 1} Jul 16 23:35:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-204f084e-1140-4e3e-8fc5-52eaac22ef55 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-31971dcc-6524-4124-9ab7-d7d1d8be19d2 tempest-VolumeDependencyTests-490071870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce1cd0f9-0783-4251-9641-78a312cd2079 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079.ade476f3-8b9d-423a-8793-680f22ae83e8" returned: 0 in 0.497s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:41 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-31971dcc-6524-4124-9ab7-d7d1d8be19d2 tempest-VolumeDependencyTests-490071870 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079.ade476f3-8b9d-423a-8793-680f22ae83e8 is being set with open permissions: ugo+rw Jul 16 23:35:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-31971dcc-6524-4124-9ab7-d7d1d8be19d2 tempest-VolumeDependencyTests-490071870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079.ade476f3-8b9d-423a-8793-680f22ae83e8 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:41 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079.ade476f3-8b9d-423a-8793-680f22ae83e8 Jul 16 23:35:41 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:42 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a40cecb7-3df7-41e8-b02a-02f996da4ee2_j5cr9jdydevstack@QuobyteHD" returned: 0 in 0.441s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a40cecb7-3df7-41e8-b02a-02f996da4ee2_j5cr9jdydevstack@QuobyteHD {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:42 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec8b484a-5059-46e1-aea6-a642f5288a58 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:35:42 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ec8b484a-5059-46e1-aea6-a642f5288a58 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Flow 'volume_create_manager' (e344df9b-c8ea-4bff-82bb-73413c1a3ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:35:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ec8b484a-5059-46e1-aea6-a642f5288a58 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ca30487-2456-4c6a-aeb3-f5fba1bce0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:42 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a40cecb7-3df7-41e8-b02a-02f996da4ee2_j5cr9jdydevstack@QuobyteHD Jul 16 23:35:42 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-31971dcc-6524-4124-9ab7-d7d1d8be19d2 tempest-VolumeDependencyTests-490071870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079.ade476f3-8b9d-423a-8793-680f22ae83e8" returned: 0 in 0.419s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ec8b484a-5059-46e1-aea6-a642f5288a58 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ca30487-2456-4c6a-aeb3-f5fba1bce0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-145139627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f005a79d-2248-4585-a36b-7054820e51bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1161d2533b2844408eeb0416ec6ccfef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:35:42Z,use_quota=True,user_id='a8bc8d7bfda14700aef42f15a4ed5ac6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ec8b484a-5059-46e1-aea6-a642f5288a58 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fc6adc2-fadf-4732-9784-3b6f2867a86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ec8b484a-5059-46e1-aea6-a642f5288a58 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fc6adc2-fadf-4732-9784-3b6f2867a86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ec8b484a-5059-46e1-aea6-a642f5288a58 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a854269-6fc8-4c51-817d-07a94c30412a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ec8b484a-5059-46e1-aea6-a642f5288a58 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a854269-6fc8-4c51-817d-07a94c30412a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f005a79d-2248-4585-a36b-7054820e51bf', 'volume_name': 'volume-f005a79d-2248-4585-a36b-7054820e51bf', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ec8b484a-5059-46e1-aea6-a642f5288a58 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00123788-18d3-4114-80e9-729c9612979b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ec8b484a-5059-46e1-aea6-a642f5288a58 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00123788-18d3-4114-80e9-729c9612979b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ec8b484a-5059-46e1-aea6-a642f5288a58 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef5052f9-0e47-405e-9d4f-e06e6c3f2b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:42 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-ec8b484a-5059-46e1-aea6-a642f5288a58 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Volume f005a79d-2248-4585-a36b-7054820e51bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f005a79d-2248-4585-a36b-7054820e51bf', 'volume_size': 1} Jul 16 23:35:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ec8b484a-5059-46e1-aea6-a642f5288a58 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-31971dcc-6524-4124-9ab7-d7d1d8be19d2 tempest-VolumeDependencyTests-490071870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:42 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079.info Jul 16 23:35:42 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:42 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a40cecb7-3df7-41e8-b02a-02f996da4ee2_j5cr9jdydevstack@QuobyteHD" returned: 1 in 0.475s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a40cecb7-3df7-41e8-b02a-02f996da4ee2_j5cr9jdydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 23:35:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:42 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-082ce430-2680-4957-bc4d-121d59e01ee4 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:35:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-082ce430-2680-4957-bc4d-121d59e01ee4 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Flow 'volume_create_manager' (55f515ba-bb66-4bf9-bb4c-2428dd66a00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:35:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-082ce430-2680-4957-bc4d-121d59e01ee4 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b234327-cd04-4f6a-bc5b-a43aff537fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-082ce430-2680-4957-bc4d-121d59e01ee4 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b234327-cd04-4f6a-bc5b-a43aff537fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-851883013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fde4a47-5db5-4faf-8717-91bb27b044e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1161d2533b2844408eeb0416ec6ccfef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:35:43Z,use_quota=True,user_id='a8bc8d7bfda14700aef42f15a4ed5ac6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-082ce430-2680-4957-bc4d-121d59e01ee4 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfac7d4a-2094-491b-8983-46a04f8f5d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-082ce430-2680-4957-bc4d-121d59e01ee4 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfac7d4a-2094-491b-8983-46a04f8f5d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-082ce430-2680-4957-bc4d-121d59e01ee4 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c1fb064-a0ca-4672-9534-285aaea46146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:42 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-082ce430-2680-4957-bc4d-121d59e01ee4 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c1fb064-a0ca-4672-9534-285aaea46146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fde4a47-5db5-4faf-8717-91bb27b044e0', 'volume_name': 'volume-7fde4a47-5db5-4faf-8717-91bb27b044e0', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-082ce430-2680-4957-bc4d-121d59e01ee4 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3420448d-5728-46a8-ac33-ea8020890cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-082ce430-2680-4957-bc4d-121d59e01ee4 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3420448d-5728-46a8-ac33-ea8020890cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:42 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-082ce430-2680-4957-bc4d-121d59e01ee4 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bfaad54-67de-4745-9e4d-5c7a539145b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:42 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-082ce430-2680-4957-bc4d-121d59e01ee4 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Volume 7fde4a47-5db5-4faf-8717-91bb27b044e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fde4a47-5db5-4faf-8717-91bb27b044e0', 'volume_size': 1} Jul 16 23:35:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-082ce430-2680-4957-bc4d-121d59e01ee4 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-31971dcc-6524-4124-9ab7-d7d1d8be19d2 tempest-VolumeDependencyTests-490071870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079.info" returned: 0 in 0.317s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:42 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-31971dcc-6524-4124-9ab7-d7d1d8be19d2 tempest-VolumeDependencyTests-490071870 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079.info is being set with open permissions: ugo+rw Jul 16 23:35:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-31971dcc-6524-4124-9ab7-d7d1d8be19d2 tempest-VolumeDependencyTests-490071870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:42 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079.info Jul 16 23:35:42 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-89d8f5ab-2cc4-4272-ba08-8fa9b5c57e23 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-89d8f5ab-2cc4-4272-ba08-8fa9b5c57e23 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Flow 'volume_create_manager' (8a4b00ce-3a24-4e1a-9b78-ff0178c29096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-89d8f5ab-2cc4-4272-ba08-8fa9b5c57e23 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97edb467-ed06-4c28-86e7-e917158e284d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:43 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-31971dcc-6524-4124-9ab7-d7d1d8be19d2 tempest-VolumeDependencyTests-490071870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079.info" returned: 0 in 0.332s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-31971dcc-6524-4124-9ab7-d7d1d8be19d2 tempest-VolumeDependencyTests-490071870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.785s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.854s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a44dbcfa-f7de-4e4d-9336-ade4b656f83c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c539cbbc093438c8a9fb5a0d97d1640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:35:39Z,use_quota=True,user_id='69ea110f49ca488aa79d6f6c4c1bb48a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Creating volume a44dbcfa-f7de-4e4d-9336-ade4b656f83c {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:35:43 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a44dbcfa-f7de-4e4d-9336-ade4b656f83c 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-89d8f5ab-2cc4-4272-ba08-8fa9b5c57e23 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97edb467-ed06-4c28-86e7-e917158e284d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-892524985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6061a061-87e8-4faa-a773-9a98e7d74e4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1161d2533b2844408eeb0416ec6ccfef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:35:43Z,use_quota=True,user_id='a8bc8d7bfda14700aef42f15a4ed5ac6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-89d8f5ab-2cc4-4272-ba08-8fa9b5c57e23 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a41582-99ab-423b-88fd-9a36a2f898b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:43 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a44dbcfa-f7de-4e4d-9336-ade4b656f83c 1073741824 Jul 16 23:35:43 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-89d8f5ab-2cc4-4272-ba08-8fa9b5c57e23 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a41582-99ab-423b-88fd-9a36a2f898b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-89d8f5ab-2cc4-4272-ba08-8fa9b5c57e23 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dabf6687-f7d5-4fd9-9806-f302be316690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-89d8f5ab-2cc4-4272-ba08-8fa9b5c57e23 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dabf6687-f7d5-4fd9-9806-f302be316690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6061a061-87e8-4faa-a773-9a98e7d74e4f', 'volume_name': 'volume-6061a061-87e8-4faa-a773-9a98e7d74e4f', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-89d8f5ab-2cc4-4272-ba08-8fa9b5c57e23 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b26011b3-d7e2-40b7-93ff-a10c8fd3c844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-89d8f5ab-2cc4-4272-ba08-8fa9b5c57e23 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b26011b3-d7e2-40b7-93ff-a10c8fd3c844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-89d8f5ab-2cc4-4272-ba08-8fa9b5c57e23 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f3313db-641e-43cc-a1d4-7aae8715a3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:43 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-89d8f5ab-2cc4-4272-ba08-8fa9b5c57e23 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Volume 6061a061-87e8-4faa-a773-9a98e7d74e4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6061a061-87e8-4faa-a773-9a98e7d74e4f', 'volume_size': 1} Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-89d8f5ab-2cc4-4272-ba08-8fa9b5c57e23 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:43 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-31971dcc-6524-4124-9ab7-d7d1d8be19d2 tempest-VolumeDependencyTests-490071870 None] Create snapshot completed successfully Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-733c331b-09b3-46cf-bf47-bae451d3fee2 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-733c331b-09b3-46cf-bf47-bae451d3fee2 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Flow 'volume_create_manager' (6f8ffe99-c6b3-4ffb-8a91-9f072c7f415f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-733c331b-09b3-46cf-bf47-bae451d3fee2 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae43f83-560b-4863-b3a5-2f7e063f821b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-733c331b-09b3-46cf-bf47-bae451d3fee2 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae43f83-560b-4863-b3a5-2f7e063f821b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-570136812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d826c5c8-cfdc-4c60-96fe-4cfc45b47818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1161d2533b2844408eeb0416ec6ccfef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:35:43Z,use_quota=True,user_id='a8bc8d7bfda14700aef42f15a4ed5ac6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-733c331b-09b3-46cf-bf47-bae451d3fee2 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a80c2f78-5348-4ae9-a5f7-2443d3370e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-733c331b-09b3-46cf-bf47-bae451d3fee2 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a80c2f78-5348-4ae9-a5f7-2443d3370e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-733c331b-09b3-46cf-bf47-bae451d3fee2 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c170e548-839f-46ed-92fe-fd18f1f9de2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-733c331b-09b3-46cf-bf47-bae451d3fee2 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c170e548-839f-46ed-92fe-fd18f1f9de2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd826c5c8-cfdc-4c60-96fe-4cfc45b47818', 'volume_name': 'volume-d826c5c8-cfdc-4c60-96fe-4cfc45b47818', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-733c331b-09b3-46cf-bf47-bae451d3fee2 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3975520-f1de-4cf7-9978-3f5d41d0bc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-733c331b-09b3-46cf-bf47-bae451d3fee2 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3975520-f1de-4cf7-9978-3f5d41d0bc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-733c331b-09b3-46cf-bf47-bae451d3fee2 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8b205b1-2378-4e38-a4bc-e2599170b569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:43 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-733c331b-09b3-46cf-bf47-bae451d3fee2 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Volume d826c5c8-cfdc-4c60-96fe-4cfc45b47818: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d826c5c8-cfdc-4c60-96fe-4cfc45b47818', 'volume_size': 1} Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-733c331b-09b3-46cf-bf47-bae451d3fee2 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:43 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a44dbcfa-f7de-4e4d-9336-ade4b656f83c 1073741824" returned: 0 in 0.484s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a44dbcfa-f7de-4e4d-9336-ade4b656f83c {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:43 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a44dbcfa-f7de-4e4d-9336-ade4b656f83c Jul 16 23:35:43 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:43 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a44dbcfa-f7de-4e4d-9336-ade4b656f83c" returned: 0 in 0.262s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-204f084e-1140-4e3e-8fc5-52eaac22ef55 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-204f084e-1140-4e3e-8fc5-52eaac22ef55 tempest-CreateVolumesFromSnapshotTest-1783062093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1481309631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8914b56a-e0c5-45d3-8add-abea79b4d793,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1161d2533b2844408eeb0416ec6ccfef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:35:42Z,use_quota=True,user_id='a8bc8d7bfda14700aef42f15a4ed5ac6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-204f084e-1140-4e3e-8fc5-52eaac22ef55 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Creating volume 8914b56a-e0c5-45d3-8add-abea79b4d793 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-204f084e-1140-4e3e-8fc5-52eaac22ef55 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-204f084e-1140-4e3e-8fc5-52eaac22ef55 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-204f084e-1140-4e3e-8fc5-52eaac22ef55 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-204f084e-1140-4e3e-8fc5-52eaac22ef55 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-204f084e-1140-4e3e-8fc5-52eaac22ef55 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-204f084e-1140-4e3e-8fc5-52eaac22ef55 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:35:43 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-204f084e-1140-4e3e-8fc5-52eaac22ef55 tempest-CreateVolumesFromSnapshotTest-1783062093 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-204f084e-1140-4e3e-8fc5-52eaac22ef55 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8914b56a-e0c5-45d3-8add-abea79b4d793 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:43 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8914b56a-e0c5-45d3-8add-abea79b4d793 1073741824 Jul 16 23:35:43 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:43 devstack cinder-volume[87607]: DEBUG cinder.volume.volume_utils [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Attempting download of 8117e3cc-4744-40f7-9bf8-bf4c0256cc0b ((None, [{'url': 'file:///opt/stack/data/glance/images/8117e3cc-4744-40f7-9bf8-bf4c0256cc0b', 'metadata': {}}])) to volume a44dbcfa-f7de-4e4d-9336-ade4b656f83c. {{(pid=87607) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 16 23:35:44 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a6e64e-3605-4ad2-8dc0-e0d8239d5de2]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:35:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8117e3cc-4744-40f7-9bf8-bf4c0256cc0b_jzlilje9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:44 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8117e3cc-4744-40f7-9bf8-bf4c0256cc0b_jzlilje9 Jul 16 23:35:44 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:44 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:35:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Flow 'volume_create_manager' (4add3130-419d-402d-a774-277858c617e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:35:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba94ea64-f1ea-4178-b2d1-2d222efd8723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba94ea64-f1ea-4178-b2d1-2d222efd8723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:35:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1161020797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6940b793-1287-4316-9d1b-8a689f13d164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='438fbd72d24d4282822e03c178ce7f58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ade476f3-8b9d-423a-8793-680f22ae83e8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:35:44Z,use_quota=True,user_id='a2f0fbceaf4c4673beb2e7f61a4456d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96c5d50e-1631-4f86-85c3-5cc28ebf09a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96c5d50e-1631-4f86-85c3-5cc28ebf09a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:44 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77b65063-34f8-4276-b31a-57318ea249e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77b65063-34f8-4276-b31a-57318ea249e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6940b793-1287-4316-9d1b-8a689f13d164', 'volume_name': 'volume-6940b793-1287-4316-9d1b-8a689f13d164', 'volume_size': 1, 'snapshot_id': 'ade476f3-8b9d-423a-8793-680f22ae83e8'}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1ab65ac-41da-48d7-adcb-3cf0866120a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1ab65ac-41da-48d7-adcb-3cf0866120a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3200fa2e-d2ff-4163-9e19-9190a7a812c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:44 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Volume 6940b793-1287-4316-9d1b-8a689f13d164: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6940b793-1287-4316-9d1b-8a689f13d164', 'volume_size': 1, 'snapshot_id': 'ade476f3-8b9d-423a-8793-680f22ae83e8'} Jul 16 23:35:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8117e3cc-4744-40f7-9bf8-bf4c0256cc0b_jzlilje9" returned: 0 in 0.472s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8117e3cc-4744-40f7-9bf8-bf4c0256cc0b_jzlilje9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:44 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-204f084e-1140-4e3e-8fc5-52eaac22ef55 tempest-CreateVolumesFromSnapshotTest-1783062093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8914b56a-e0c5-45d3-8add-abea79b4d793 1073741824" returned: 0 in 0.599s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-204f084e-1140-4e3e-8fc5-52eaac22ef55 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8914b56a-e0c5-45d3-8add-abea79b4d793 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:44 devstack sudo[106169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8914b56a-e0c5-45d3-8add-abea79b4d793 Jul 16 23:35:44 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:44 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8117e3cc-4744-40f7-9bf8-bf4c0256cc0b_jzlilje9 Jul 16 23:35:44 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:44 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-204f084e-1140-4e3e-8fc5-52eaac22ef55 tempest-CreateVolumesFromSnapshotTest-1783062093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8914b56a-e0c5-45d3-8add-abea79b4d793" returned: 0 in 0.256s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:44 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-204f084e-1140-4e3e-8fc5-52eaac22ef55 tempest-CreateVolumesFromSnapshotTest-1783062093 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:35:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-204f084e-1140-4e3e-8fc5-52eaac22ef55 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ec8b484a-5059-46e1-aea6-a642f5288a58 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.448s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:44 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ec8b484a-5059-46e1-aea6-a642f5288a58 tempest-CreateVolumesFromSnapshotTest-1783062093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-145139627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f005a79d-2248-4585-a36b-7054820e51bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1161d2533b2844408eeb0416ec6ccfef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:35:42Z,use_quota=True,user_id='a8bc8d7bfda14700aef42f15a4ed5ac6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:35:44 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-ec8b484a-5059-46e1-aea6-a642f5288a58 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Creating volume f005a79d-2248-4585-a36b-7054820e51bf {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:35:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ec8b484a-5059-46e1-aea6-a642f5288a58 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ec8b484a-5059-46e1-aea6-a642f5288a58 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:44 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ec8b484a-5059-46e1-aea6-a642f5288a58 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:35:44 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ec8b484a-5059-46e1-aea6-a642f5288a58 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:35:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ec8b484a-5059-46e1-aea6-a642f5288a58 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:44 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ec8b484a-5059-46e1-aea6-a642f5288a58 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:35:44 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-ec8b484a-5059-46e1-aea6-a642f5288a58 tempest-CreateVolumesFromSnapshotTest-1783062093 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:35:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ec8b484a-5059-46e1-aea6-a642f5288a58 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f005a79d-2248-4585-a36b-7054820e51bf 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:44 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8117e3cc-4744-40f7-9bf8-bf4c0256cc0b_jzlilje9" returned: 1 in 0.345s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8117e3cc-4744-40f7-9bf8-bf4c0256cc0b_jzlilje9' failed. Not Retrying. {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 23:35:44 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72d6053-2688-4865-9694-f6b5d20cfd66]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:35:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8117e3cc-4744-40f7-9bf8-bf4c0256cc0b_mic7ki_3devstack@QuobyteHD {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:44 devstack sudo[106175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f005a79d-2248-4585-a36b-7054820e51bf 1073741824 Jul 16 23:35:44 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-204f084e-1140-4e3e-8fc5-52eaac22ef55 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19089a78-978f-433b-9e38-dae5e4439993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8914b56a-e0c5-45d3-8add-abea79b4d793', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-204f084e-1140-4e3e-8fc5-52eaac22ef55 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be7c2241-fd0e-4d74-9483-6c467114f188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:44 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-204f084e-1140-4e3e-8fc5-52eaac22ef55 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Volume volume-8914b56a-e0c5-45d3-8add-abea79b4d793 (8914b56a-e0c5-45d3-8add-abea79b4d793): created successfully Jul 16 23:35:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-204f084e-1140-4e3e-8fc5-52eaac22ef55 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be7c2241-fd0e-4d74-9483-6c467114f188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:44 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-204f084e-1140-4e3e-8fc5-52eaac22ef55 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Flow 'volume_create_manager' (a51da0a7-022b-44d9-bcda-0551c6c638b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:35:44 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-204f084e-1140-4e3e-8fc5-52eaac22ef55 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Created volume successfully. Jul 16 23:35:44 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8117e3cc-4744-40f7-9bf8-bf4c0256cc0b_mic7ki_3devstack@QuobyteHD Jul 16 23:35:44 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:45 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8117e3cc-4744-40f7-9bf8-bf4c0256cc0b_mic7ki_3devstack@QuobyteHD" returned: 0 in 0.370s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8117e3cc-4744-40f7-9bf8-bf4c0256cc0b_mic7ki_3devstack@QuobyteHD {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:45 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ec8b484a-5059-46e1-aea6-a642f5288a58 tempest-CreateVolumesFromSnapshotTest-1783062093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f005a79d-2248-4585-a36b-7054820e51bf 1073741824" returned: 0 in 0.449s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ec8b484a-5059-46e1-aea6-a642f5288a58 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f005a79d-2248-4585-a36b-7054820e51bf {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:45 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8117e3cc-4744-40f7-9bf8-bf4c0256cc0b_mic7ki_3devstack@QuobyteHD Jul 16 23:35:45 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:45 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f005a79d-2248-4585-a36b-7054820e51bf Jul 16 23:35:45 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:45 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ec8b484a-5059-46e1-aea6-a642f5288a58 tempest-CreateVolumesFromSnapshotTest-1783062093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f005a79d-2248-4585-a36b-7054820e51bf" returned: 0 in 0.269s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:45 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ec8b484a-5059-46e1-aea6-a642f5288a58 tempest-CreateVolumesFromSnapshotTest-1783062093 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:35:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ec8b484a-5059-46e1-aea6-a642f5288a58 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.986s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:45 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:35:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c4f4653-b0ef-4909-9395-9252cf78383f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5003458c2014856a0f13542b0c0e216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:35:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:35:40Z,use_quota=True,user_id='2ba678881c474bc98623ff764a3b4a10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8848f66e-b146-42d6-a9f3-2fc687aaceef),volume_type_id=8848f66e-b146-42d6-a9f3-2fc687aaceef)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:35:45 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Creating volume 9c4f4653-b0ef-4909-9395-9252cf78383f {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:35:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:45 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:35:45 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:35:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:45 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:35:45 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:35:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9c4f4653-b0ef-4909-9395-9252cf78383f 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:45 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8117e3cc-4744-40f7-9bf8-bf4c0256cc0b_mic7ki_3devstack@QuobyteHD" returned: 1 in 0.417s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8117e3cc-4744-40f7-9bf8-bf4c0256cc0b_mic7ki_3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 23:35:45 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] 8117e3cc-4744-40f7-9bf8-bf4c0256cc0b was raw, converting to qcow2 {{(pid=87607) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 16 23:35:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8117e3cc-4744-40f7-9bf8-bf4c0256cc0b_mic7ki_3devstack@QuobyteHD /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a44dbcfa-f7de-4e4d-9336-ade4b656f83c {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:45 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9c4f4653-b0ef-4909-9395-9252cf78383f 1073741824 Jul 16 23:35:45 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ec8b484a-5059-46e1-aea6-a642f5288a58 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef5052f9-0e47-405e-9d4f-e06e6c3f2b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f005a79d-2248-4585-a36b-7054820e51bf', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ec8b484a-5059-46e1-aea6-a642f5288a58 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2272eda-9828-4957-b901-0a91c26b3846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:45 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8117e3cc-4744-40f7-9bf8-bf4c0256cc0b_mic7ki_3devstack@QuobyteHD /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a44dbcfa-f7de-4e4d-9336-ade4b656f83c Jul 16 23:35:45 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:45 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-ec8b484a-5059-46e1-aea6-a642f5288a58 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Volume volume-f005a79d-2248-4585-a36b-7054820e51bf (f005a79d-2248-4585-a36b-7054820e51bf): created successfully Jul 16 23:35:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ec8b484a-5059-46e1-aea6-a642f5288a58 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2272eda-9828-4957-b901-0a91c26b3846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ec8b484a-5059-46e1-aea6-a642f5288a58 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Flow 'volume_create_manager' (e344df9b-c8ea-4bff-82bb-73413c1a3ce8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:35:45 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-ec8b484a-5059-46e1-aea6-a642f5288a58 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Created volume successfully. Jul 16 23:35:46 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9c4f4653-b0ef-4909-9395-9252cf78383f 1073741824" returned: 0 in 0.429s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9c4f4653-b0ef-4909-9395-9252cf78383f {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:46 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:46 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9c4f4653-b0ef-4909-9395-9252cf78383f Jul 16 23:35:46 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8117e3cc-4744-40f7-9bf8-bf4c0256cc0b_mic7ki_3devstack@QuobyteHD /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a44dbcfa-f7de-4e4d-9336-ade4b656f83c" returned: 0 in 0.468s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:46 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8117e3cc-4744-40f7-9bf8-bf4c0256cc0b_mic7ki_3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a44dbcfa-f7de-4e4d-9336-ade4b656f83c {{(pid=87607) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 23:35:46 devstack cinder-volume[87607]: INFO cinder.image.image_utils [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Converted 0.00 MB image at 0.00 MB/s Jul 16 23:35:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a44dbcfa-f7de-4e4d-9336-ade4b656f83c 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:46 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a44dbcfa-f7de-4e4d-9336-ade4b656f83c 1G Jul 16 23:35:46 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:46 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9c4f4653-b0ef-4909-9395-9252cf78383f" returned: 0 in 0.259s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:46 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:35:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-082ce430-2680-4957-bc4d-121d59e01ee4 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.628s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:46 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-082ce430-2680-4957-bc4d-121d59e01ee4 tempest-CreateVolumesFromSnapshotTest-1783062093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-851883013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fde4a47-5db5-4faf-8717-91bb27b044e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1161d2533b2844408eeb0416ec6ccfef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:35:43Z,use_quota=True,user_id='a8bc8d7bfda14700aef42f15a4ed5ac6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:35:46 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-082ce430-2680-4957-bc4d-121d59e01ee4 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Creating volume 7fde4a47-5db5-4faf-8717-91bb27b044e0 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:35:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-082ce430-2680-4957-bc4d-121d59e01ee4 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-082ce430-2680-4957-bc4d-121d59e01ee4 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:46 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-082ce430-2680-4957-bc4d-121d59e01ee4 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:35:46 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-082ce430-2680-4957-bc4d-121d59e01ee4 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:35:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-082ce430-2680-4957-bc4d-121d59e01ee4 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:46 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-082ce430-2680-4957-bc4d-121d59e01ee4 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:35:46 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-082ce430-2680-4957-bc4d-121d59e01ee4 tempest-CreateVolumesFromSnapshotTest-1783062093 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:35:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-082ce430-2680-4957-bc4d-121d59e01ee4 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7fde4a47-5db5-4faf-8717-91bb27b044e0 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:46 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7fde4a47-5db5-4faf-8717-91bb27b044e0 1073741824 Jul 16 23:35:46 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:46 devstack cinder-volume[87607]: DEBUG cinder.volume.volume_utils [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Attempting download of a40cecb7-3df7-41e8-b02a-02f996da4ee2 ((None, [{'url': 'file:///opt/stack/data/glance/images/a40cecb7-3df7-41e8-b02a-02f996da4ee2', 'metadata': {}}])) to volume 9c4f4653-b0ef-4909-9395-9252cf78383f. {{(pid=87607) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 16 23:35:46 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a44dbcfa-f7de-4e4d-9336-ade4b656f83c 1G" returned: 0 in 0.341s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:46 devstack cinder-volume[87607]: DEBUG cinder.volume.volume_utils [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Downloaded image 8117e3cc-4744-40f7-9bf8-bf4c0256cc0b ((None, [{'url': 'file:///opt/stack/data/glance/images/8117e3cc-4744-40f7-9bf8-bf4c0256cc0b', 'metadata': {}}])) to volume a44dbcfa-f7de-4e4d-9336-ade4b656f83c successfully. {{(pid=87607) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 16 23:35:46 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Temporary image 8117e3cc-4744-40f7-9bf8-bf4c0256cc0b for user 69ea110f49ca488aa79d6f6c4c1bb48a is deleted. {{(pid=87607) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 16 23:35:46 devstack cinder-volume[87607]: DEBUG cinder.volume.volume_utils [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Marking volume a44dbcfa-f7de-4e4d-9336-ade4b656f83c as bootable. {{(pid=87607) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 16 23:35:46 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae00e3bb-bc79-4f53-968f-826e0ee80157]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:35:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a40cecb7-3df7-41e8-b02a-02f996da4ee2_6iqb4hzb {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:46 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Copying metadata from image 8117e3cc-4744-40f7-9bf8-bf4c0256cc0b to a44dbcfa-f7de-4e4d-9336-ade4b656f83c. {{(pid=87607) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 16 23:35:46 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Creating volume glance metadata for volume a44dbcfa-f7de-4e4d-9336-ade4b656f83c backed by image 8117e3cc-4744-40f7-9bf8-bf4c0256cc0b with: {'image_id': '8117e3cc-4744-40f7-9bf8-bf4c0256cc0b', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f602cc86b5c9a9283fc242d4dc4e6443', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87607) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 16 23:35:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f88c261f-092e-4496-9572-edca64ffb9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a44dbcfa-f7de-4e4d-9336-ade4b656f83c', 'volume_size': 1, 'image_id': '8117e3cc-4744-40f7-9bf8-bf4c0256cc0b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8117e3cc-4744-40f7-9bf8-bf4c0256cc0b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f602cc86b5c9a9283fc242d4dc4e6443', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2c539cbbc093438c8a9fb5a0d97d1640', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c641f4e076984a54126fab68dd735e17b747dc4274fe8ce2e9d9edf40906e7457811163b2e2824736a25ab52ac5d818c951e6efdde5b8dddd559cb32d08beeac', 'id': '8117e3cc-4744-40f7-9bf8-bf4c0256cc0b', 'created_at': datetime.datetime(2026, 7, 16, 21, 35, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 21, 35, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8117e3cc-4744-40f7-9bf8-bf4c0256cc0b/file', 'properties': {}}, 'image_service': }' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0883c44-a133-46d6-b5d2-50a24c8e427b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:46 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Volume volume-a44dbcfa-f7de-4e4d-9336-ade4b656f83c (a44dbcfa-f7de-4e4d-9336-ade4b656f83c): created successfully Jul 16 23:35:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0883c44-a133-46d6-b5d2-50a24c8e427b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Flow 'volume_create_manager' (4cd6161c-3ff9-4c39-8a54-46168cf789df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:35:46 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a40cecb7-3df7-41e8-b02a-02f996da4ee2_6iqb4hzb Jul 16 23:35:46 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:46 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-97c2f4af-25fb-4014-9a83-af5d70fae7ac tempest-VolumeImageDependencyTests-1489285573 None] Created volume successfully. Jul 16 23:35:46 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a40cecb7-3df7-41e8-b02a-02f996da4ee2_6iqb4hzb" returned: 0 in 0.392s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:46 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a40cecb7-3df7-41e8-b02a-02f996da4ee2_6iqb4hzb {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-082ce430-2680-4957-bc4d-121d59e01ee4 tempest-CreateVolumesFromSnapshotTest-1783062093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7fde4a47-5db5-4faf-8717-91bb27b044e0 1073741824" returned: 0 in 0.515s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-082ce430-2680-4957-bc4d-121d59e01ee4 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7fde4a47-5db5-4faf-8717-91bb27b044e0 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:46 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7fde4a47-5db5-4faf-8717-91bb27b044e0 Jul 16 23:35:46 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:46 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a40cecb7-3df7-41e8-b02a-02f996da4ee2_6iqb4hzb Jul 16 23:35:46 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:47 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-082ce430-2680-4957-bc4d-121d59e01ee4 tempest-CreateVolumesFromSnapshotTest-1783062093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7fde4a47-5db5-4faf-8717-91bb27b044e0" returned: 0 in 0.242s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:47 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-082ce430-2680-4957-bc4d-121d59e01ee4 tempest-CreateVolumesFromSnapshotTest-1783062093 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:35:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-082ce430-2680-4957-bc4d-121d59e01ee4 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-89d8f5ab-2cc4-4272-ba08-8fa9b5c57e23 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.996s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:47 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-89d8f5ab-2cc4-4272-ba08-8fa9b5c57e23 tempest-CreateVolumesFromSnapshotTest-1783062093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-892524985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6061a061-87e8-4faa-a773-9a98e7d74e4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1161d2533b2844408eeb0416ec6ccfef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:35:43Z,use_quota=True,user_id='a8bc8d7bfda14700aef42f15a4ed5ac6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:35:47 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-89d8f5ab-2cc4-4272-ba08-8fa9b5c57e23 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Creating volume 6061a061-87e8-4faa-a773-9a98e7d74e4f {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:35:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-89d8f5ab-2cc4-4272-ba08-8fa9b5c57e23 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-89d8f5ab-2cc4-4272-ba08-8fa9b5c57e23 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:47 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-89d8f5ab-2cc4-4272-ba08-8fa9b5c57e23 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:35:47 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-89d8f5ab-2cc4-4272-ba08-8fa9b5c57e23 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:35:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-89d8f5ab-2cc4-4272-ba08-8fa9b5c57e23 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:47 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-89d8f5ab-2cc4-4272-ba08-8fa9b5c57e23 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:35:47 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-89d8f5ab-2cc4-4272-ba08-8fa9b5c57e23 tempest-CreateVolumesFromSnapshotTest-1783062093 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:35:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-89d8f5ab-2cc4-4272-ba08-8fa9b5c57e23 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6061a061-87e8-4faa-a773-9a98e7d74e4f 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:47 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-082ce430-2680-4957-bc4d-121d59e01ee4 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bfaad54-67de-4745-9e4d-5c7a539145b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fde4a47-5db5-4faf-8717-91bb27b044e0', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:47 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6061a061-87e8-4faa-a773-9a98e7d74e4f 1073741824 Jul 16 23:35:47 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-082ce430-2680-4957-bc4d-121d59e01ee4 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca95217-5fe9-4095-95ab-49bcd635a22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a40cecb7-3df7-41e8-b02a-02f996da4ee2_6iqb4hzb" returned: 1 in 0.344s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a40cecb7-3df7-41e8-b02a-02f996da4ee2_6iqb4hzb' failed. Not Retrying. {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 23:35:47 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[52061510-15a6-428a-9964-600f4af6a55a]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:35:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a40cecb7-3df7-41e8-b02a-02f996da4ee2_j5cr9jdydevstack@QuobyteHD {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:47 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-082ce430-2680-4957-bc4d-121d59e01ee4 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Volume volume-7fde4a47-5db5-4faf-8717-91bb27b044e0 (7fde4a47-5db5-4faf-8717-91bb27b044e0): created successfully Jul 16 23:35:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-082ce430-2680-4957-bc4d-121d59e01ee4 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca95217-5fe9-4095-95ab-49bcd635a22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:47 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-082ce430-2680-4957-bc4d-121d59e01ee4 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Flow 'volume_create_manager' (55f515ba-bb66-4bf9-bb4c-2428dd66a00a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:35:47 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-082ce430-2680-4957-bc4d-121d59e01ee4 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Created volume successfully. Jul 16 23:35:47 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a40cecb7-3df7-41e8-b02a-02f996da4ee2_j5cr9jdydevstack@QuobyteHD Jul 16 23:35:47 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:47 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a40cecb7-3df7-41e8-b02a-02f996da4ee2_j5cr9jdydevstack@QuobyteHD" returned: 0 in 0.353s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a40cecb7-3df7-41e8-b02a-02f996da4ee2_j5cr9jdydevstack@QuobyteHD {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:47 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-8ac5fa66-a148-411b-8b78-6fa63d0d2fe5 tempest-VolumeImageDependencyTests-1489285573 None] Acquiring lock "cinder-a44dbcfa-f7de-4e4d-9336-ade4b656f83c-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:35:47 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-8ac5fa66-a148-411b-8b78-6fa63d0d2fe5 tempest-VolumeImageDependencyTests-1489285573 None] Lock "cinder-a44dbcfa-f7de-4e4d-9336-ade4b656f83c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:35:47 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a40cecb7-3df7-41e8-b02a-02f996da4ee2_j5cr9jdydevstack@QuobyteHD Jul 16 23:35:47 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:47 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-8ac5fa66-a148-411b-8b78-6fa63d0d2fe5 tempest-VolumeImageDependencyTests-1489285573 None] Acquiring lock "cinder-quobyte-a44dbcfa-f7de-4e4d-9336-ade4b656f83c" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:35:47 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-8ac5fa66-a148-411b-8b78-6fa63d0d2fe5 tempest-VolumeImageDependencyTests-1489285573 None] Lock "cinder-quobyte-a44dbcfa-f7de-4e4d-9336-ade4b656f83c" acquired by "delete_volume" :: waited 0.038s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:35:47 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-89d8f5ab-2cc4-4272-ba08-8fa9b5c57e23 tempest-CreateVolumesFromSnapshotTest-1783062093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6061a061-87e8-4faa-a773-9a98e7d74e4f 1073741824" returned: 0 in 0.564s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:47 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c557b6-ac03-4fb8-ba67-201ccd88836b]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:35:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8ac5fa66-a148-411b-8b78-6fa63d0d2fe5 tempest-VolumeImageDependencyTests-1489285573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a44dbcfa-f7de-4e4d-9336-ade4b656f83c {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-89d8f5ab-2cc4-4272-ba08-8fa9b5c57e23 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6061a061-87e8-4faa-a773-9a98e7d74e4f {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:47 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6061a061-87e8-4faa-a773-9a98e7d74e4f Jul 16 23:35:47 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:47 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a44dbcfa-f7de-4e4d-9336-ade4b656f83c Jul 16 23:35:47 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:47 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a40cecb7-3df7-41e8-b02a-02f996da4ee2_j5cr9jdydevstack@QuobyteHD" returned: 1 in 0.346s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a40cecb7-3df7-41e8-b02a-02f996da4ee2_j5cr9jdydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 23:35:47 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] a40cecb7-3df7-41e8-b02a-02f996da4ee2 was raw, converting to qcow2 {{(pid=87607) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 16 23:35:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a40cecb7-3df7-41e8-b02a-02f996da4ee2_j5cr9jdydevstack@QuobyteHD /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9c4f4653-b0ef-4909-9395-9252cf78383f {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:47 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a40cecb7-3df7-41e8-b02a-02f996da4ee2_j5cr9jdydevstack@QuobyteHD /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9c4f4653-b0ef-4909-9395-9252cf78383f Jul 16 23:35:47 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:48 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-89d8f5ab-2cc4-4272-ba08-8fa9b5c57e23 tempest-CreateVolumesFromSnapshotTest-1783062093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6061a061-87e8-4faa-a773-9a98e7d74e4f" returned: 0 in 0.303s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:48 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-89d8f5ab-2cc4-4272-ba08-8fa9b5c57e23 tempest-CreateVolumesFromSnapshotTest-1783062093 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:35:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-89d8f5ab-2cc4-4272-ba08-8fa9b5c57e23 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-733c331b-09b3-46cf-bf47-bae451d3fee2 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.667s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:48 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-733c331b-09b3-46cf-bf47-bae451d3fee2 tempest-CreateVolumesFromSnapshotTest-1783062093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-570136812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d826c5c8-cfdc-4c60-96fe-4cfc45b47818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1161d2533b2844408eeb0416ec6ccfef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:35:43Z,use_quota=True,user_id='a8bc8d7bfda14700aef42f15a4ed5ac6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:35:48 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-733c331b-09b3-46cf-bf47-bae451d3fee2 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Creating volume d826c5c8-cfdc-4c60-96fe-4cfc45b47818 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:35:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-733c331b-09b3-46cf-bf47-bae451d3fee2 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-733c331b-09b3-46cf-bf47-bae451d3fee2 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:48 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-733c331b-09b3-46cf-bf47-bae451d3fee2 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:35:48 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-733c331b-09b3-46cf-bf47-bae451d3fee2 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:35:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-733c331b-09b3-46cf-bf47-bae451d3fee2 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:48 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-733c331b-09b3-46cf-bf47-bae451d3fee2 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:35:48 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-733c331b-09b3-46cf-bf47-bae451d3fee2 tempest-CreateVolumesFromSnapshotTest-1783062093 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:35:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-733c331b-09b3-46cf-bf47-bae451d3fee2 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d826c5c8-cfdc-4c60-96fe-4cfc45b47818 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:48 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:48 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-89d8f5ab-2cc4-4272-ba08-8fa9b5c57e23 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f3313db-641e-43cc-a1d4-7aae8715a3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6061a061-87e8-4faa-a773-9a98e7d74e4f', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:48 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d826c5c8-cfdc-4c60-96fe-4cfc45b47818 1073741824 Jul 16 23:35:48 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:48 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-89d8f5ab-2cc4-4272-ba08-8fa9b5c57e23 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc4f7654-89c1-4691-99c5-064ad74951b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8ac5fa66-a148-411b-8b78-6fa63d0d2fe5 tempest-VolumeImageDependencyTests-1489285573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a44dbcfa-f7de-4e4d-9336-ade4b656f83c" returned: 0 in 0.403s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8ac5fa66-a148-411b-8b78-6fa63d0d2fe5 tempest-VolumeImageDependencyTests-1489285573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a44dbcfa-f7de-4e4d-9336-ade4b656f83c {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:48 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-89d8f5ab-2cc4-4272-ba08-8fa9b5c57e23 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Volume volume-6061a061-87e8-4faa-a773-9a98e7d74e4f (6061a061-87e8-4faa-a773-9a98e7d74e4f): created successfully Jul 16 23:35:48 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-89d8f5ab-2cc4-4272-ba08-8fa9b5c57e23 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc4f7654-89c1-4691-99c5-064ad74951b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:48 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a44dbcfa-f7de-4e4d-9336-ade4b656f83c Jul 16 23:35:48 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:48 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-89d8f5ab-2cc4-4272-ba08-8fa9b5c57e23 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Flow 'volume_create_manager' (8a4b00ce-3a24-4e1a-9b78-ff0178c29096) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:35:48 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-89d8f5ab-2cc4-4272-ba08-8fa9b5c57e23 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Created volume successfully. Jul 16 23:35:48 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a40cecb7-3df7-41e8-b02a-02f996da4ee2_j5cr9jdydevstack@QuobyteHD /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9c4f4653-b0ef-4909-9395-9252cf78383f" returned: 0 in 0.452s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:48 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a40cecb7-3df7-41e8-b02a-02f996da4ee2_j5cr9jdydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9c4f4653-b0ef-4909-9395-9252cf78383f {{(pid=87607) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 23:35:48 devstack cinder-volume[87607]: INFO cinder.image.image_utils [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Converted 0.00 MB image at 0.00 MB/s Jul 16 23:35:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9c4f4653-b0ef-4909-9395-9252cf78383f 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:48 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9c4f4653-b0ef-4909-9395-9252cf78383f 1G Jul 16 23:35:48 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:48 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8ac5fa66-a148-411b-8b78-6fa63d0d2fe5 tempest-VolumeImageDependencyTests-1489285573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a44dbcfa-f7de-4e4d-9336-ade4b656f83c" returned: 0 in 0.312s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:48 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-8ac5fa66-a148-411b-8b78-6fa63d0d2fe5 tempest-VolumeImageDependencyTests-1489285573 None] Lock "cinder-quobyte-a44dbcfa-f7de-4e4d-9336-ade4b656f83c" released by "delete_volume" :: held 0.767s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:35:48 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-8ac5fa66-a148-411b-8b78-6fa63d0d2fe5 tempest-VolumeImageDependencyTests-1489285573 None] Created reservations ['a6c7d726-45a2-405d-8252-0d9f0e4f50c2', 'fec7e79e-969e-47ad-898c-efc6705ab218', '225c7804-38f1-463a-9dd9-f7113ba16791', 'b878c7ff-9fa2-43ce-b93c-8c2a4475409b'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:35:48 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-733c331b-09b3-46cf-bf47-bae451d3fee2 tempest-CreateVolumesFromSnapshotTest-1783062093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d826c5c8-cfdc-4c60-96fe-4cfc45b47818 1073741824" returned: 0 in 0.497s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-8ac5fa66-a148-411b-8b78-6fa63d0d2fe5 tempest-VolumeImageDependencyTests-1489285573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-8ac5fa66-a148-411b-8b78-6fa63d0d2fe5 tempest-VolumeImageDependencyTests-1489285573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:48 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-8ac5fa66-a148-411b-8b78-6fa63d0d2fe5 tempest-VolumeImageDependencyTests-1489285573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:35:48 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-8ac5fa66-a148-411b-8b78-6fa63d0d2fe5 tempest-VolumeImageDependencyTests-1489285573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:35:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-8ac5fa66-a148-411b-8b78-6fa63d0d2fe5 tempest-VolumeImageDependencyTests-1489285573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8ac5fa66-a148-411b-8b78-6fa63d0d2fe5 tempest-VolumeImageDependencyTests-1489285573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:48 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:35:48 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-733c331b-09b3-46cf-bf47-bae451d3fee2 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d826c5c8-cfdc-4c60-96fe-4cfc45b47818 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:48 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d826c5c8-cfdc-4c60-96fe-4cfc45b47818 Jul 16 23:35:48 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:48 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9c4f4653-b0ef-4909-9395-9252cf78383f 1G" returned: 0 in 0.376s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:48 devstack cinder-volume[87607]: DEBUG cinder.volume.volume_utils [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Downloaded image a40cecb7-3df7-41e8-b02a-02f996da4ee2 ((None, [{'url': 'file:///opt/stack/data/glance/images/a40cecb7-3df7-41e8-b02a-02f996da4ee2', 'metadata': {}}])) to volume 9c4f4653-b0ef-4909-9395-9252cf78383f successfully. {{(pid=87607) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 16 23:35:48 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Temporary image a40cecb7-3df7-41e8-b02a-02f996da4ee2 for user 2ba678881c474bc98623ff764a3b4a10 is deleted. {{(pid=87607) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 16 23:35:48 devstack cinder-volume[87607]: DEBUG cinder.volume.volume_utils [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Marking volume 9c4f4653-b0ef-4909-9395-9252cf78383f as bootable. {{(pid=87607) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 16 23:35:48 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Copying metadata from image a40cecb7-3df7-41e8-b02a-02f996da4ee2 to 9c4f4653-b0ef-4909-9395-9252cf78383f. {{(pid=87607) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 16 23:35:48 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Creating volume glance metadata for volume 9c4f4653-b0ef-4909-9395-9252cf78383f backed by image a40cecb7-3df7-41e8-b02a-02f996da4ee2 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'a40cecb7-3df7-41e8-b02a-02f996da4ee2', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '19901a209367df03bb9ec0d73d325c0c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87607) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 16 23:35:48 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a73938e-c7e2-46af-95cb-868568d9af82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c4f4653-b0ef-4909-9395-9252cf78383f', 'volume_size': 1, 'image_id': 'a40cecb7-3df7-41e8-b02a-02f996da4ee2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a40cecb7-3df7-41e8-b02a-02f996da4ee2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '19901a209367df03bb9ec0d73d325c0c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c5003458c2014856a0f13542b0c0e216', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd22f09f477202543c2e137a88c7e4a10f08f81ed1c36d306b8fee51c1c815274a8dfd21b955af357238edbdb6320dc4815b262b0f810d1bc739c5b2698db3064', 'id': 'a40cecb7-3df7-41e8-b02a-02f996da4ee2', 'created_at': datetime.datetime(2026, 7, 16, 21, 35, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 21, 35, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a40cecb7-3df7-41e8-b02a-02f996da4ee2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:48 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3727f7bc-1542-4797-ac82-3fc78bc32767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:48 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Volume volume-9c4f4653-b0ef-4909-9395-9252cf78383f (9c4f4653-b0ef-4909-9395-9252cf78383f): created successfully Jul 16 23:35:49 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3727f7bc-1542-4797-ac82-3fc78bc32767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:49 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:49 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Flow 'volume_create_manager' (33f10f05-082b-4087-b9a5-38743a2cecb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:35:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8ac5fa66-a148-411b-8b78-6fa63d0d2fe5 tempest-VolumeImageDependencyTests-1489285573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.381s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:49 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-8ac5fa66-a148-411b-8b78-6fa63d0d2fe5 tempest-VolumeImageDependencyTests-1489285573 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:35:49 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-8ac5fa66-a148-411b-8b78-6fa63d0d2fe5 tempest-VolumeImageDependencyTests-1489285573 None] Deleted volume successfully. Jul 16 23:35:49 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-043a6f3a-0c17-406e-a81d-9bc051a3d53e tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Created volume successfully. Jul 16 23:35:49 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-8ac5fa66-a148-411b-8b78-6fa63d0d2fe5 tempest-VolumeImageDependencyTests-1489285573 None] Lock "cinder-a44dbcfa-f7de-4e4d-9336-ade4b656f83c-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:35:49 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-733c331b-09b3-46cf-bf47-bae451d3fee2 tempest-CreateVolumesFromSnapshotTest-1783062093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d826c5c8-cfdc-4c60-96fe-4cfc45b47818" returned: 0 in 0.404s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:49 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-733c331b-09b3-46cf-bf47-bae451d3fee2 tempest-CreateVolumesFromSnapshotTest-1783062093 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:35:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-733c331b-09b3-46cf-bf47-bae451d3fee2 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.559s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:49 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Acquiring lock "cinder-quobyte-ade476f3-8b9d-423a-8793-680f22ae83e8-6940b793-1287-4316-9d1b-8a689f13d164" by "_create_volume_from_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:35:49 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-733c331b-09b3-46cf-bf47-bae451d3fee2 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8b205b1-2378-4e38-a4bc-e2599170b569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d826c5c8-cfdc-4c60-96fe-4cfc45b47818', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:49 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-733c331b-09b3-46cf-bf47-bae451d3fee2 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4208828-425e-4ce5-bac2-71c3124ff10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:49 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Lock "cinder-quobyte-ade476f3-8b9d-423a-8793-680f22ae83e8-6940b793-1287-4316-9d1b-8a689f13d164" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:35:49 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Creating volume 6940b793-1287-4316-9d1b-8a689f13d164 from snapshot ade476f3-8b9d-423a-8793-680f22ae83e8 {{(pid=87607) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 16 23:35:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:49 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:35:49 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:35:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:49 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:35:49 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Acquiring lock "cinder-quobyte-6940b793-1287-4316-9d1b-8a689f13d164" by "_copy_volume_from_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:35:49 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-733c331b-09b3-46cf-bf47-bae451d3fee2 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Volume volume-d826c5c8-cfdc-4c60-96fe-4cfc45b47818 (d826c5c8-cfdc-4c60-96fe-4cfc45b47818): created successfully Jul 16 23:35:49 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-733c331b-09b3-46cf-bf47-bae451d3fee2 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4208828-425e-4ce5-bac2-71c3124ff10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:49 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-733c331b-09b3-46cf-bf47-bae451d3fee2 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Flow 'volume_create_manager' (6f8ffe99-c6b3-4ffb-8a91-9f072c7f415f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:35:49 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Lock "cinder-quobyte-6940b793-1287-4316-9d1b-8a689f13d164" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:35:49 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] snapshot: ade476f3-8b9d-423a-8793-680f22ae83e8, volume: 6940b793-1287-4316-9d1b-8a689f13d164, {{(pid=87607) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 16 23:35:49 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-733c331b-09b3-46cf-bf47-bae451d3fee2 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Created volume successfully. Jul 16 23:35:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:49 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:35:49 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:35:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:49 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f346ef9-9338-478a-a269-0f514d7ec270]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:35:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079.ade476f3-8b9d-423a-8793-680f22ae83e8 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:49 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079.ade476f3-8b9d-423a-8793-680f22ae83e8 Jul 16 23:35:49 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:49 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079.ade476f3-8b9d-423a-8793-680f22ae83e8" returned: 0 in 0.395s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:49 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce1cd0f9-0783-4251-9641-78a312cd2079(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:35:49 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079 {{(pid=87607) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 16 23:35:49 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Creating direct copy from snapshot {{(pid=87607) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 16 23:35:49 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a37a440-7d89-4051-b7e7-05b071f29355]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:35:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:49 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079 Jul 16 23:35:49 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:49 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-adaa839e-06ea-4ba1-b5d6-ca736c66c802 tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Acquiring lock "cinder-9c4f4653-b0ef-4909-9395-9252cf78383f-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:35:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-adaa839e-06ea-4ba1-b5d6-ca736c66c802 tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Lock "cinder-9c4f4653-b0ef-4909-9395-9252cf78383f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:35:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-adaa839e-06ea-4ba1-b5d6-ca736c66c802 tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Acquiring lock "cinder-quobyte-9c4f4653-b0ef-4909-9395-9252cf78383f" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:35:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-adaa839e-06ea-4ba1-b5d6-ca736c66c802 tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Lock "cinder-quobyte-9c4f4653-b0ef-4909-9395-9252cf78383f" acquired by "delete_volume" :: waited 0.035s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:35:50 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079" returned: 0 in 0.501s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:50 devstack cinder-volume[87607]: DEBUG cinder.utils [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Path /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6940b793-1287-4316-9d1b-8a689f13d164 not found in is_blk_device check {{(pid=87607) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 16 23:35:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6940b793-1287-4316-9d1b-8a689f13d164 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:50 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[e581292b-39f4-442e-8f81-f760ba5e9a91]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:35:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-adaa839e-06ea-4ba1-b5d6-ca736c66c802 tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9c4f4653-b0ef-4909-9395-9252cf78383f {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:50 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6940b793-1287-4316-9d1b-8a689f13d164 Jul 16 23:35:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-2184f172-1579-45b7-913f-b533be635ec9 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Acquiring lock "cinder-d826c5c8-cfdc-4c60-96fe-4cfc45b47818-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:35:50 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-2184f172-1579-45b7-913f-b533be635ec9 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "cinder-d826c5c8-cfdc-4c60-96fe-4cfc45b47818-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:35:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-2184f172-1579-45b7-913f-b533be635ec9 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Acquiring lock "cinder-quobyte-d826c5c8-cfdc-4c60-96fe-4cfc45b47818" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:35:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-2184f172-1579-45b7-913f-b533be635ec9 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "cinder-quobyte-d826c5c8-cfdc-4c60-96fe-4cfc45b47818" acquired by "delete_volume" :: waited 0.017s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:35:50 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d02e917-8226-48d8-9600-1e09ec6f3da1]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:35:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2184f172-1579-45b7-913f-b533be635ec9 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d826c5c8-cfdc-4c60-96fe-4cfc45b47818 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:50 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9c4f4653-b0ef-4909-9395-9252cf78383f Jul 16 23:35:50 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:50 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d826c5c8-cfdc-4c60-96fe-4cfc45b47818 Jul 16 23:35:50 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:50 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-adaa839e-06ea-4ba1-b5d6-ca736c66c802 tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9c4f4653-b0ef-4909-9395-9252cf78383f" returned: 0 in 0.527s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-adaa839e-06ea-4ba1-b5d6-ca736c66c802 tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9c4f4653-b0ef-4909-9395-9252cf78383f {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:50 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9c4f4653-b0ef-4909-9395-9252cf78383f Jul 16 23:35:50 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:50 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2184f172-1579-45b7-913f-b533be635ec9 tempest-CreateVolumesFromSnapshotTest-1783062093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d826c5c8-cfdc-4c60-96fe-4cfc45b47818" returned: 0 in 0.506s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2184f172-1579-45b7-913f-b533be635ec9 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d826c5c8-cfdc-4c60-96fe-4cfc45b47818 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:50 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d826c5c8-cfdc-4c60-96fe-4cfc45b47818 Jul 16 23:35:50 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:51 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-adaa839e-06ea-4ba1-b5d6-ca736c66c802 tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-9c4f4653-b0ef-4909-9395-9252cf78383f" returned: 0 in 0.780s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:51 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-adaa839e-06ea-4ba1-b5d6-ca736c66c802 tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Lock "cinder-quobyte-9c4f4653-b0ef-4909-9395-9252cf78383f" released by "delete_volume" :: held 1.434s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:35:51 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-adaa839e-06ea-4ba1-b5d6-ca736c66c802 tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Created reservations ['39aff698-5cc0-4817-adf3-72cf598f14ff', '5e8930d4-c57e-4877-a4f9-93644bc1babf', '3bf6c7ea-3282-4fdd-9f12-111a981be075', '84e550e3-f37d-46fd-b078-fd575cd2cb15'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:35:51 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2184f172-1579-45b7-913f-b533be635ec9 tempest-CreateVolumesFromSnapshotTest-1783062093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d826c5c8-cfdc-4c60-96fe-4cfc45b47818" returned: 0 in 0.912s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:51 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-2184f172-1579-45b7-913f-b533be635ec9 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "cinder-quobyte-d826c5c8-cfdc-4c60-96fe-4cfc45b47818" released by "delete_volume" :: held 1.498s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:35:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-adaa839e-06ea-4ba1-b5d6-ca736c66c802 tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-adaa839e-06ea-4ba1-b5d6-ca736c66c802 tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:51 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-adaa839e-06ea-4ba1-b5d6-ca736c66c802 tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:35:51 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-adaa839e-06ea-4ba1-b5d6-ca736c66c802 tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:35:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-adaa839e-06ea-4ba1-b5d6-ca736c66c802 tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-adaa839e-06ea-4ba1-b5d6-ca736c66c802 tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:51 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:35:51 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:52 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-2184f172-1579-45b7-913f-b533be635ec9 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Created reservations ['8bc337e1-97ab-47fb-876c-ca49a1b03c95', 'dda5a700-d14d-4ebc-ae6d-cc4f1d45de30', '21a442b4-74cb-456e-8af4-d4360eec9945', 'ad465769-a280-4f7a-8069-b90b19583e93'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:35:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-2184f172-1579-45b7-913f-b533be635ec9 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-2184f172-1579-45b7-913f-b533be635ec9 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:52 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-2184f172-1579-45b7-913f-b533be635ec9 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:35:52 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-2184f172-1579-45b7-913f-b533be635ec9 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:35:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-2184f172-1579-45b7-913f-b533be635ec9 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2184f172-1579-45b7-913f-b533be635ec9 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:52 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:35:52 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:52 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-adaa839e-06ea-4ba1-b5d6-ca736c66c802 tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.579s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:52 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-adaa839e-06ea-4ba1-b5d6-ca736c66c802 tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:35:52 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-adaa839e-06ea-4ba1-b5d6-ca736c66c802 tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Deleted volume successfully. Jul 16 23:35:52 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-adaa839e-06ea-4ba1-b5d6-ca736c66c802 tempest-VolumeAndVolumeTypeFromImageTest-1065787561 None] Lock "cinder-9c4f4653-b0ef-4909-9395-9252cf78383f-delete_volume" released by "delete_volume" :: held 2.591s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:35:52 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-5e95d82d-3ecb-4df0-b83f-b7b419263734 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Acquiring lock "cinder-6061a061-87e8-4faa-a773-9a98e7d74e4f-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:35:52 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-5e95d82d-3ecb-4df0-b83f-b7b419263734 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "cinder-6061a061-87e8-4faa-a773-9a98e7d74e4f-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:35:52 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2184f172-1579-45b7-913f-b533be635ec9 tempest-CreateVolumesFromSnapshotTest-1783062093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.692s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:52 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-2184f172-1579-45b7-913f-b533be635ec9 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:35:52 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-2184f172-1579-45b7-913f-b533be635ec9 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Deleted volume successfully. Jul 16 23:35:52 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-5e95d82d-3ecb-4df0-b83f-b7b419263734 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Acquiring lock "cinder-quobyte-6061a061-87e8-4faa-a773-9a98e7d74e4f" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:35:53 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-5e95d82d-3ecb-4df0-b83f-b7b419263734 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "cinder-quobyte-6061a061-87e8-4faa-a773-9a98e7d74e4f" acquired by "delete_volume" :: waited 0.042s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:35:53 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-2184f172-1579-45b7-913f-b533be635ec9 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "cinder-d826c5c8-cfdc-4c60-96fe-4cfc45b47818-delete_volume" released by "delete_volume" :: held 2.844s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:35:53 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8564fc-df99-4718-b357-eb43557d125b]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:35:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5e95d82d-3ecb-4df0-b83f-b7b419263734 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6061a061-87e8-4faa-a773-9a98e7d74e4f {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:53 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6061a061-87e8-4faa-a773-9a98e7d74e4f Jul 16 23:35:53 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:54 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5e95d82d-3ecb-4df0-b83f-b7b419263734 tempest-CreateVolumesFromSnapshotTest-1783062093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6061a061-87e8-4faa-a773-9a98e7d74e4f" returned: 0 in 0.944s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5e95d82d-3ecb-4df0-b83f-b7b419263734 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6061a061-87e8-4faa-a773-9a98e7d74e4f {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:54 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6061a061-87e8-4faa-a773-9a98e7d74e4f Jul 16 23:35:54 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:54 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5e95d82d-3ecb-4df0-b83f-b7b419263734 tempest-CreateVolumesFromSnapshotTest-1783062093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6061a061-87e8-4faa-a773-9a98e7d74e4f" returned: 0 in 0.591s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:54 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-5e95d82d-3ecb-4df0-b83f-b7b419263734 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "cinder-quobyte-6061a061-87e8-4faa-a773-9a98e7d74e4f" released by "delete_volume" :: held 1.679s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:35:54 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-5e95d82d-3ecb-4df0-b83f-b7b419263734 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Created reservations ['d3bde806-7cd3-4ae6-a5b1-56fab65f26d5', '0fbd4645-a902-4127-b303-71a42766012b', '6f7fa6ac-7dda-42f1-bf89-35417673c1c3', 'b36c9bbe-0213-45e2-9abc-51b1a2863e12'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:35:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5e95d82d-3ecb-4df0-b83f-b7b419263734 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5e95d82d-3ecb-4df0-b83f-b7b419263734 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:55 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-5e95d82d-3ecb-4df0-b83f-b7b419263734 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:35:55 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-5e95d82d-3ecb-4df0-b83f-b7b419263734 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:35:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5e95d82d-3ecb-4df0-b83f-b7b419263734 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5e95d82d-3ecb-4df0-b83f-b7b419263734 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:55 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:35:55 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:55 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4c0b95f9-a06d-4c1d-8786-8172cb524b75 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Acquiring lock "cinder-7fde4a47-5db5-4faf-8717-91bb27b044e0-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:35:55 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4c0b95f9-a06d-4c1d-8786-8172cb524b75 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "cinder-7fde4a47-5db5-4faf-8717-91bb27b044e0-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:35:55 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4c0b95f9-a06d-4c1d-8786-8172cb524b75 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Acquiring lock "cinder-quobyte-7fde4a47-5db5-4faf-8717-91bb27b044e0" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:35:55 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4c0b95f9-a06d-4c1d-8786-8172cb524b75 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "cinder-quobyte-7fde4a47-5db5-4faf-8717-91bb27b044e0" acquired by "delete_volume" :: waited 0.021s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:35:55 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ea0613-d8ac-4241-ab1f-703ad6b38ca5]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:35:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4c0b95f9-a06d-4c1d-8786-8172cb524b75 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7fde4a47-5db5-4faf-8717-91bb27b044e0 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:55 devstack sudo[106342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7fde4a47-5db5-4faf-8717-91bb27b044e0 Jul 16 23:35:55 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:55 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5e95d82d-3ecb-4df0-b83f-b7b419263734 tempest-CreateVolumesFromSnapshotTest-1783062093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.866s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:55 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-5e95d82d-3ecb-4df0-b83f-b7b419263734 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:35:55 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-5e95d82d-3ecb-4df0-b83f-b7b419263734 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Deleted volume successfully. Jul 16 23:35:56 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-5e95d82d-3ecb-4df0-b83f-b7b419263734 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "cinder-6061a061-87e8-4faa-a773-9a98e7d74e4f-delete_volume" released by "delete_volume" :: held 3.165s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:35:56 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4c0b95f9-a06d-4c1d-8786-8172cb524b75 tempest-CreateVolumesFromSnapshotTest-1783062093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7fde4a47-5db5-4faf-8717-91bb27b044e0" returned: 0 in 0.821s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4c0b95f9-a06d-4c1d-8786-8172cb524b75 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7fde4a47-5db5-4faf-8717-91bb27b044e0 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:56 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6940b793-1287-4316-9d1b-8a689f13d164" returned: 0 in 6.258s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:56 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7fde4a47-5db5-4faf-8717-91bb27b044e0 Jul 16 23:35:56 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:56 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[829d7893-7b87-4242-9a54-f038c9b0e3c3]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:35:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:56 devstack sudo[106350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079 Jul 16 23:35:56 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:56 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a140e2d9-7c5c-4741-bc5a-37fd29e8537a tempest-ProjectAdminTests-2055014804 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87607) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 16 23:35:56 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4c0b95f9-a06d-4c1d-8786-8172cb524b75 tempest-CreateVolumesFromSnapshotTest-1783062093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7fde4a47-5db5-4faf-8717-91bb27b044e0" returned: 0 in 0.384s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:56 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4c0b95f9-a06d-4c1d-8786-8172cb524b75 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "cinder-quobyte-7fde4a47-5db5-4faf-8717-91bb27b044e0" released by "delete_volume" :: held 1.293s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:35:56 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-4c0b95f9-a06d-4c1d-8786-8172cb524b75 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Created reservations ['6ebb242c-8a3f-4965-8bde-2a2d3baf0ab3', '8bbff81b-cc47-4497-a1e5-8e4f3d6d674f', '4089f8c2-0047-456c-ad77-a40565fb5560', 'f5e5feb1-6dcd-4797-a760-64a8b8c4d214'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:35:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4c0b95f9-a06d-4c1d-8786-8172cb524b75 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4c0b95f9-a06d-4c1d-8786-8172cb524b75 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:56 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4c0b95f9-a06d-4c1d-8786-8172cb524b75 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:35:56 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4c0b95f9-a06d-4c1d-8786-8172cb524b75 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:35:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4c0b95f9-a06d-4c1d-8786-8172cb524b75 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4c0b95f9-a06d-4c1d-8786-8172cb524b75 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:57 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:35:57 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:57 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079" returned: 0 in 0.681s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:57 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Image conversion details: src /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079, size 1024.00 MB, duration 6.26 sec, destination /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6940b793-1287-4316-9d1b-8a689f13d164 {{(pid=87607) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 23:35:57 devstack cinder-volume[87607]: INFO cinder.image.image_utils [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Converted 1024.00 MB image at 163.60 MB/s Jul 16 23:35:57 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6940b793-1287-4316-9d1b-8a689f13d164 is being set with open permissions: ugo+rw Jul 16 23:35:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6940b793-1287-4316-9d1b-8a689f13d164 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:57 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6940b793-1287-4316-9d1b-8a689f13d164 Jul 16 23:35:57 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:57 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4c0b95f9-a06d-4c1d-8786-8172cb524b75 tempest-CreateVolumesFromSnapshotTest-1783062093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.327s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:57 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-4c0b95f9-a06d-4c1d-8786-8172cb524b75 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:35:57 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-4c0b95f9-a06d-4c1d-8786-8172cb524b75 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Deleted volume successfully. Jul 16 23:35:57 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4c0b95f9-a06d-4c1d-8786-8172cb524b75 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "cinder-7fde4a47-5db5-4faf-8717-91bb27b044e0-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:35:57 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6940b793-1287-4316-9d1b-8a689f13d164" returned: 0 in 0.311s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:57 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Lock "cinder-quobyte-6940b793-1287-4316-9d1b-8a689f13d164" released by "_copy_volume_from_snapshot" :: held 8.268s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:35:57 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Lock "cinder-quobyte-ade476f3-8b9d-423a-8793-680f22ae83e8-6940b793-1287-4316-9d1b-8a689f13d164" released by "_create_volume_from_snapshot" :: held 8.320s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:35:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.351s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:57 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3200fa2e-d2ff-4163-9e19-9190a7a812c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6940b793-1287-4316-9d1b-8a689f13d164', 'volume_size': 1, 'snapshot_id': 'ade476f3-8b9d-423a-8793-680f22ae83e8'}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:57 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27021f45-9b1d-4b16-87ee-0e50e9f4140e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:35:57 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Volume volume-6940b793-1287-4316-9d1b-8a689f13d164 (6940b793-1287-4316-9d1b-8a689f13d164): created successfully Jul 16 23:35:57 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27021f45-9b1d-4b16-87ee-0e50e9f4140e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:35:57 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Flow 'volume_create_manager' (4add3130-419d-402d-a774-277858c617e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:35:57 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-39c9489c-346a-4bd3-8e2f-b501bfe3b6c5 tempest-VolumeDependencyTests-490071870 None] Created volume successfully. Jul 16 23:35:57 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e35fa1f3-7178-4805-a73c-07708b32d84c tempest-VolumeDependencyTests-490071870 None] Acquiring lock "cinder-ade476f3-8b9d-423a-8793-680f22ae83e8-delete_snapshot" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:35:57 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e35fa1f3-7178-4805-a73c-07708b32d84c tempest-VolumeDependencyTests-490071870 None] Lock "cinder-ade476f3-8b9d-423a-8793-680f22ae83e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:35:57 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e35fa1f3-7178-4805-a73c-07708b32d84c tempest-VolumeDependencyTests-490071870 None] Acquiring lock "cinder-quobyte-ce1cd0f9-0783-4251-9641-78a312cd2079" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:35:57 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e35fa1f3-7178-4805-a73c-07708b32d84c tempest-VolumeDependencyTests-490071870 None] Lock "cinder-quobyte-ce1cd0f9-0783-4251-9641-78a312cd2079" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:35:57 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e35fa1f3-7178-4805-a73c-07708b32d84c tempest-VolumeDependencyTests-490071870 None] Acquiring lock "cinder-quobyte-ade476f3-8b9d-423a-8793-680f22ae83e8" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:35:57 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-2603ba77-15d7-43ac-8bf8-49d17b2430e8 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Acquiring lock "cinder-f005a79d-2248-4585-a36b-7054820e51bf-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:35:57 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e35fa1f3-7178-4805-a73c-07708b32d84c tempest-VolumeDependencyTests-490071870 None] Lock "cinder-quobyte-ade476f3-8b9d-423a-8793-680f22ae83e8" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:35:57 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-e35fa1f3-7178-4805-a73c-07708b32d84c tempest-VolumeDependencyTests-490071870 None] Deleting offline snapshot ade476f3-8b9d-423a-8793-680f22ae83e8 of volume ce1cd0f9-0783-4251-9641-78a312cd2079 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:35:57 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-e35fa1f3-7178-4805-a73c-07708b32d84c tempest-VolumeDependencyTests-490071870 None] snapshot_file for this snap is: volume-ce1cd0f9-0783-4251-9641-78a312cd2079.ade476f3-8b9d-423a-8793-680f22ae83e8 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:35:57 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-2603ba77-15d7-43ac-8bf8-49d17b2430e8 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "cinder-f005a79d-2248-4585-a36b-7054820e51bf-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:35:57 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[29891e1e-4fdc-4f8c-9ba1-c364cd01222c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:35:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e35fa1f3-7178-4805-a73c-07708b32d84c tempest-VolumeDependencyTests-490071870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079.ade476f3-8b9d-423a-8793-680f22ae83e8 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:57 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-2603ba77-15d7-43ac-8bf8-49d17b2430e8 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Acquiring lock "cinder-quobyte-f005a79d-2248-4585-a36b-7054820e51bf" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:35:57 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-2603ba77-15d7-43ac-8bf8-49d17b2430e8 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "cinder-quobyte-f005a79d-2248-4585-a36b-7054820e51bf" acquired by "delete_volume" :: waited 0.027s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:35:58 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd55886a-6059-48c4-a4d9-b98b05f1ca1a]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:35:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2603ba77-15d7-43ac-8bf8-49d17b2430e8 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f005a79d-2248-4585-a36b-7054820e51bf {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:58 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079.ade476f3-8b9d-423a-8793-680f22ae83e8 Jul 16 23:35:58 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:58 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f005a79d-2248-4585-a36b-7054820e51bf Jul 16 23:35:58 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:58 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e35fa1f3-7178-4805-a73c-07708b32d84c tempest-VolumeDependencyTests-490071870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079.ade476f3-8b9d-423a-8793-680f22ae83e8" returned: 0 in 0.474s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:58 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-e35fa1f3-7178-4805-a73c-07708b32d84c tempest-VolumeDependencyTests-490071870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce1cd0f9-0783-4251-9641-78a312cd2079(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:35:58 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[47dc67e5-cd9c-4313-9288-d3cbe746bd1a]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:35:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e35fa1f3-7178-4805-a73c-07708b32d84c tempest-VolumeDependencyTests-490071870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:58 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2603ba77-15d7-43ac-8bf8-49d17b2430e8 tempest-CreateVolumesFromSnapshotTest-1783062093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f005a79d-2248-4585-a36b-7054820e51bf" returned: 0 in 0.480s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2603ba77-15d7-43ac-8bf8-49d17b2430e8 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f005a79d-2248-4585-a36b-7054820e51bf {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:58 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079 Jul 16 23:35:58 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:58 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f005a79d-2248-4585-a36b-7054820e51bf Jul 16 23:35:58 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:58 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2603ba77-15d7-43ac-8bf8-49d17b2430e8 tempest-CreateVolumesFromSnapshotTest-1783062093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f005a79d-2248-4585-a36b-7054820e51bf" returned: 0 in 0.287s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:58 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-2603ba77-15d7-43ac-8bf8-49d17b2430e8 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "cinder-quobyte-f005a79d-2248-4585-a36b-7054820e51bf" released by "delete_volume" :: held 0.822s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:35:58 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e35fa1f3-7178-4805-a73c-07708b32d84c tempest-VolumeDependencyTests-490071870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079" returned: 0 in 0.486s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e35fa1f3-7178-4805-a73c-07708b32d84c tempest-VolumeDependencyTests-490071870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079.ade476f3-8b9d-423a-8793-680f22ae83e8 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:58 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-2603ba77-15d7-43ac-8bf8-49d17b2430e8 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Created reservations ['54f1ac88-d11e-425a-8c42-16e3e0421084', '5ac144fe-8d01-47ac-be45-162dc3f2349c', '046647ab-e62f-4969-b32d-6378fe844a7f', 'cbbc6c9f-2fb7-42a0-8b71-413d13f15ad2'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:35:58 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079.ade476f3-8b9d-423a-8793-680f22ae83e8 Jul 16 23:35:58 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-2603ba77-15d7-43ac-8bf8-49d17b2430e8 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:35:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-2603ba77-15d7-43ac-8bf8-49d17b2430e8 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:35:59 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-2603ba77-15d7-43ac-8bf8-49d17b2430e8 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:35:59 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-2603ba77-15d7-43ac-8bf8-49d17b2430e8 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:35:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-2603ba77-15d7-43ac-8bf8-49d17b2430e8 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:35:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2603ba77-15d7-43ac-8bf8-49d17b2430e8 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:59 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:35:59 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:59 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2603ba77-15d7-43ac-8bf8-49d17b2430e8 tempest-CreateVolumesFromSnapshotTest-1783062093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.307s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:59 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-2603ba77-15d7-43ac-8bf8-49d17b2430e8 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:35:59 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-2603ba77-15d7-43ac-8bf8-49d17b2430e8 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Deleted volume successfully. Jul 16 23:35:59 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e35fa1f3-7178-4805-a73c-07708b32d84c tempest-VolumeDependencyTests-490071870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079.ade476f3-8b9d-423a-8793-680f22ae83e8" returned: 0 in 0.470s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e35fa1f3-7178-4805-a73c-07708b32d84c tempest-VolumeDependencyTests-490071870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079.ade476f3-8b9d-423a-8793-680f22ae83e8 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:35:59 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-2603ba77-15d7-43ac-8bf8-49d17b2430e8 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "cinder-f005a79d-2248-4585-a36b-7054820e51bf-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:35:59 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079.ade476f3-8b9d-423a-8793-680f22ae83e8 Jul 16 23:35:59 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:35:59 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Jul 16 23:35:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e35fa1f3-7178-4805-a73c-07708b32d84c tempest-VolumeDependencyTests-490071870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079.ade476f3-8b9d-423a-8793-680f22ae83e8" returned: 0 in 0.273s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:35:59 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e35fa1f3-7178-4805-a73c-07708b32d84c tempest-VolumeDependencyTests-490071870 None] Lock "cinder-quobyte-ade476f3-8b9d-423a-8793-680f22ae83e8" released by "_delete_snapshot" :: held 1.851s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:35:59 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e35fa1f3-7178-4805-a73c-07708b32d84c tempest-VolumeDependencyTests-490071870 None] Lock "cinder-quobyte-ce1cd0f9-0783-4251-9641-78a312cd2079" released by "delete_snapshot" :: held 1.890s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:35:59 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-e35fa1f3-7178-4805-a73c-07708b32d84c tempest-VolumeDependencyTests-490071870 None] Created reservations ['1486c4b4-0310-4876-bfa4-7bc0636bffce', '71cf1c6d-ab2c-4cd1-a891-0eed84e3c3ad', 'aa830275-1ae6-4bfc-87df-a217fb47fb45', 'eef25454-c08c-44ce-b1d3-a99158dc8f27'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:35:59 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-e35fa1f3-7178-4805-a73c-07708b32d84c tempest-VolumeDependencyTests-490071870 None] Delete snapshot completed successfully. Jul 16 23:35:59 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e35fa1f3-7178-4805-a73c-07708b32d84c tempest-VolumeDependencyTests-490071870 None] Lock "cinder-ade476f3-8b9d-423a-8793-680f22ae83e8-delete_snapshot" released by "delete_snapshot" :: held 2.062s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:35:59 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ec3ed422-346d-48b7-8d46-74b999e857ea tempest-VolumeDependencyTests-490071870 None] Acquiring lock "cinder-ce1cd0f9-0783-4251-9641-78a312cd2079-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:35:59 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ec3ed422-346d-48b7-8d46-74b999e857ea tempest-VolumeDependencyTests-490071870 None] Lock "cinder-ce1cd0f9-0783-4251-9641-78a312cd2079-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:00 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ec3ed422-346d-48b7-8d46-74b999e857ea tempest-VolumeDependencyTests-490071870 None] Acquiring lock "cinder-quobyte-ce1cd0f9-0783-4251-9641-78a312cd2079" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:00 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ec3ed422-346d-48b7-8d46-74b999e857ea tempest-VolumeDependencyTests-490071870 None] Lock "cinder-quobyte-ce1cd0f9-0783-4251-9641-78a312cd2079" acquired by "delete_volume" :: waited 0.019s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:00 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea9ed4b-b9b5-436f-92cd-b973e252df80]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:36:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ec3ed422-346d-48b7-8d46-74b999e857ea tempest-VolumeDependencyTests-490071870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:00 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-5e933002-7983-4e6b-aebc-e3c800da77cd tempest-CreateVolumesFromSnapshotTest-1783062093 None] Acquiring lock "cinder-8914b56a-e0c5-45d3-8add-abea79b4d793-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:00 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-5e933002-7983-4e6b-aebc-e3c800da77cd tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "cinder-8914b56a-e0c5-45d3-8add-abea79b4d793-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:00 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-5e933002-7983-4e6b-aebc-e3c800da77cd tempest-CreateVolumesFromSnapshotTest-1783062093 None] Acquiring lock "cinder-quobyte-8914b56a-e0c5-45d3-8add-abea79b4d793" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:00 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-5e933002-7983-4e6b-aebc-e3c800da77cd tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "cinder-quobyte-8914b56a-e0c5-45d3-8add-abea79b4d793" acquired by "delete_volume" :: waited 0.016s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:00 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[5feb1f92-99da-4fcb-849e-c692cdd425b0]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:36:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5e933002-7983-4e6b-aebc-e3c800da77cd tempest-CreateVolumesFromSnapshotTest-1783062093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8914b56a-e0c5-45d3-8add-abea79b4d793 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:00 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079 Jul 16 23:36:00 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:00 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8914b56a-e0c5-45d3-8add-abea79b4d793 Jul 16 23:36:00 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:00 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ec3ed422-346d-48b7-8d46-74b999e857ea tempest-VolumeDependencyTests-490071870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079" returned: 0 in 0.490s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ec3ed422-346d-48b7-8d46-74b999e857ea tempest-VolumeDependencyTests-490071870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:00 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079 Jul 16 23:36:00 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:00 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5e933002-7983-4e6b-aebc-e3c800da77cd tempest-CreateVolumesFromSnapshotTest-1783062093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8914b56a-e0c5-45d3-8add-abea79b4d793" returned: 0 in 0.447s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5e933002-7983-4e6b-aebc-e3c800da77cd tempest-CreateVolumesFromSnapshotTest-1783062093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8914b56a-e0c5-45d3-8add-abea79b4d793 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:00 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8914b56a-e0c5-45d3-8add-abea79b4d793 Jul 16 23:36:00 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:00 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ec3ed422-346d-48b7-8d46-74b999e857ea tempest-VolumeDependencyTests-490071870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ce1cd0f9-0783-4251-9641-78a312cd2079" returned: 0 in 0.294s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:00 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ec3ed422-346d-48b7-8d46-74b999e857ea tempest-VolumeDependencyTests-490071870 None] Lock "cinder-quobyte-ce1cd0f9-0783-4251-9641-78a312cd2079" released by "delete_volume" :: held 0.903s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-ec3ed422-346d-48b7-8d46-74b999e857ea tempest-VolumeDependencyTests-490071870 None] Created reservations ['be33a549-8b12-4350-852d-5047af5c22c3', 'efec80da-aa3e-433d-b6f1-e3621df9f0ef', 'd4c922e8-d605-4683-a35f-5a12a60f4232', '37071975-d93e-436c-bb7f-4fa55f9266ea'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:36:01 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5e933002-7983-4e6b-aebc-e3c800da77cd tempest-CreateVolumesFromSnapshotTest-1783062093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8914b56a-e0c5-45d3-8add-abea79b4d793" returned: 0 in 0.377s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-5e933002-7983-4e6b-aebc-e3c800da77cd tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "cinder-quobyte-8914b56a-e0c5-45d3-8add-abea79b4d793" released by "delete_volume" :: held 0.891s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ec3ed422-346d-48b7-8d46-74b999e857ea tempest-VolumeDependencyTests-490071870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ec3ed422-346d-48b7-8d46-74b999e857ea tempest-VolumeDependencyTests-490071870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ec3ed422-346d-48b7-8d46-74b999e857ea tempest-VolumeDependencyTests-490071870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ec3ed422-346d-48b7-8d46-74b999e857ea tempest-VolumeDependencyTests-490071870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ec3ed422-346d-48b7-8d46-74b999e857ea tempest-VolumeDependencyTests-490071870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ec3ed422-346d-48b7-8d46-74b999e857ea tempest-VolumeDependencyTests-490071870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:01 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:36:01 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-5e933002-7983-4e6b-aebc-e3c800da77cd tempest-CreateVolumesFromSnapshotTest-1783062093 None] Created reservations ['b47ceec2-5a72-451a-8044-15fec863758c', '25a74b73-c99a-453e-bc9b-9d5848f4e62e', '02b80c75-aa09-4757-b7ba-0a7b9addd6e1', '1487d404-7656-4c6c-9b05-4bbb34385099'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-0acec6e8-fbcf-41fb-8200-d41c28240a11 tempest-CreateVolumesFromImageTest-1017882793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0acec6e8-fbcf-41fb-8200-d41c28240a11 tempest-CreateVolumesFromImageTest-1017882793 None] Flow 'volume_create_manager' (7e5be081-2c51-42fe-a7de-c3ec6fafa022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0acec6e8-fbcf-41fb-8200-d41c28240a11 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89eb608f-45df-4229-9ce9-faf10eeb4432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0acec6e8-fbcf-41fb-8200-d41c28240a11 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89eb608f-45df-4229-9ce9-faf10eeb4432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-805351120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f988a10-3b8e-404e-b798-65233272d5d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52252d56a4c8420783013221b7d94aae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:36:01Z,use_quota=True,user_id='c9e1f1151d084cc595d56fb6596027db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0acec6e8-fbcf-41fb-8200-d41c28240a11 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79f839f6-7415-4c3d-9351-eeee8289b1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0acec6e8-fbcf-41fb-8200-d41c28240a11 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79f839f6-7415-4c3d-9351-eeee8289b1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0acec6e8-fbcf-41fb-8200-d41c28240a11 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffbd5850-d864-4b8e-9ce3-d5f908b8c4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0acec6e8-fbcf-41fb-8200-d41c28240a11 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffbd5850-d864-4b8e-9ce3-d5f908b8c4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f988a10-3b8e-404e-b798-65233272d5d4', 'volume_name': 'volume-8f988a10-3b8e-404e-b798-65233272d5d4', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0acec6e8-fbcf-41fb-8200-d41c28240a11 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0f27fa7-e7fb-4424-bd87-5105761134b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0acec6e8-fbcf-41fb-8200-d41c28240a11 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0f27fa7-e7fb-4424-bd87-5105761134b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0acec6e8-fbcf-41fb-8200-d41c28240a11 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eaafc08-6518-436e-a2fd-11620f9c4651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:01 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-0acec6e8-fbcf-41fb-8200-d41c28240a11 tempest-CreateVolumesFromImageTest-1017882793 None] Volume 8f988a10-3b8e-404e-b798-65233272d5d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f988a10-3b8e-404e-b798-65233272d5d4', 'volume_size': 1} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0acec6e8-fbcf-41fb-8200-d41c28240a11 tempest-CreateVolumesFromImageTest-1017882793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0acec6e8-fbcf-41fb-8200-d41c28240a11 tempest-CreateVolumesFromImageTest-1017882793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0acec6e8-fbcf-41fb-8200-d41c28240a11 tempest-CreateVolumesFromImageTest-1017882793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-805351120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f988a10-3b8e-404e-b798-65233272d5d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52252d56a4c8420783013221b7d94aae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:36:01Z,use_quota=True,user_id='c9e1f1151d084cc595d56fb6596027db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-0acec6e8-fbcf-41fb-8200-d41c28240a11 tempest-CreateVolumesFromImageTest-1017882793 None] Creating volume 8f988a10-3b8e-404e-b798-65233272d5d4 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0acec6e8-fbcf-41fb-8200-d41c28240a11 tempest-CreateVolumesFromImageTest-1017882793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0acec6e8-fbcf-41fb-8200-d41c28240a11 tempest-CreateVolumesFromImageTest-1017882793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0acec6e8-fbcf-41fb-8200-d41c28240a11 tempest-CreateVolumesFromImageTest-1017882793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0acec6e8-fbcf-41fb-8200-d41c28240a11 tempest-CreateVolumesFromImageTest-1017882793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0acec6e8-fbcf-41fb-8200-d41c28240a11 tempest-CreateVolumesFromImageTest-1017882793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0acec6e8-fbcf-41fb-8200-d41c28240a11 tempest-CreateVolumesFromImageTest-1017882793 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:36:01 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-0acec6e8-fbcf-41fb-8200-d41c28240a11 tempest-CreateVolumesFromImageTest-1017882793 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0acec6e8-fbcf-41fb-8200-d41c28240a11 tempest-CreateVolumesFromImageTest-1017882793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8f988a10-3b8e-404e-b798-65233272d5d4 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:01 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8f988a10-3b8e-404e-b798-65233272d5d4 1073741824 Jul 16 23:36:01 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5e933002-7983-4e6b-aebc-e3c800da77cd tempest-CreateVolumesFromSnapshotTest-1783062093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5e933002-7983-4e6b-aebc-e3c800da77cd tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-5e933002-7983-4e6b-aebc-e3c800da77cd tempest-CreateVolumesFromSnapshotTest-1783062093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-5e933002-7983-4e6b-aebc-e3c800da77cd tempest-CreateVolumesFromSnapshotTest-1783062093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5e933002-7983-4e6b-aebc-e3c800da77cd tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5e933002-7983-4e6b-aebc-e3c800da77cd tempest-CreateVolumesFromSnapshotTest-1783062093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:01 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:36:01 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:01 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ec3ed422-346d-48b7-8d46-74b999e857ea tempest-VolumeDependencyTests-490071870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.483s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-ec3ed422-346d-48b7-8d46-74b999e857ea tempest-VolumeDependencyTests-490071870 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:36:01 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-ec3ed422-346d-48b7-8d46-74b999e857ea tempest-VolumeDependencyTests-490071870 None] Deleted volume successfully. Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4614a7b4-f710-4db4-86eb-a182625fcce0 tempest-VolumeDependencyTests-490071870 None] Acquiring lock "cinder-6940b793-1287-4316-9d1b-8a689f13d164-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ec3ed422-346d-48b7-8d46-74b999e857ea tempest-VolumeDependencyTests-490071870 None] Lock "cinder-ce1cd0f9-0783-4251-9641-78a312cd2079-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4614a7b4-f710-4db4-86eb-a182625fcce0 tempest-VolumeDependencyTests-490071870 None] Lock "cinder-6940b793-1287-4316-9d1b-8a689f13d164-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4614a7b4-f710-4db4-86eb-a182625fcce0 tempest-VolumeDependencyTests-490071870 None] Acquiring lock "cinder-quobyte-6940b793-1287-4316-9d1b-8a689f13d164" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4614a7b4-f710-4db4-86eb-a182625fcce0 tempest-VolumeDependencyTests-490071870 None] Lock "cinder-quobyte-6940b793-1287-4316-9d1b-8a689f13d164" acquired by "delete_volume" :: waited 0.022s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:01 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5e933002-7983-4e6b-aebc-e3c800da77cd tempest-CreateVolumesFromSnapshotTest-1783062093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.337s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-5e933002-7983-4e6b-aebc-e3c800da77cd tempest-CreateVolumesFromSnapshotTest-1783062093 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:36:01 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-5e933002-7983-4e6b-aebc-e3c800da77cd tempest-CreateVolumesFromSnapshotTest-1783062093 None] Deleted volume successfully. Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32c5fe1-17c1-403f-b995-3219cfead369]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4614a7b4-f710-4db4-86eb-a182625fcce0 tempest-VolumeDependencyTests-490071870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6940b793-1287-4316-9d1b-8a689f13d164 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f87d606b-0113-4f6f-bd97-fa2aa3d7bf89 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Acquiring lock "cinder-3ccb9c91-2657-4e01-9178-4bbe09d5fd05-delete_snapshot" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-5e933002-7983-4e6b-aebc-e3c800da77cd tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "cinder-8914b56a-e0c5-45d3-8add-abea79b4d793-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f87d606b-0113-4f6f-bd97-fa2aa3d7bf89 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "cinder-3ccb9c91-2657-4e01-9178-4bbe09d5fd05-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f87d606b-0113-4f6f-bd97-fa2aa3d7bf89 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Acquiring lock "cinder-quobyte-533de4c3-1c21-4eb0-8575-28f23aaf766d" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f87d606b-0113-4f6f-bd97-fa2aa3d7bf89 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "cinder-quobyte-533de4c3-1c21-4eb0-8575-28f23aaf766d" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f87d606b-0113-4f6f-bd97-fa2aa3d7bf89 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Acquiring lock "cinder-quobyte-3ccb9c91-2657-4e01-9178-4bbe09d5fd05" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f87d606b-0113-4f6f-bd97-fa2aa3d7bf89 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "cinder-quobyte-3ccb9c91-2657-4e01-9178-4bbe09d5fd05" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:01 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-f87d606b-0113-4f6f-bd97-fa2aa3d7bf89 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Deleting offline snapshot 3ccb9c91-2657-4e01-9178-4bbe09d5fd05 of volume 533de4c3-1c21-4eb0-8575-28f23aaf766d {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:36:02 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-f87d606b-0113-4f6f-bd97-fa2aa3d7bf89 tempest-CreateVolumesFromSnapshotTest-1783062093 None] snapshot_file for this snap is: volume-533de4c3-1c21-4eb0-8575-28f23aaf766d.3ccb9c91-2657-4e01-9178-4bbe09d5fd05 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:36:02 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[772bc032-fa7f-480a-963e-24b1c4e3e9c9]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:36:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f87d606b-0113-4f6f-bd97-fa2aa3d7bf89 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d.3ccb9c91-2657-4e01-9178-4bbe09d5fd05 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:02 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6940b793-1287-4316-9d1b-8a689f13d164 Jul 16 23:36:02 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:02 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d.3ccb9c91-2657-4e01-9178-4bbe09d5fd05 Jul 16 23:36:02 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:02 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0acec6e8-fbcf-41fb-8200-d41c28240a11 tempest-CreateVolumesFromImageTest-1017882793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8f988a10-3b8e-404e-b798-65233272d5d4 1073741824" returned: 0 in 1.010s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:02 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4614a7b4-f710-4db4-86eb-a182625fcce0 tempest-VolumeDependencyTests-490071870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6940b793-1287-4316-9d1b-8a689f13d164" returned: 0 in 0.667s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4614a7b4-f710-4db4-86eb-a182625fcce0 tempest-VolumeDependencyTests-490071870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6940b793-1287-4316-9d1b-8a689f13d164 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0acec6e8-fbcf-41fb-8200-d41c28240a11 tempest-CreateVolumesFromImageTest-1017882793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8f988a10-3b8e-404e-b798-65233272d5d4 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:02 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8f988a10-3b8e-404e-b798-65233272d5d4 Jul 16 23:36:02 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:02 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6940b793-1287-4316-9d1b-8a689f13d164 Jul 16 23:36:02 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:02 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bb17ba7-e0e7-4fff-886e-9d844e1c12b6 tempest-ProjectMemberTests-1023405772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:36:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4bb17ba7-e0e7-4fff-886e-9d844e1c12b6 tempest-ProjectMemberTests-1023405772 None] Flow 'volume_create_manager' (b0d1df49-08fc-4e9b-91b7-c58fa6dca6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:36:02 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4bb17ba7-e0e7-4fff-886e-9d844e1c12b6 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d3b841e-aa6f-4e73-b1ae-60454df7626b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f87d606b-0113-4f6f-bd97-fa2aa3d7bf89 tempest-CreateVolumesFromSnapshotTest-1783062093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d.3ccb9c91-2657-4e01-9178-4bbe09d5fd05" returned: 0 in 0.896s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:02 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-f87d606b-0113-4f6f-bd97-fa2aa3d7bf89 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-533de4c3-1c21-4eb0-8575-28f23aaf766d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:36:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4bb17ba7-e0e7-4fff-886e-9d844e1c12b6 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d3b841e-aa6f-4e73-b1ae-60454df7626b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-232932615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e245bb89-22e4-4e73-98f8-a8578619077b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b14a0052f8fb4344b121d3a20292b053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:36:02Z,use_quota=True,user_id='faa7527cbba84668895a85e3faa36efb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4bb17ba7-e0e7-4fff-886e-9d844e1c12b6 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ab037c-bdfe-467c-a352-df9babac2b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4bb17ba7-e0e7-4fff-886e-9d844e1c12b6 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ab037c-bdfe-467c-a352-df9babac2b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:02 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4bb17ba7-e0e7-4fff-886e-9d844e1c12b6 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0483e24e-3d63-48e0-8050-5af54b0fa690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4bb17ba7-e0e7-4fff-886e-9d844e1c12b6 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0483e24e-3d63-48e0-8050-5af54b0fa690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e245bb89-22e4-4e73-98f8-a8578619077b', 'volume_name': 'volume-e245bb89-22e4-4e73-98f8-a8578619077b', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4bb17ba7-e0e7-4fff-886e-9d844e1c12b6 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86ee44c8-4bfc-4f47-9b5c-4b92e98c6c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4bb17ba7-e0e7-4fff-886e-9d844e1c12b6 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86ee44c8-4bfc-4f47-9b5c-4b92e98c6c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4bb17ba7-e0e7-4fff-886e-9d844e1c12b6 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35e729e3-084f-47b5-811d-9b60ddf820c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:03 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-4bb17ba7-e0e7-4fff-886e-9d844e1c12b6 tempest-ProjectMemberTests-1023405772 None] Volume e245bb89-22e4-4e73-98f8-a8578619077b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e245bb89-22e4-4e73-98f8-a8578619077b', 'volume_size': 1} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4bb17ba7-e0e7-4fff-886e-9d844e1c12b6 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[79008072-cf4d-462d-bc8f-b6f22398a8ed]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f87d606b-0113-4f6f-bd97-fa2aa3d7bf89 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0c675f9-5962-469c-a38b-99ab3876c1c2 tempest-CreateVolumesFromImageTest-1017882793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:36:03 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:03 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a0c675f9-5962-469c-a38b-99ab3876c1c2 tempest-CreateVolumesFromImageTest-1017882793 None] Flow 'volume_create_manager' (fc26cdec-8fce-46b4-b79c-5f555f0a7747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a0c675f9-5962-469c-a38b-99ab3876c1c2 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b2ee13-ab1c-4936-a988-13b3550a4d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5b54f61-81b5-4b16-835e-ae7b626e397c tempest-CreateVolumesFromImageTest-1017882793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e5b54f61-81b5-4b16-835e-ae7b626e397c tempest-CreateVolumesFromImageTest-1017882793 None] Flow 'volume_create_manager' (02ec2dbf-ef98-4640-8fbe-04cb2bade92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e5b54f61-81b5-4b16-835e-ae7b626e397c tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef77b060-ff95-469e-804a-ab8482d00ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:03 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4614a7b4-f710-4db4-86eb-a182625fcce0 tempest-VolumeDependencyTests-490071870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6940b793-1287-4316-9d1b-8a689f13d164" returned: 0 in 0.663s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0acec6e8-fbcf-41fb-8200-d41c28240a11 tempest-CreateVolumesFromImageTest-1017882793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8f988a10-3b8e-404e-b798-65233272d5d4" returned: 0 in 0.636s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:03 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0acec6e8-fbcf-41fb-8200-d41c28240a11 tempest-CreateVolumesFromImageTest-1017882793 None] <== create_volume: return (1789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0acec6e8-fbcf-41fb-8200-d41c28240a11 tempest-CreateVolumesFromImageTest-1017882793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.791s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4bb17ba7-e0e7-4fff-886e-9d844e1c12b6 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.246s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4bb17ba7-e0e7-4fff-886e-9d844e1c12b6 tempest-ProjectMemberTests-1023405772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-232932615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e245bb89-22e4-4e73-98f8-a8578619077b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b14a0052f8fb4344b121d3a20292b053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:36:02Z,use_quota=True,user_id='faa7527cbba84668895a85e3faa36efb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-4bb17ba7-e0e7-4fff-886e-9d844e1c12b6 tempest-ProjectMemberTests-1023405772 None] Creating volume e245bb89-22e4-4e73-98f8-a8578619077b {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4bb17ba7-e0e7-4fff-886e-9d844e1c12b6 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4bb17ba7-e0e7-4fff-886e-9d844e1c12b6 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4bb17ba7-e0e7-4fff-886e-9d844e1c12b6 tempest-ProjectMemberTests-1023405772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4bb17ba7-e0e7-4fff-886e-9d844e1c12b6 tempest-ProjectMemberTests-1023405772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4bb17ba7-e0e7-4fff-886e-9d844e1c12b6 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4bb17ba7-e0e7-4fff-886e-9d844e1c12b6 tempest-ProjectMemberTests-1023405772 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:36:03 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-4bb17ba7-e0e7-4fff-886e-9d844e1c12b6 tempest-ProjectMemberTests-1023405772 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4bb17ba7-e0e7-4fff-886e-9d844e1c12b6 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a0c675f9-5962-469c-a38b-99ab3876c1c2 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b2ee13-ab1c-4936-a988-13b3550a4d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1061499309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fbf5f45-c1c6-47de-b43f-091c36b6ca56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52252d56a4c8420783013221b7d94aae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:36:03Z,use_quota=True,user_id='c9e1f1151d084cc595d56fb6596027db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a0c675f9-5962-469c-a38b-99ab3876c1c2 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad6fc3ca-43fb-4dce-9d81-a05e9e0e1ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a0c675f9-5962-469c-a38b-99ab3876c1c2 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad6fc3ca-43fb-4dce-9d81-a05e9e0e1ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a0c675f9-5962-469c-a38b-99ab3876c1c2 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37220a43-dd4c-4ebf-8a9a-1bd886d7cb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:03 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b 1073741824 Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a0c675f9-5962-469c-a38b-99ab3876c1c2 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37220a43-dd4c-4ebf-8a9a-1bd886d7cb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fbf5f45-c1c6-47de-b43f-091c36b6ca56', 'volume_name': 'volume-6fbf5f45-c1c6-47de-b43f-091c36b6ca56', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:03 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a0c675f9-5962-469c-a38b-99ab3876c1c2 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (749ff0b8-70a2-48d3-8003-a750dcb4acf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a0c675f9-5962-469c-a38b-99ab3876c1c2 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (749ff0b8-70a2-48d3-8003-a750dcb4acf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a0c675f9-5962-469c-a38b-99ab3876c1c2 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (655db0e1-ef1e-43d9-9e38-2da3ab7e72e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:03 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-a0c675f9-5962-469c-a38b-99ab3876c1c2 tempest-CreateVolumesFromImageTest-1017882793 None] Volume 6fbf5f45-c1c6-47de-b43f-091c36b6ca56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fbf5f45-c1c6-47de-b43f-091c36b6ca56', 'volume_size': 1} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a0c675f9-5962-469c-a38b-99ab3876c1c2 tempest-CreateVolumesFromImageTest-1017882793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e5b54f61-81b5-4b16-835e-ae7b626e397c tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef77b060-ff95-469e-804a-ab8482d00ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1537937006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebf70375-6d3e-4fd3-8fda-6d5b0c6facda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52252d56a4c8420783013221b7d94aae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:36:03Z,use_quota=True,user_id='c9e1f1151d084cc595d56fb6596027db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e5b54f61-81b5-4b16-835e-ae7b626e397c tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8e3f75e-f975-4d88-bd16-f915dcfa212e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e5b54f61-81b5-4b16-835e-ae7b626e397c tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8e3f75e-f975-4d88-bd16-f915dcfa212e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e5b54f61-81b5-4b16-835e-ae7b626e397c tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f845e00-7247-4a6a-8b96-95e8a79f015b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e5b54f61-81b5-4b16-835e-ae7b626e397c tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f845e00-7247-4a6a-8b96-95e8a79f015b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebf70375-6d3e-4fd3-8fda-6d5b0c6facda', 'volume_name': 'volume-ebf70375-6d3e-4fd3-8fda-6d5b0c6facda', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e5b54f61-81b5-4b16-835e-ae7b626e397c tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c903692-1165-4971-8fee-408a4f44f2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e5b54f61-81b5-4b16-835e-ae7b626e397c tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c903692-1165-4971-8fee-408a4f44f2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e5b54f61-81b5-4b16-835e-ae7b626e397c tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df76c126-abd2-4df6-9f50-4422eb74ad5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:03 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-e5b54f61-81b5-4b16-835e-ae7b626e397c tempest-CreateVolumesFromImageTest-1017882793 None] Volume ebf70375-6d3e-4fd3-8fda-6d5b0c6facda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebf70375-6d3e-4fd3-8fda-6d5b0c6facda', 'volume_size': 1} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e5b54f61-81b5-4b16-835e-ae7b626e397c tempest-CreateVolumesFromImageTest-1017882793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4614a7b4-f710-4db4-86eb-a182625fcce0 tempest-VolumeDependencyTests-490071870 None] Lock "cinder-quobyte-6940b793-1287-4316-9d1b-8a689f13d164" released by "delete_volume" :: held 1.597s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-7115fb92-51a0-4a28-aada-31c41cace163 tempest-CreateVolumesFromImageTest-1017882793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7115fb92-51a0-4a28-aada-31c41cace163 tempest-CreateVolumesFromImageTest-1017882793 None] Flow 'volume_create_manager' (e25feb2e-a57d-462b-9ce8-3756b1661333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7115fb92-51a0-4a28-aada-31c41cace163 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f65af67b-2106-49a6-802b-56a395c18131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0acec6e8-fbcf-41fb-8200-d41c28240a11 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eaafc08-6518-436e-a2fd-11620f9c4651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f988a10-3b8e-404e-b798-65233272d5d4', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0acec6e8-fbcf-41fb-8200-d41c28240a11 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8627c58a-1955-4113-b756-dba9dc078128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:03 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7115fb92-51a0-4a28-aada-31c41cace163 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f65af67b-2106-49a6-802b-56a395c18131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-619738258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c053ba3f-ccc2-4a61-b8a5-d2c65e0fb9cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52252d56a4c8420783013221b7d94aae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:36:03Z,use_quota=True,user_id='c9e1f1151d084cc595d56fb6596027db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7115fb92-51a0-4a28-aada-31c41cace163 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8304119-3a8e-4350-ac48-1fac240214b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7115fb92-51a0-4a28-aada-31c41cace163 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8304119-3a8e-4350-ac48-1fac240214b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7115fb92-51a0-4a28-aada-31c41cace163 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52c4f389-7ac3-4853-af38-83d681262e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7115fb92-51a0-4a28-aada-31c41cace163 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52c4f389-7ac3-4853-af38-83d681262e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c053ba3f-ccc2-4a61-b8a5-d2c65e0fb9cb', 'volume_name': 'volume-c053ba3f-ccc2-4a61-b8a5-d2c65e0fb9cb', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7115fb92-51a0-4a28-aada-31c41cace163 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d5c2590-c759-4015-bb5a-1366534cc0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7115fb92-51a0-4a28-aada-31c41cace163 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d5c2590-c759-4015-bb5a-1366534cc0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7115fb92-51a0-4a28-aada-31c41cace163 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa7ea7d0-08ec-49a7-a941-49100624b856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:03 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-7115fb92-51a0-4a28-aada-31c41cace163 tempest-CreateVolumesFromImageTest-1017882793 None] Volume c053ba3f-ccc2-4a61-b8a5-d2c65e0fb9cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c053ba3f-ccc2-4a61-b8a5-d2c65e0fb9cb', 'volume_size': 1} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7115fb92-51a0-4a28-aada-31c41cace163 tempest-CreateVolumesFromImageTest-1017882793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:03 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-0acec6e8-fbcf-41fb-8200-d41c28240a11 tempest-CreateVolumesFromImageTest-1017882793 None] Volume volume-8f988a10-3b8e-404e-b798-65233272d5d4 (8f988a10-3b8e-404e-b798-65233272d5d4): created successfully Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0acec6e8-fbcf-41fb-8200-d41c28240a11 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8627c58a-1955-4113-b756-dba9dc078128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0acec6e8-fbcf-41fb-8200-d41c28240a11 tempest-CreateVolumesFromImageTest-1017882793 None] Flow 'volume_create_manager' (7e5be081-2c51-42fe-a7de-c3ec6fafa022) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f87d606b-0113-4f6f-bd97-fa2aa3d7bf89 tempest-CreateVolumesFromSnapshotTest-1783062093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d" returned: 0 in 0.542s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f87d606b-0113-4f6f-bd97-fa2aa3d7bf89 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d.3ccb9c91-2657-4e01-9178-4bbe09d5fd05 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:03 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d.3ccb9c91-2657-4e01-9178-4bbe09d5fd05 Jul 16 23:36:03 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:03 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-0acec6e8-fbcf-41fb-8200-d41c28240a11 tempest-CreateVolumesFromImageTest-1017882793 None] Created volume successfully. Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6679d21-6adb-4b94-917d-30ddaf8cba68 tempest-CreateVolumesFromImageTest-1017882793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c6679d21-6adb-4b94-917d-30ddaf8cba68 tempest-CreateVolumesFromImageTest-1017882793 None] Flow 'volume_create_manager' (7c2785af-2e47-4c37-8dbb-fe8a20036177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c6679d21-6adb-4b94-917d-30ddaf8cba68 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3095d919-a1dd-4396-a777-5f56b537e185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c6679d21-6adb-4b94-917d-30ddaf8cba68 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3095d919-a1dd-4396-a777-5f56b537e185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-683926967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc215c63-a3fc-4145-a0ac-114d6ba1edb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52252d56a4c8420783013221b7d94aae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:36:04Z,use_quota=True,user_id='c9e1f1151d084cc595d56fb6596027db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c6679d21-6adb-4b94-917d-30ddaf8cba68 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfcd86e7-5cdc-4845-92bc-07ac85e4161a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c6679d21-6adb-4b94-917d-30ddaf8cba68 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfcd86e7-5cdc-4845-92bc-07ac85e4161a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c6679d21-6adb-4b94-917d-30ddaf8cba68 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eac5677d-c032-48d6-b164-8d4f060d26af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c6679d21-6adb-4b94-917d-30ddaf8cba68 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eac5677d-c032-48d6-b164-8d4f060d26af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc215c63-a3fc-4145-a0ac-114d6ba1edb6', 'volume_name': 'volume-dc215c63-a3fc-4145-a0ac-114d6ba1edb6', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c6679d21-6adb-4b94-917d-30ddaf8cba68 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20237df7-0c37-45f6-83fc-bc55eef14de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c6679d21-6adb-4b94-917d-30ddaf8cba68 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20237df7-0c37-45f6-83fc-bc55eef14de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c6679d21-6adb-4b94-917d-30ddaf8cba68 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d343296-9e13-4387-82b7-54615e067c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:03 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-c6679d21-6adb-4b94-917d-30ddaf8cba68 tempest-CreateVolumesFromImageTest-1017882793 None] Volume dc215c63-a3fc-4145-a0ac-114d6ba1edb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc215c63-a3fc-4145-a0ac-114d6ba1edb6', 'volume_size': 1} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c6679d21-6adb-4b94-917d-30ddaf8cba68 tempest-CreateVolumesFromImageTest-1017882793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-4614a7b4-f710-4db4-86eb-a182625fcce0 tempest-VolumeDependencyTests-490071870 None] Created reservations ['c0963ea6-ef28-4006-9420-dd1c98c7e039', '49b72a8f-1fdb-4455-a1f6-f1cf88f190e7', 'a682d221-c64c-446c-a186-0f05447505e8', '4ba6c765-30e5-49a3-9a0f-ed173317475b'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4614a7b4-f710-4db4-86eb-a182625fcce0 tempest-VolumeDependencyTests-490071870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4614a7b4-f710-4db4-86eb-a182625fcce0 tempest-VolumeDependencyTests-490071870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4614a7b4-f710-4db4-86eb-a182625fcce0 tempest-VolumeDependencyTests-490071870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4614a7b4-f710-4db4-86eb-a182625fcce0 tempest-VolumeDependencyTests-490071870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4614a7b4-f710-4db4-86eb-a182625fcce0 tempest-VolumeDependencyTests-490071870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4614a7b4-f710-4db4-86eb-a182625fcce0 tempest-VolumeDependencyTests-490071870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:03 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:36:03 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:03 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4bb17ba7-e0e7-4fff-886e-9d844e1c12b6 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b 1073741824" returned: 0 in 0.575s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4bb17ba7-e0e7-4fff-886e-9d844e1c12b6 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:03 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b Jul 16 23:36:03 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:03 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f87d606b-0113-4f6f-bd97-fa2aa3d7bf89 tempest-CreateVolumesFromSnapshotTest-1783062093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d.3ccb9c91-2657-4e01-9178-4bbe09d5fd05" returned: 0 in 0.413s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f87d606b-0113-4f6f-bd97-fa2aa3d7bf89 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d.3ccb9c91-2657-4e01-9178-4bbe09d5fd05 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:04 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d.3ccb9c91-2657-4e01-9178-4bbe09d5fd05 Jul 16 23:36:04 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:04 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4614a7b4-f710-4db4-86eb-a182625fcce0 tempest-VolumeDependencyTests-490071870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.279s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:04 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-4614a7b4-f710-4db4-86eb-a182625fcce0 tempest-VolumeDependencyTests-490071870 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:36:04 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-4614a7b4-f710-4db4-86eb-a182625fcce0 tempest-VolumeDependencyTests-490071870 None] Deleted volume successfully. Jul 16 23:36:04 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4614a7b4-f710-4db4-86eb-a182625fcce0 tempest-VolumeDependencyTests-490071870 None] Lock "cinder-6940b793-1287-4316-9d1b-8a689f13d164-delete_volume" released by "delete_volume" :: held 2.348s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:04 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4bb17ba7-e0e7-4fff-886e-9d844e1c12b6 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b" returned: 0 in 0.269s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4bb17ba7-e0e7-4fff-886e-9d844e1c12b6 tempest-ProjectMemberTests-1023405772 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:36:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4bb17ba7-e0e7-4fff-886e-9d844e1c12b6 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a0c675f9-5962-469c-a38b-99ab3876c1c2 tempest-CreateVolumesFromImageTest-1017882793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.829s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a0c675f9-5962-469c-a38b-99ab3876c1c2 tempest-CreateVolumesFromImageTest-1017882793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1061499309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fbf5f45-c1c6-47de-b43f-091c36b6ca56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52252d56a4c8420783013221b7d94aae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:36:03Z,use_quota=True,user_id='c9e1f1151d084cc595d56fb6596027db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:36:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-a0c675f9-5962-469c-a38b-99ab3876c1c2 tempest-CreateVolumesFromImageTest-1017882793 None] Creating volume 6fbf5f45-c1c6-47de-b43f-091c36b6ca56 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:36:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a0c675f9-5962-469c-a38b-99ab3876c1c2 tempest-CreateVolumesFromImageTest-1017882793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a0c675f9-5962-469c-a38b-99ab3876c1c2 tempest-CreateVolumesFromImageTest-1017882793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a0c675f9-5962-469c-a38b-99ab3876c1c2 tempest-CreateVolumesFromImageTest-1017882793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a0c675f9-5962-469c-a38b-99ab3876c1c2 tempest-CreateVolumesFromImageTest-1017882793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a0c675f9-5962-469c-a38b-99ab3876c1c2 tempest-CreateVolumesFromImageTest-1017882793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a0c675f9-5962-469c-a38b-99ab3876c1c2 tempest-CreateVolumesFromImageTest-1017882793 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:36:04 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-a0c675f9-5962-469c-a38b-99ab3876c1c2 tempest-CreateVolumesFromImageTest-1017882793 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:36:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a0c675f9-5962-469c-a38b-99ab3876c1c2 tempest-CreateVolumesFromImageTest-1017882793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6fbf5f45-c1c6-47de-b43f-091c36b6ca56 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:04 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4bb17ba7-e0e7-4fff-886e-9d844e1c12b6 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35e729e3-084f-47b5-811d-9b60ddf820c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e245bb89-22e4-4e73-98f8-a8578619077b', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:04 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4bb17ba7-e0e7-4fff-886e-9d844e1c12b6 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f1babb-6731-4d9b-a03c-1a5dd7a33bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:04 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6fbf5f45-c1c6-47de-b43f-091c36b6ca56 1073741824 Jul 16 23:36:04 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:04 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-4bb17ba7-e0e7-4fff-886e-9d844e1c12b6 tempest-ProjectMemberTests-1023405772 None] Volume volume-e245bb89-22e4-4e73-98f8-a8578619077b (e245bb89-22e4-4e73-98f8-a8578619077b): created successfully Jul 16 23:36:04 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4bb17ba7-e0e7-4fff-886e-9d844e1c12b6 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f1babb-6731-4d9b-a03c-1a5dd7a33bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:04 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4bb17ba7-e0e7-4fff-886e-9d844e1c12b6 tempest-ProjectMemberTests-1023405772 None] Flow 'volume_create_manager' (b0d1df49-08fc-4e9b-91b7-c58fa6dca6d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:36:04 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-4bb17ba7-e0e7-4fff-886e-9d844e1c12b6 tempest-ProjectMemberTests-1023405772 None] Created volume successfully. Jul 16 23:36:04 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f87d606b-0113-4f6f-bd97-fa2aa3d7bf89 tempest-CreateVolumesFromSnapshotTest-1783062093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d.3ccb9c91-2657-4e01-9178-4bbe09d5fd05" returned: 0 in 0.298s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:04 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f87d606b-0113-4f6f-bd97-fa2aa3d7bf89 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "cinder-quobyte-3ccb9c91-2657-4e01-9178-4bbe09d5fd05" released by "_delete_snapshot" :: held 2.345s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:04 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f87d606b-0113-4f6f-bd97-fa2aa3d7bf89 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "cinder-quobyte-533de4c3-1c21-4eb0-8575-28f23aaf766d" released by "delete_snapshot" :: held 2.379s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:04 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-f87d606b-0113-4f6f-bd97-fa2aa3d7bf89 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Created reservations ['68e44cc4-3b92-46e9-b4af-0a4cedaaa351', '916638b7-aa48-4bb1-b882-adee541ab327', '564db79e-3693-4ba5-9e34-2af4191a87a6', '10e3808d-2581-479d-a273-dce2ced6db21'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:36:04 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-f87d606b-0113-4f6f-bd97-fa2aa3d7bf89 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Delete snapshot completed successfully. Jul 16 23:36:04 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f87d606b-0113-4f6f-bd97-fa2aa3d7bf89 tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "cinder-3ccb9c91-2657-4e01-9178-4bbe09d5fd05-delete_snapshot" released by "delete_snapshot" :: held 2.521s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:04 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a0c675f9-5962-469c-a38b-99ab3876c1c2 tempest-CreateVolumesFromImageTest-1017882793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6fbf5f45-c1c6-47de-b43f-091c36b6ca56 1073741824" returned: 0 in 0.516s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a0c675f9-5962-469c-a38b-99ab3876c1c2 tempest-CreateVolumesFromImageTest-1017882793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6fbf5f45-c1c6-47de-b43f-091c36b6ca56 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:04 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6fbf5f45-c1c6-47de-b43f-091c36b6ca56 Jul 16 23:36:04 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:04 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a0c675f9-5962-469c-a38b-99ab3876c1c2 tempest-CreateVolumesFromImageTest-1017882793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6fbf5f45-c1c6-47de-b43f-091c36b6ca56" returned: 0 in 0.266s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a0c675f9-5962-469c-a38b-99ab3876c1c2 tempest-CreateVolumesFromImageTest-1017882793 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:36:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a0c675f9-5962-469c-a38b-99ab3876c1c2 tempest-CreateVolumesFromImageTest-1017882793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e5b54f61-81b5-4b16-835e-ae7b626e397c tempest-CreateVolumesFromImageTest-1017882793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.564s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e5b54f61-81b5-4b16-835e-ae7b626e397c tempest-CreateVolumesFromImageTest-1017882793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1537937006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebf70375-6d3e-4fd3-8fda-6d5b0c6facda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52252d56a4c8420783013221b7d94aae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:36:03Z,use_quota=True,user_id='c9e1f1151d084cc595d56fb6596027db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:36:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-e5b54f61-81b5-4b16-835e-ae7b626e397c tempest-CreateVolumesFromImageTest-1017882793 None] Creating volume ebf70375-6d3e-4fd3-8fda-6d5b0c6facda {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:36:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e5b54f61-81b5-4b16-835e-ae7b626e397c tempest-CreateVolumesFromImageTest-1017882793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e5b54f61-81b5-4b16-835e-ae7b626e397c tempest-CreateVolumesFromImageTest-1017882793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e5b54f61-81b5-4b16-835e-ae7b626e397c tempest-CreateVolumesFromImageTest-1017882793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e5b54f61-81b5-4b16-835e-ae7b626e397c tempest-CreateVolumesFromImageTest-1017882793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e5b54f61-81b5-4b16-835e-ae7b626e397c tempest-CreateVolumesFromImageTest-1017882793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e5b54f61-81b5-4b16-835e-ae7b626e397c tempest-CreateVolumesFromImageTest-1017882793 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:36:05 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-e5b54f61-81b5-4b16-835e-ae7b626e397c tempest-CreateVolumesFromImageTest-1017882793 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:36:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e5b54f61-81b5-4b16-835e-ae7b626e397c tempest-CreateVolumesFromImageTest-1017882793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ebf70375-6d3e-4fd3-8fda-6d5b0c6facda 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:05 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a0c675f9-5962-469c-a38b-99ab3876c1c2 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (655db0e1-ef1e-43d9-9e38-2da3ab7e72e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fbf5f45-c1c6-47de-b43f-091c36b6ca56', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:05 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a0c675f9-5962-469c-a38b-99ab3876c1c2 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d935eff2-3bbd-4f57-b730-ded61fcf7076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:05 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ebf70375-6d3e-4fd3-8fda-6d5b0c6facda 1073741824 Jul 16 23:36:05 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:05 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-a0c675f9-5962-469c-a38b-99ab3876c1c2 tempest-CreateVolumesFromImageTest-1017882793 None] Volume volume-6fbf5f45-c1c6-47de-b43f-091c36b6ca56 (6fbf5f45-c1c6-47de-b43f-091c36b6ca56): created successfully Jul 16 23:36:05 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a0c675f9-5962-469c-a38b-99ab3876c1c2 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d935eff2-3bbd-4f57-b730-ded61fcf7076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:05 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a0c675f9-5962-469c-a38b-99ab3876c1c2 tempest-CreateVolumesFromImageTest-1017882793 None] Flow 'volume_create_manager' (fc26cdec-8fce-46b4-b79c-5f555f0a7747) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:36:05 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-a0c675f9-5962-469c-a38b-99ab3876c1c2 tempest-CreateVolumesFromImageTest-1017882793 None] Created volume successfully. Jul 16 23:36:05 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-14a07097-a842-4c16-ac87-8565ed4d8b7c tempest-CreateVolumesFromSnapshotTest-1783062093 None] Acquiring lock "cinder-533de4c3-1c21-4eb0-8575-28f23aaf766d-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:05 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-14a07097-a842-4c16-ac87-8565ed4d8b7c tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "cinder-533de4c3-1c21-4eb0-8575-28f23aaf766d-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7642f724-2ce4-4da5-bb48-24c443c727ee tempest-ProjectMemberTests-1023405772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:05 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-14a07097-a842-4c16-ac87-8565ed4d8b7c tempest-CreateVolumesFromSnapshotTest-1783062093 None] Acquiring lock "cinder-quobyte-533de4c3-1c21-4eb0-8575-28f23aaf766d" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:05 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-14a07097-a842-4c16-ac87-8565ed4d8b7c tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "cinder-quobyte-533de4c3-1c21-4eb0-8575-28f23aaf766d" acquired by "delete_volume" :: waited 0.016s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:05 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dac19b5-4b58-4bf4-9b58-c0918eba0d14]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:36:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-14a07097-a842-4c16-ac87-8565ed4d8b7c tempest-CreateVolumesFromSnapshotTest-1783062093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:05 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d Jul 16 23:36:05 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:05 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e5b54f61-81b5-4b16-835e-ae7b626e397c tempest-CreateVolumesFromImageTest-1017882793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ebf70375-6d3e-4fd3-8fda-6d5b0c6facda 1073741824" returned: 0 in 0.618s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e5b54f61-81b5-4b16-835e-ae7b626e397c tempest-CreateVolumesFromImageTest-1017882793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ebf70375-6d3e-4fd3-8fda-6d5b0c6facda {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:05 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ebf70375-6d3e-4fd3-8fda-6d5b0c6facda Jul 16 23:36:05 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:05 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-14a07097-a842-4c16-ac87-8565ed4d8b7c tempest-CreateVolumesFromSnapshotTest-1783062093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d" returned: 0 in 0.397s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-14a07097-a842-4c16-ac87-8565ed4d8b7c tempest-CreateVolumesFromSnapshotTest-1783062093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:05 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d Jul 16 23:36:05 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:05 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e5b54f61-81b5-4b16-835e-ae7b626e397c tempest-CreateVolumesFromImageTest-1017882793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ebf70375-6d3e-4fd3-8fda-6d5b0c6facda" returned: 0 in 0.279s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:05 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e5b54f61-81b5-4b16-835e-ae7b626e397c tempest-CreateVolumesFromImageTest-1017882793 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:36:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e5b54f61-81b5-4b16-835e-ae7b626e397c tempest-CreateVolumesFromImageTest-1017882793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7115fb92-51a0-4a28-aada-31c41cace163 tempest-CreateVolumesFromImageTest-1017882793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.391s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:05 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-7115fb92-51a0-4a28-aada-31c41cace163 tempest-CreateVolumesFromImageTest-1017882793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-619738258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c053ba3f-ccc2-4a61-b8a5-d2c65e0fb9cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52252d56a4c8420783013221b7d94aae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:36:03Z,use_quota=True,user_id='c9e1f1151d084cc595d56fb6596027db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:36:05 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-7115fb92-51a0-4a28-aada-31c41cace163 tempest-CreateVolumesFromImageTest-1017882793 None] Creating volume c053ba3f-ccc2-4a61-b8a5-d2c65e0fb9cb {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:36:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7115fb92-51a0-4a28-aada-31c41cace163 tempest-CreateVolumesFromImageTest-1017882793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7115fb92-51a0-4a28-aada-31c41cace163 tempest-CreateVolumesFromImageTest-1017882793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:05 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-7115fb92-51a0-4a28-aada-31c41cace163 tempest-CreateVolumesFromImageTest-1017882793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:05 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-7115fb92-51a0-4a28-aada-31c41cace163 tempest-CreateVolumesFromImageTest-1017882793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7115fb92-51a0-4a28-aada-31c41cace163 tempest-CreateVolumesFromImageTest-1017882793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:05 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-7115fb92-51a0-4a28-aada-31c41cace163 tempest-CreateVolumesFromImageTest-1017882793 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:36:05 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-7115fb92-51a0-4a28-aada-31c41cace163 tempest-CreateVolumesFromImageTest-1017882793 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:36:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7115fb92-51a0-4a28-aada-31c41cace163 tempest-CreateVolumesFromImageTest-1017882793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-c053ba3f-ccc2-4a61-b8a5-d2c65e0fb9cb 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e5b54f61-81b5-4b16-835e-ae7b626e397c tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df76c126-abd2-4df6-9f50-4422eb74ad5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebf70375-6d3e-4fd3-8fda-6d5b0c6facda', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:06 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-c053ba3f-ccc2-4a61-b8a5-d2c65e0fb9cb 1073741824 Jul 16 23:36:06 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e5b54f61-81b5-4b16-835e-ae7b626e397c tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de31413f-438f-4209-8c7b-ee83d7d382e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:06 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-e5b54f61-81b5-4b16-835e-ae7b626e397c tempest-CreateVolumesFromImageTest-1017882793 None] Volume volume-ebf70375-6d3e-4fd3-8fda-6d5b0c6facda (ebf70375-6d3e-4fd3-8fda-6d5b0c6facda): created successfully Jul 16 23:36:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e5b54f61-81b5-4b16-835e-ae7b626e397c tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de31413f-438f-4209-8c7b-ee83d7d382e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e5b54f61-81b5-4b16-835e-ae7b626e397c tempest-CreateVolumesFromImageTest-1017882793 None] Flow 'volume_create_manager' (02ec2dbf-ef98-4640-8fbe-04cb2bade92a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:36:06 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-e5b54f61-81b5-4b16-835e-ae7b626e397c tempest-CreateVolumesFromImageTest-1017882793 None] Created volume successfully. Jul 16 23:36:06 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-14a07097-a842-4c16-ac87-8565ed4d8b7c tempest-CreateVolumesFromSnapshotTest-1783062093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-533de4c3-1c21-4eb0-8575-28f23aaf766d" returned: 0 in 0.334s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:06 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-14a07097-a842-4c16-ac87-8565ed4d8b7c tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "cinder-quobyte-533de4c3-1c21-4eb0-8575-28f23aaf766d" released by "delete_volume" :: held 0.804s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:06 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-14a07097-a842-4c16-ac87-8565ed4d8b7c tempest-CreateVolumesFromSnapshotTest-1783062093 None] Created reservations ['8bc13682-3291-4cc6-b151-cda4959f135c', 'fb96e32f-5af5-4e92-98cd-d95da9e91ecf', '637f6642-44c4-4206-8995-2768884564c2', '233f749f-18dd-4304-b223-bb0e210852d4'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:36:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-14a07097-a842-4c16-ac87-8565ed4d8b7c tempest-CreateVolumesFromSnapshotTest-1783062093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-14a07097-a842-4c16-ac87-8565ed4d8b7c tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-14a07097-a842-4c16-ac87-8565ed4d8b7c tempest-CreateVolumesFromSnapshotTest-1783062093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-14a07097-a842-4c16-ac87-8565ed4d8b7c tempest-CreateVolumesFromSnapshotTest-1783062093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-14a07097-a842-4c16-ac87-8565ed4d8b7c tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-14a07097-a842-4c16-ac87-8565ed4d8b7c tempest-CreateVolumesFromSnapshotTest-1783062093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:06 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:36:06 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:06 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7115fb92-51a0-4a28-aada-31c41cace163 tempest-CreateVolumesFromImageTest-1017882793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-c053ba3f-ccc2-4a61-b8a5-d2c65e0fb9cb 1073741824" returned: 0 in 0.605s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7115fb92-51a0-4a28-aada-31c41cace163 tempest-CreateVolumesFromImageTest-1017882793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-c053ba3f-ccc2-4a61-b8a5-d2c65e0fb9cb {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:06 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-14a07097-a842-4c16-ac87-8565ed4d8b7c tempest-CreateVolumesFromSnapshotTest-1783062093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.271s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:06 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-14a07097-a842-4c16-ac87-8565ed4d8b7c tempest-CreateVolumesFromSnapshotTest-1783062093 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:36:06 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-c053ba3f-ccc2-4a61-b8a5-d2c65e0fb9cb Jul 16 23:36:06 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:06 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-14a07097-a842-4c16-ac87-8565ed4d8b7c tempest-CreateVolumesFromSnapshotTest-1783062093 None] Deleted volume successfully. Jul 16 23:36:06 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-14a07097-a842-4c16-ac87-8565ed4d8b7c tempest-CreateVolumesFromSnapshotTest-1783062093 None] Lock "cinder-533de4c3-1c21-4eb0-8575-28f23aaf766d-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:06 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7115fb92-51a0-4a28-aada-31c41cace163 tempest-CreateVolumesFromImageTest-1017882793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-c053ba3f-ccc2-4a61-b8a5-d2c65e0fb9cb" returned: 0 in 0.309s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-7115fb92-51a0-4a28-aada-31c41cace163 tempest-CreateVolumesFromImageTest-1017882793 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:36:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7115fb92-51a0-4a28-aada-31c41cace163 tempest-CreateVolumesFromImageTest-1017882793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c6679d21-6adb-4b94-917d-30ddaf8cba68 tempest-CreateVolumesFromImageTest-1017882793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.201s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-c6679d21-6adb-4b94-917d-30ddaf8cba68 tempest-CreateVolumesFromImageTest-1017882793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-683926967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc215c63-a3fc-4145-a0ac-114d6ba1edb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52252d56a4c8420783013221b7d94aae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:36:04Z,use_quota=True,user_id='c9e1f1151d084cc595d56fb6596027db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:36:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-c6679d21-6adb-4b94-917d-30ddaf8cba68 tempest-CreateVolumesFromImageTest-1017882793 None] Creating volume dc215c63-a3fc-4145-a0ac-114d6ba1edb6 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:36:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c6679d21-6adb-4b94-917d-30ddaf8cba68 tempest-CreateVolumesFromImageTest-1017882793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c6679d21-6adb-4b94-917d-30ddaf8cba68 tempest-CreateVolumesFromImageTest-1017882793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-c6679d21-6adb-4b94-917d-30ddaf8cba68 tempest-CreateVolumesFromImageTest-1017882793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-c6679d21-6adb-4b94-917d-30ddaf8cba68 tempest-CreateVolumesFromImageTest-1017882793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c6679d21-6adb-4b94-917d-30ddaf8cba68 tempest-CreateVolumesFromImageTest-1017882793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-c6679d21-6adb-4b94-917d-30ddaf8cba68 tempest-CreateVolumesFromImageTest-1017882793 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:36:06 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-c6679d21-6adb-4b94-917d-30ddaf8cba68 tempest-CreateVolumesFromImageTest-1017882793 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:36:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c6679d21-6adb-4b94-917d-30ddaf8cba68 tempest-CreateVolumesFromImageTest-1017882793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-dc215c63-a3fc-4145-a0ac-114d6ba1edb6 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:06 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-dc215c63-a3fc-4145-a0ac-114d6ba1edb6 1073741824 Jul 16 23:36:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7115fb92-51a0-4a28-aada-31c41cace163 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa7ea7d0-08ec-49a7-a941-49100624b856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c053ba3f-ccc2-4a61-b8a5-d2c65e0fb9cb', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:06 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7115fb92-51a0-4a28-aada-31c41cace163 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7085567-e198-49cc-8e90-99b3b995e2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:07 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-7115fb92-51a0-4a28-aada-31c41cace163 tempest-CreateVolumesFromImageTest-1017882793 None] Volume volume-c053ba3f-ccc2-4a61-b8a5-d2c65e0fb9cb (c053ba3f-ccc2-4a61-b8a5-d2c65e0fb9cb): created successfully Jul 16 23:36:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7115fb92-51a0-4a28-aada-31c41cace163 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7085567-e198-49cc-8e90-99b3b995e2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7115fb92-51a0-4a28-aada-31c41cace163 tempest-CreateVolumesFromImageTest-1017882793 None] Flow 'volume_create_manager' (e25feb2e-a57d-462b-9ce8-3756b1661333) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:36:07 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-7115fb92-51a0-4a28-aada-31c41cace163 tempest-CreateVolumesFromImageTest-1017882793 None] Created volume successfully. Jul 16 23:36:07 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c6679d21-6adb-4b94-917d-30ddaf8cba68 tempest-CreateVolumesFromImageTest-1017882793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-dc215c63-a3fc-4145-a0ac-114d6ba1edb6 1073741824" returned: 0 in 0.587s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c6679d21-6adb-4b94-917d-30ddaf8cba68 tempest-CreateVolumesFromImageTest-1017882793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-dc215c63-a3fc-4145-a0ac-114d6ba1edb6 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:07 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-dc215c63-a3fc-4145-a0ac-114d6ba1edb6 Jul 16 23:36:07 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:07 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c6679d21-6adb-4b94-917d-30ddaf8cba68 tempest-CreateVolumesFromImageTest-1017882793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-dc215c63-a3fc-4145-a0ac-114d6ba1edb6" returned: 0 in 0.275s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:07 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-c6679d21-6adb-4b94-917d-30ddaf8cba68 tempest-CreateVolumesFromImageTest-1017882793 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:36:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c6679d21-6adb-4b94-917d-30ddaf8cba68 tempest-CreateVolumesFromImageTest-1017882793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7642f724-2ce4-4da5-bb48-24c443c727ee tempest-ProjectMemberTests-1023405772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.455s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:07 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-7642f724-2ce4-4da5-bb48-24c443c727ee tempest-ProjectMemberTests-1023405772 None] Creating offline snapshot ca1f188c-4d3a-4d22-990b-b483b3f05eca of volume e245bb89-22e4-4e73-98f8-a8578619077b {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:36:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c6679d21-6adb-4b94-917d-30ddaf8cba68 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d343296-9e13-4387-82b7-54615e067c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc215c63-a3fc-4145-a0ac-114d6ba1edb6', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c6679d21-6adb-4b94-917d-30ddaf8cba68 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60358d66-5466-4394-9b95-1d33dd4d60a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:07 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d7d133-7777-49f2-b7ea-bca52463d535]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:36:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7642f724-2ce4-4da5-bb48-24c443c727ee tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:07 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-c6679d21-6adb-4b94-917d-30ddaf8cba68 tempest-CreateVolumesFromImageTest-1017882793 None] Volume volume-dc215c63-a3fc-4145-a0ac-114d6ba1edb6 (dc215c63-a3fc-4145-a0ac-114d6ba1edb6): created successfully Jul 16 23:36:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c6679d21-6adb-4b94-917d-30ddaf8cba68 tempest-CreateVolumesFromImageTest-1017882793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60358d66-5466-4394-9b95-1d33dd4d60a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-c6679d21-6adb-4b94-917d-30ddaf8cba68 tempest-CreateVolumesFromImageTest-1017882793 None] Flow 'volume_create_manager' (7c2785af-2e47-4c37-8dbb-fe8a20036177) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:36:07 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-c6679d21-6adb-4b94-917d-30ddaf8cba68 tempest-CreateVolumesFromImageTest-1017882793 None] Created volume successfully. Jul 16 23:36:08 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b Jul 16 23:36:08 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:08 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e5f3e074-1071-4cd8-ae71-8d77b08cde59 tempest-CreateVolumesFromImageTest-1017882793 None] Acquiring lock "cinder-dc215c63-a3fc-4145-a0ac-114d6ba1edb6-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:08 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e5f3e074-1071-4cd8-ae71-8d77b08cde59 tempest-CreateVolumesFromImageTest-1017882793 None] Lock "cinder-dc215c63-a3fc-4145-a0ac-114d6ba1edb6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:08 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e5f3e074-1071-4cd8-ae71-8d77b08cde59 tempest-CreateVolumesFromImageTest-1017882793 None] Acquiring lock "cinder-quobyte-dc215c63-a3fc-4145-a0ac-114d6ba1edb6" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:08 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e5f3e074-1071-4cd8-ae71-8d77b08cde59 tempest-CreateVolumesFromImageTest-1017882793 None] Lock "cinder-quobyte-dc215c63-a3fc-4145-a0ac-114d6ba1edb6" acquired by "delete_volume" :: waited 0.020s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:08 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7642f724-2ce4-4da5-bb48-24c443c727ee tempest-ProjectMemberTests-1023405772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b" returned: 0 in 0.472s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7642f724-2ce4-4da5-bb48-24c443c727ee tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b.ca1f188c-4d3a-4d22-990b-b483b3f05eca 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:08 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6f3b25-aaaa-4e2f-8594-dbec260f64eb]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:36:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e5f3e074-1071-4cd8-ae71-8d77b08cde59 tempest-CreateVolumesFromImageTest-1017882793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-dc215c63-a3fc-4145-a0ac-114d6ba1edb6 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:08 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b.ca1f188c-4d3a-4d22-990b-b483b3f05eca 1G Jul 16 23:36:08 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:08 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-dc215c63-a3fc-4145-a0ac-114d6ba1edb6 Jul 16 23:36:08 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:08 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:08 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e5f3e074-1071-4cd8-ae71-8d77b08cde59 tempest-CreateVolumesFromImageTest-1017882793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-dc215c63-a3fc-4145-a0ac-114d6ba1edb6" returned: 0 in 0.439s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e5f3e074-1071-4cd8-ae71-8d77b08cde59 tempest-CreateVolumesFromImageTest-1017882793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-dc215c63-a3fc-4145-a0ac-114d6ba1edb6 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7642f724-2ce4-4da5-bb48-24c443c727ee tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b.ca1f188c-4d3a-4d22-990b-b483b3f05eca 1G" returned: 0 in 0.469s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7642f724-2ce4-4da5-bb48-24c443c727ee tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e245bb89-22e4-4e73-98f8-a8578619077b -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b.ca1f188c-4d3a-4d22-990b-b483b3f05eca {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:08 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-dc215c63-a3fc-4145-a0ac-114d6ba1edb6 Jul 16 23:36:08 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:08 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e245bb89-22e4-4e73-98f8-a8578619077b -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b.ca1f188c-4d3a-4d22-990b-b483b3f05eca Jul 16 23:36:08 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:09 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e5f3e074-1071-4cd8-ae71-8d77b08cde59 tempest-CreateVolumesFromImageTest-1017882793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-dc215c63-a3fc-4145-a0ac-114d6ba1edb6" returned: 0 in 0.303s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:09 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e5f3e074-1071-4cd8-ae71-8d77b08cde59 tempest-CreateVolumesFromImageTest-1017882793 None] Lock "cinder-quobyte-dc215c63-a3fc-4145-a0ac-114d6ba1edb6" released by "delete_volume" :: held 0.803s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:09 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7642f724-2ce4-4da5-bb48-24c443c727ee tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e245bb89-22e4-4e73-98f8-a8578619077b -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b.ca1f188c-4d3a-4d22-990b-b483b3f05eca" returned: 0 in 0.351s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:09 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-7642f724-2ce4-4da5-bb48-24c443c727ee tempest-ProjectMemberTests-1023405772 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b.ca1f188c-4d3a-4d22-990b-b483b3f05eca is being set with open permissions: ugo+rw Jul 16 23:36:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7642f724-2ce4-4da5-bb48-24c443c727ee tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b.ca1f188c-4d3a-4d22-990b-b483b3f05eca {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:09 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-e5f3e074-1071-4cd8-ae71-8d77b08cde59 tempest-CreateVolumesFromImageTest-1017882793 None] Created reservations ['87d6dad2-f264-4904-9491-5a8550bb7b38', 'e04bff0e-f933-468c-a8dd-7bdade6ece58', '7f236cae-73bb-479e-87a6-79c8c9af08d3', '597381fc-7274-4216-b345-55d1a4678bf3'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:36:09 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b.ca1f188c-4d3a-4d22-990b-b483b3f05eca Jul 16 23:36:09 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e5f3e074-1071-4cd8-ae71-8d77b08cde59 tempest-CreateVolumesFromImageTest-1017882793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e5f3e074-1071-4cd8-ae71-8d77b08cde59 tempest-CreateVolumesFromImageTest-1017882793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:09 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e5f3e074-1071-4cd8-ae71-8d77b08cde59 tempest-CreateVolumesFromImageTest-1017882793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:09 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e5f3e074-1071-4cd8-ae71-8d77b08cde59 tempest-CreateVolumesFromImageTest-1017882793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e5f3e074-1071-4cd8-ae71-8d77b08cde59 tempest-CreateVolumesFromImageTest-1017882793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e5f3e074-1071-4cd8-ae71-8d77b08cde59 tempest-CreateVolumesFromImageTest-1017882793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:09 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:36:09 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:09 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fa698f19-9830-4857-9b4e-c95949500d57 tempest-CreateVolumesFromImageTest-1017882793 None] Acquiring lock "cinder-c053ba3f-ccc2-4a61-b8a5-d2c65e0fb9cb-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:09 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fa698f19-9830-4857-9b4e-c95949500d57 tempest-CreateVolumesFromImageTest-1017882793 None] Lock "cinder-c053ba3f-ccc2-4a61-b8a5-d2c65e0fb9cb-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:09 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fa698f19-9830-4857-9b4e-c95949500d57 tempest-CreateVolumesFromImageTest-1017882793 None] Acquiring lock "cinder-quobyte-c053ba3f-ccc2-4a61-b8a5-d2c65e0fb9cb" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:09 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7642f724-2ce4-4da5-bb48-24c443c727ee tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b.ca1f188c-4d3a-4d22-990b-b483b3f05eca" returned: 0 in 0.409s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:09 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fa698f19-9830-4857-9b4e-c95949500d57 tempest-CreateVolumesFromImageTest-1017882793 None] Lock "cinder-quobyte-c053ba3f-ccc2-4a61-b8a5-d2c65e0fb9cb" acquired by "delete_volume" :: waited 0.028s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:09 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e942d48-cf43-4f28-bda2-e9f66ce4c141]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:36:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fa698f19-9830-4857-9b4e-c95949500d57 tempest-CreateVolumesFromImageTest-1017882793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-c053ba3f-ccc2-4a61-b8a5-d2c65e0fb9cb {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7642f724-2ce4-4da5-bb48-24c443c727ee tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:09 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b.info Jul 16 23:36:09 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:09 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e5f3e074-1071-4cd8-ae71-8d77b08cde59 tempest-CreateVolumesFromImageTest-1017882793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.413s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:09 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-e5f3e074-1071-4cd8-ae71-8d77b08cde59 tempest-CreateVolumesFromImageTest-1017882793 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:36:09 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-e5f3e074-1071-4cd8-ae71-8d77b08cde59 tempest-CreateVolumesFromImageTest-1017882793 None] Deleted volume successfully. Jul 16 23:36:09 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e5f3e074-1071-4cd8-ae71-8d77b08cde59 tempest-CreateVolumesFromImageTest-1017882793 None] Lock "cinder-dc215c63-a3fc-4145-a0ac-114d6ba1edb6-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:09 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-c053ba3f-ccc2-4a61-b8a5-d2c65e0fb9cb Jul 16 23:36:09 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:10 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7642f724-2ce4-4da5-bb48-24c443c727ee tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b.info" returned: 0 in 0.359s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:10 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-7642f724-2ce4-4da5-bb48-24c443c727ee tempest-ProjectMemberTests-1023405772 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b.info is being set with open permissions: ugo+rw Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7642f724-2ce4-4da5-bb48-24c443c727ee tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:10 devstack sudo[106551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b.info Jul 16 23:36:10 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:10 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fa698f19-9830-4857-9b4e-c95949500d57 tempest-CreateVolumesFromImageTest-1017882793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-c053ba3f-ccc2-4a61-b8a5-d2c65e0fb9cb" returned: 0 in 0.534s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fa698f19-9830-4857-9b4e-c95949500d57 tempest-CreateVolumesFromImageTest-1017882793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-c053ba3f-ccc2-4a61-b8a5-d2c65e0fb9cb {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:10 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-c053ba3f-ccc2-4a61-b8a5-d2c65e0fb9cb Jul 16 23:36:10 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:10 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7642f724-2ce4-4da5-bb48-24c443c727ee tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b.info" returned: 0 in 0.334s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7642f724-2ce4-4da5-bb48-24c443c727ee tempest-ProjectMemberTests-1023405772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.545s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:10 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-7642f724-2ce4-4da5-bb48-24c443c727ee tempest-ProjectMemberTests-1023405772 None] Create snapshot completed successfully Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-027162ca-5ea8-466f-a316-2648efe60eef tempest-CinderUnicodeTest-1912490025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-027162ca-5ea8-466f-a316-2648efe60eef tempest-CinderUnicodeTest-1912490025 None] Flow 'volume_create_manager' (3bb5c639-55f2-4578-949f-479ee3920c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-027162ca-5ea8-466f-a316-2648efe60eef tempest-CinderUnicodeTest-1912490025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94404a3d-ea96-46ef-8001-81e3366d5571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-027162ca-5ea8-466f-a316-2648efe60eef tempest-CinderUnicodeTest-1912490025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94404a3d-ea96-46ef-8001-81e3366d5571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c211226f-6fc7-4fcc-8873-a48e49aca258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42074c007fb348ad95be9444ce4f8ee6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:36:10Z,use_quota=True,user_id='38574f602b8748168ce15e6524e7ba12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-027162ca-5ea8-466f-a316-2648efe60eef tempest-CinderUnicodeTest-1912490025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd40e9c-7305-4111-88a8-9cfd02d0b3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-027162ca-5ea8-466f-a316-2648efe60eef tempest-CinderUnicodeTest-1912490025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd40e9c-7305-4111-88a8-9cfd02d0b3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-027162ca-5ea8-466f-a316-2648efe60eef tempest-CinderUnicodeTest-1912490025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92d7b890-25cb-41ac-aede-68ee624f7007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-027162ca-5ea8-466f-a316-2648efe60eef tempest-CinderUnicodeTest-1912490025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92d7b890-25cb-41ac-aede-68ee624f7007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c211226f-6fc7-4fcc-8873-a48e49aca258', 'volume_name': 'volume-c211226f-6fc7-4fcc-8873-a48e49aca258', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-027162ca-5ea8-466f-a316-2648efe60eef tempest-CinderUnicodeTest-1912490025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (915517cc-0268-465f-aaf0-fc3b63cf345a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-027162ca-5ea8-466f-a316-2648efe60eef tempest-CinderUnicodeTest-1912490025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (915517cc-0268-465f-aaf0-fc3b63cf345a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-027162ca-5ea8-466f-a316-2648efe60eef tempest-CinderUnicodeTest-1912490025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96443cb3-c7eb-455a-a0da-28ee1b9550fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:10 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-027162ca-5ea8-466f-a316-2648efe60eef tempest-CinderUnicodeTest-1912490025 None] Volume c211226f-6fc7-4fcc-8873-a48e49aca258: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c211226f-6fc7-4fcc-8873-a48e49aca258', 'volume_size': 1} Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-027162ca-5ea8-466f-a316-2648efe60eef tempest-CinderUnicodeTest-1912490025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-027162ca-5ea8-466f-a316-2648efe60eef tempest-CinderUnicodeTest-1912490025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-027162ca-5ea8-466f-a316-2648efe60eef tempest-CinderUnicodeTest-1912490025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c211226f-6fc7-4fcc-8873-a48e49aca258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42074c007fb348ad95be9444ce4f8ee6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:36:10Z,use_quota=True,user_id='38574f602b8748168ce15e6524e7ba12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-027162ca-5ea8-466f-a316-2648efe60eef tempest-CinderUnicodeTest-1912490025 None] Creating volume c211226f-6fc7-4fcc-8873-a48e49aca258 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-027162ca-5ea8-466f-a316-2648efe60eef tempest-CinderUnicodeTest-1912490025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-027162ca-5ea8-466f-a316-2648efe60eef tempest-CinderUnicodeTest-1912490025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-027162ca-5ea8-466f-a316-2648efe60eef tempest-CinderUnicodeTest-1912490025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:10 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-027162ca-5ea8-466f-a316-2648efe60eef tempest-CinderUnicodeTest-1912490025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-027162ca-5ea8-466f-a316-2648efe60eef tempest-CinderUnicodeTest-1912490025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-027162ca-5ea8-466f-a316-2648efe60eef tempest-CinderUnicodeTest-1912490025 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:36:10 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-027162ca-5ea8-466f-a316-2648efe60eef tempest-CinderUnicodeTest-1912490025 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-027162ca-5ea8-466f-a316-2648efe60eef tempest-CinderUnicodeTest-1912490025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-c211226f-6fc7-4fcc-8873-a48e49aca258 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fa698f19-9830-4857-9b4e-c95949500d57 tempest-CreateVolumesFromImageTest-1017882793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-c053ba3f-ccc2-4a61-b8a5-d2c65e0fb9cb" returned: 0 in 0.432s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:10 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-c211226f-6fc7-4fcc-8873-a48e49aca258 1073741824 Jul 16 23:36:10 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fa698f19-9830-4857-9b4e-c95949500d57 tempest-CreateVolumesFromImageTest-1017882793 None] Lock "cinder-quobyte-c053ba3f-ccc2-4a61-b8a5-d2c65e0fb9cb" released by "delete_volume" :: held 1.028s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-45ea7963-58e6-4ecd-8771-c5af1005c975 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-ca1f188c-4d3a-4d22-990b-b483b3f05eca-delete_snapshot" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-fa698f19-9830-4857-9b4e-c95949500d57 tempest-CreateVolumesFromImageTest-1017882793 None] Created reservations ['d88db251-ac75-4f4b-bfa6-e5f09b5c0b03', '5db49cba-7af2-4441-9ef1-224705516a0b', 'fc9e0ef2-a7d4-4416-b08e-157cd4646464', '5dfbf7d9-d7ae-40a0-a7b1-53b55d127e40'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-45ea7963-58e6-4ecd-8771-c5af1005c975 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-ca1f188c-4d3a-4d22-990b-b483b3f05eca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-45ea7963-58e6-4ecd-8771-c5af1005c975 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-quobyte-e245bb89-22e4-4e73-98f8-a8578619077b" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-45ea7963-58e6-4ecd-8771-c5af1005c975 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-e245bb89-22e4-4e73-98f8-a8578619077b" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-45ea7963-58e6-4ecd-8771-c5af1005c975 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-quobyte-ca1f188c-4d3a-4d22-990b-b483b3f05eca" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-45ea7963-58e6-4ecd-8771-c5af1005c975 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-ca1f188c-4d3a-4d22-990b-b483b3f05eca" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-45ea7963-58e6-4ecd-8771-c5af1005c975 tempest-ProjectMemberTests-1023405772 None] Deleting offline snapshot ca1f188c-4d3a-4d22-990b-b483b3f05eca of volume e245bb89-22e4-4e73-98f8-a8578619077b {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-45ea7963-58e6-4ecd-8771-c5af1005c975 tempest-ProjectMemberTests-1023405772 None] snapshot_file for this snap is: volume-e245bb89-22e4-4e73-98f8-a8578619077b.ca1f188c-4d3a-4d22-990b-b483b3f05eca {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[6664f3f8-8f71-4067-9807-735730e09bf9]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-45ea7963-58e6-4ecd-8771-c5af1005c975 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b.ca1f188c-4d3a-4d22-990b-b483b3f05eca {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-fa698f19-9830-4857-9b4e-c95949500d57 tempest-CreateVolumesFromImageTest-1017882793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-fa698f19-9830-4857-9b4e-c95949500d57 tempest-CreateVolumesFromImageTest-1017882793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-fa698f19-9830-4857-9b4e-c95949500d57 tempest-CreateVolumesFromImageTest-1017882793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-fa698f19-9830-4857-9b4e-c95949500d57 tempest-CreateVolumesFromImageTest-1017882793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-fa698f19-9830-4857-9b4e-c95949500d57 tempest-CreateVolumesFromImageTest-1017882793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fa698f19-9830-4857-9b4e-c95949500d57 tempest-CreateVolumesFromImageTest-1017882793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:10 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:36:10 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:10 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b.ca1f188c-4d3a-4d22-990b-b483b3f05eca Jul 16 23:36:10 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:11 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fa698f19-9830-4857-9b4e-c95949500d57 tempest-CreateVolumesFromImageTest-1017882793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.318s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:11 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-fa698f19-9830-4857-9b4e-c95949500d57 tempest-CreateVolumesFromImageTest-1017882793 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:36:11 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-fa698f19-9830-4857-9b4e-c95949500d57 tempest-CreateVolumesFromImageTest-1017882793 None] Deleted volume successfully. Jul 16 23:36:11 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-027162ca-5ea8-466f-a316-2648efe60eef tempest-CinderUnicodeTest-1912490025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-c211226f-6fc7-4fcc-8873-a48e49aca258 1073741824" returned: 0 in 0.595s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:11 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fa698f19-9830-4857-9b4e-c95949500d57 tempest-CreateVolumesFromImageTest-1017882793 None] Lock "cinder-c053ba3f-ccc2-4a61-b8a5-d2c65e0fb9cb-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-027162ca-5ea8-466f-a316-2648efe60eef tempest-CinderUnicodeTest-1912490025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-c211226f-6fc7-4fcc-8873-a48e49aca258 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:11 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-c211226f-6fc7-4fcc-8873-a48e49aca258 Jul 16 23:36:11 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:11 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-45ea7963-58e6-4ecd-8771-c5af1005c975 tempest-ProjectMemberTests-1023405772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b.ca1f188c-4d3a-4d22-990b-b483b3f05eca" returned: 0 in 0.457s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:11 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-45ea7963-58e6-4ecd-8771-c5af1005c975 tempest-ProjectMemberTests-1023405772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e245bb89-22e4-4e73-98f8-a8578619077b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:36:11 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bdb107b-bd64-4e12-afdb-6cb8ddb1a8e2]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:36:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-45ea7963-58e6-4ecd-8771-c5af1005c975 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:11 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b Jul 16 23:36:11 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:11 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-027162ca-5ea8-466f-a316-2648efe60eef tempest-CinderUnicodeTest-1912490025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-c211226f-6fc7-4fcc-8873-a48e49aca258" returned: 0 in 0.299s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:11 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-027162ca-5ea8-466f-a316-2648efe60eef tempest-CinderUnicodeTest-1912490025 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:36:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-027162ca-5ea8-466f-a316-2648efe60eef tempest-CinderUnicodeTest-1912490025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:11 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-027162ca-5ea8-466f-a316-2648efe60eef tempest-CinderUnicodeTest-1912490025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96443cb3-c7eb-455a-a0da-28ee1b9550fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c211226f-6fc7-4fcc-8873-a48e49aca258', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:11 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-027162ca-5ea8-466f-a316-2648efe60eef tempest-CinderUnicodeTest-1912490025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad537b98-d5df-4cb8-a0f0-7c016cbd07b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:11 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-027162ca-5ea8-466f-a316-2648efe60eef tempest-CinderUnicodeTest-1912490025 None] Volume volume-c211226f-6fc7-4fcc-8873-a48e49aca258 (c211226f-6fc7-4fcc-8873-a48e49aca258): created successfully Jul 16 23:36:11 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-027162ca-5ea8-466f-a316-2648efe60eef tempest-CinderUnicodeTest-1912490025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad537b98-d5df-4cb8-a0f0-7c016cbd07b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:11 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-027162ca-5ea8-466f-a316-2648efe60eef tempest-CinderUnicodeTest-1912490025 None] Flow 'volume_create_manager' (3bb5c639-55f2-4578-949f-479ee3920c61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:36:11 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-027162ca-5ea8-466f-a316-2648efe60eef tempest-CinderUnicodeTest-1912490025 None] Created volume successfully. Jul 16 23:36:11 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-777062cd-baa4-43b1-b4e4-33f8b8b3f6ec tempest-CreateVolumesFromImageTest-1017882793 None] Acquiring lock "cinder-6fbf5f45-c1c6-47de-b43f-091c36b6ca56-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:11 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-777062cd-baa4-43b1-b4e4-33f8b8b3f6ec tempest-CreateVolumesFromImageTest-1017882793 None] Lock "cinder-6fbf5f45-c1c6-47de-b43f-091c36b6ca56-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:11 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-777062cd-baa4-43b1-b4e4-33f8b8b3f6ec tempest-CreateVolumesFromImageTest-1017882793 None] Acquiring lock "cinder-quobyte-6fbf5f45-c1c6-47de-b43f-091c36b6ca56" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:11 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-45ea7963-58e6-4ecd-8771-c5af1005c975 tempest-ProjectMemberTests-1023405772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b" returned: 0 in 0.520s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-45ea7963-58e6-4ecd-8771-c5af1005c975 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b.ca1f188c-4d3a-4d22-990b-b483b3f05eca {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:11 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-777062cd-baa4-43b1-b4e4-33f8b8b3f6ec tempest-CreateVolumesFromImageTest-1017882793 None] Lock "cinder-quobyte-6fbf5f45-c1c6-47de-b43f-091c36b6ca56" acquired by "delete_volume" :: waited 0.037s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:11 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b.ca1f188c-4d3a-4d22-990b-b483b3f05eca Jul 16 23:36:11 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:11 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[43dd5a0c-34c8-4298-b2c0-a7d6186a132f]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:36:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-777062cd-baa4-43b1-b4e4-33f8b8b3f6ec tempest-CreateVolumesFromImageTest-1017882793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6fbf5f45-c1c6-47de-b43f-091c36b6ca56 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:12 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6fbf5f45-c1c6-47de-b43f-091c36b6ca56 Jul 16 23:36:12 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:12 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-45ea7963-58e6-4ecd-8771-c5af1005c975 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b.ca1f188c-4d3a-4d22-990b-b483b3f05eca" returned: 0 in 0.407s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-45ea7963-58e6-4ecd-8771-c5af1005c975 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b.ca1f188c-4d3a-4d22-990b-b483b3f05eca {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:12 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b.ca1f188c-4d3a-4d22-990b-b483b3f05eca Jul 16 23:36:12 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:12 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-777062cd-baa4-43b1-b4e4-33f8b8b3f6ec tempest-CreateVolumesFromImageTest-1017882793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6fbf5f45-c1c6-47de-b43f-091c36b6ca56" returned: 0 in 0.410s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-777062cd-baa4-43b1-b4e4-33f8b8b3f6ec tempest-CreateVolumesFromImageTest-1017882793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6fbf5f45-c1c6-47de-b43f-091c36b6ca56 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:12 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6fbf5f45-c1c6-47de-b43f-091c36b6ca56 Jul 16 23:36:12 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:12 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-45ea7963-58e6-4ecd-8771-c5af1005c975 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b.ca1f188c-4d3a-4d22-990b-b483b3f05eca" returned: 0 in 0.295s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:12 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-777062cd-baa4-43b1-b4e4-33f8b8b3f6ec tempest-CreateVolumesFromImageTest-1017882793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-6fbf5f45-c1c6-47de-b43f-091c36b6ca56" returned: 0 in 0.280s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:12 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-45ea7963-58e6-4ecd-8771-c5af1005c975 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-ca1f188c-4d3a-4d22-990b-b483b3f05eca" released by "_delete_snapshot" :: held 1.835s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:12 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-777062cd-baa4-43b1-b4e4-33f8b8b3f6ec tempest-CreateVolumesFromImageTest-1017882793 None] Lock "cinder-quobyte-6fbf5f45-c1c6-47de-b43f-091c36b6ca56" released by "delete_volume" :: held 0.757s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:12 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-45ea7963-58e6-4ecd-8771-c5af1005c975 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-e245bb89-22e4-4e73-98f8-a8578619077b" released by "delete_snapshot" :: held 1.881s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:12 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-777062cd-baa4-43b1-b4e4-33f8b8b3f6ec tempest-CreateVolumesFromImageTest-1017882793 None] Created reservations ['91c43d59-2bb0-41c5-9a72-3a89b2e8e262', 'd872874c-39a8-4730-a4c3-bfb305b832ff', 'aaa9d9df-dc53-4702-a187-5c857d9e2edf', '4954f6d1-e144-421e-b2aa-e64aa802cfa3'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:36:12 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-45ea7963-58e6-4ecd-8771-c5af1005c975 tempest-ProjectMemberTests-1023405772 None] Created reservations ['863c43c3-2235-4044-b18e-ba5bf2f13f6f', '8291960f-491b-4460-9dd9-30686c0c9d7d', '00e3ec89-7590-4627-a561-29b43c06a45a', 'bcc93325-092b-40f9-94b7-ba6c15565251'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:36:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-777062cd-baa4-43b1-b4e4-33f8b8b3f6ec tempest-CreateVolumesFromImageTest-1017882793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-777062cd-baa4-43b1-b4e4-33f8b8b3f6ec tempest-CreateVolumesFromImageTest-1017882793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:12 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-777062cd-baa4-43b1-b4e4-33f8b8b3f6ec tempest-CreateVolumesFromImageTest-1017882793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:12 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-777062cd-baa4-43b1-b4e4-33f8b8b3f6ec tempest-CreateVolumesFromImageTest-1017882793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-777062cd-baa4-43b1-b4e4-33f8b8b3f6ec tempest-CreateVolumesFromImageTest-1017882793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-777062cd-baa4-43b1-b4e4-33f8b8b3f6ec tempest-CreateVolumesFromImageTest-1017882793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:12 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:36:12 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:12 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-45ea7963-58e6-4ecd-8771-c5af1005c975 tempest-ProjectMemberTests-1023405772 None] Delete snapshot completed successfully. Jul 16 23:36:12 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-45ea7963-58e6-4ecd-8771-c5af1005c975 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-ca1f188c-4d3a-4d22-990b-b483b3f05eca-delete_snapshot" released by "delete_snapshot" :: held 2.182s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:12 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-01192d36-a93f-41dd-9389-9c9eb662307a tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-e245bb89-22e4-4e73-98f8-a8578619077b-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:12 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-01192d36-a93f-41dd-9389-9c9eb662307a tempest-ProjectMemberTests-1023405772 None] Lock "cinder-e245bb89-22e4-4e73-98f8-a8578619077b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:13 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-01192d36-a93f-41dd-9389-9c9eb662307a tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-quobyte-e245bb89-22e4-4e73-98f8-a8578619077b" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:13 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-01192d36-a93f-41dd-9389-9c9eb662307a tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-e245bb89-22e4-4e73-98f8-a8578619077b" acquired by "delete_volume" :: waited 0.031s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:13 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[46836152-eef6-4252-9e00-931495a33525]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:36:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-01192d36-a93f-41dd-9389-9c9eb662307a tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:13 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-80014c04-d95b-409f-b05e-8b4382cc6300 tempest-CreateVolumesFromImageTest-1017882793 None] Acquiring lock "cinder-ebf70375-6d3e-4fd3-8fda-6d5b0c6facda-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:13 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-777062cd-baa4-43b1-b4e4-33f8b8b3f6ec tempest-CreateVolumesFromImageTest-1017882793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.440s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:13 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-777062cd-baa4-43b1-b4e4-33f8b8b3f6ec tempest-CreateVolumesFromImageTest-1017882793 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:36:13 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-777062cd-baa4-43b1-b4e4-33f8b8b3f6ec tempest-CreateVolumesFromImageTest-1017882793 None] Deleted volume successfully. Jul 16 23:36:13 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-80014c04-d95b-409f-b05e-8b4382cc6300 tempest-CreateVolumesFromImageTest-1017882793 None] Lock "cinder-ebf70375-6d3e-4fd3-8fda-6d5b0c6facda-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:13 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-777062cd-baa4-43b1-b4e4-33f8b8b3f6ec tempest-CreateVolumesFromImageTest-1017882793 None] Lock "cinder-6fbf5f45-c1c6-47de-b43f-091c36b6ca56-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:13 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-80014c04-d95b-409f-b05e-8b4382cc6300 tempest-CreateVolumesFromImageTest-1017882793 None] Acquiring lock "cinder-quobyte-ebf70375-6d3e-4fd3-8fda-6d5b0c6facda" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:13 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-80014c04-d95b-409f-b05e-8b4382cc6300 tempest-CreateVolumesFromImageTest-1017882793 None] Lock "cinder-quobyte-ebf70375-6d3e-4fd3-8fda-6d5b0c6facda" acquired by "delete_volume" :: waited 0.018s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:13 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cf1e657-ff5f-4328-8093-fb199cda8c7e tempest-CinderUnicodeTest-1912490025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:36:13 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b Jul 16 23:36:13 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:13 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-8cf1e657-ff5f-4328-8093-fb199cda8c7e tempest-CinderUnicodeTest-1912490025 None] Flow 'volume_create_manager' (f01cabaa-af38-4655-8362-c1c6a41e6da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:36:13 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-8cf1e657-ff5f-4328-8093-fb199cda8c7e tempest-CinderUnicodeTest-1912490025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc323a75-526c-432e-bf95-7eaa8f68daaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:13 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a43669-1568-4356-bce7-c29dd779377c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:36:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-80014c04-d95b-409f-b05e-8b4382cc6300 tempest-CreateVolumesFromImageTest-1017882793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ebf70375-6d3e-4fd3-8fda-6d5b0c6facda {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:13 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-8cf1e657-ff5f-4328-8093-fb199cda8c7e tempest-CinderUnicodeTest-1912490025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc323a75-526c-432e-bf95-7eaa8f68daaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:36:13Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-355329333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d91d040-557b-4f5c-8aa9-d43f98e25040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42074c007fb348ad95be9444ce4f8ee6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:36:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:36:13Z,use_quota=True,user_id='38574f602b8748168ce15e6524e7ba12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:13 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-8cf1e657-ff5f-4328-8093-fb199cda8c7e tempest-CinderUnicodeTest-1912490025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7e667f6-2235-4f32-ae89-9735dee60f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:13 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-8cf1e657-ff5f-4328-8093-fb199cda8c7e tempest-CinderUnicodeTest-1912490025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7e667f6-2235-4f32-ae89-9735dee60f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:13 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-8cf1e657-ff5f-4328-8093-fb199cda8c7e tempest-CinderUnicodeTest-1912490025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab2fda8b-7a8f-4fe1-ba9e-ad7e875a71ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:13 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-8cf1e657-ff5f-4328-8093-fb199cda8c7e tempest-CinderUnicodeTest-1912490025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab2fda8b-7a8f-4fe1-ba9e-ad7e875a71ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d91d040-557b-4f5c-8aa9-d43f98e25040', 'volume_name': 'volume-0d91d040-557b-4f5c-8aa9-d43f98e25040', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:13 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-8cf1e657-ff5f-4328-8093-fb199cda8c7e tempest-CinderUnicodeTest-1912490025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8c80952-c534-4f90-bcef-a0beed02d168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:13 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-8cf1e657-ff5f-4328-8093-fb199cda8c7e tempest-CinderUnicodeTest-1912490025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8c80952-c534-4f90-bcef-a0beed02d168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:13 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-8cf1e657-ff5f-4328-8093-fb199cda8c7e tempest-CinderUnicodeTest-1912490025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbd79648-0074-4939-b03f-c0609e430256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:13 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-8cf1e657-ff5f-4328-8093-fb199cda8c7e tempest-CinderUnicodeTest-1912490025 None] Volume 0d91d040-557b-4f5c-8aa9-d43f98e25040: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d91d040-557b-4f5c-8aa9-d43f98e25040', 'volume_size': 1} Jul 16 23:36:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-8cf1e657-ff5f-4328-8093-fb199cda8c7e tempest-CinderUnicodeTest-1912490025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-8cf1e657-ff5f-4328-8093-fb199cda8c7e tempest-CinderUnicodeTest-1912490025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:13 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-8cf1e657-ff5f-4328-8093-fb199cda8c7e tempest-CinderUnicodeTest-1912490025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:36:13Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-355329333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d91d040-557b-4f5c-8aa9-d43f98e25040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42074c007fb348ad95be9444ce4f8ee6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:36:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:36:13Z,use_quota=True,user_id='38574f602b8748168ce15e6524e7ba12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:36:13 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-8cf1e657-ff5f-4328-8093-fb199cda8c7e tempest-CinderUnicodeTest-1912490025 None] Creating volume 0d91d040-557b-4f5c-8aa9-d43f98e25040 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:36:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-8cf1e657-ff5f-4328-8093-fb199cda8c7e tempest-CinderUnicodeTest-1912490025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-8cf1e657-ff5f-4328-8093-fb199cda8c7e tempest-CinderUnicodeTest-1912490025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:13 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-8cf1e657-ff5f-4328-8093-fb199cda8c7e tempest-CinderUnicodeTest-1912490025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:13 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-8cf1e657-ff5f-4328-8093-fb199cda8c7e tempest-CinderUnicodeTest-1912490025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-8cf1e657-ff5f-4328-8093-fb199cda8c7e tempest-CinderUnicodeTest-1912490025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:13 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-8cf1e657-ff5f-4328-8093-fb199cda8c7e tempest-CinderUnicodeTest-1912490025 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:36:13 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-8cf1e657-ff5f-4328-8093-fb199cda8c7e tempest-CinderUnicodeTest-1912490025 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:36:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8cf1e657-ff5f-4328-8093-fb199cda8c7e tempest-CinderUnicodeTest-1912490025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:13 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ebf70375-6d3e-4fd3-8fda-6d5b0c6facda Jul 16 23:36:13 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:13 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040 1073741824 Jul 16 23:36:13 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:13 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-01192d36-a93f-41dd-9389-9c9eb662307a tempest-ProjectMemberTests-1023405772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b" returned: 0 in 0.538s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-01192d36-a93f-41dd-9389-9c9eb662307a tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:13 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b Jul 16 23:36:13 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:13 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-80014c04-d95b-409f-b05e-8b4382cc6300 tempest-CreateVolumesFromImageTest-1017882793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ebf70375-6d3e-4fd3-8fda-6d5b0c6facda" returned: 0 in 0.397s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-80014c04-d95b-409f-b05e-8b4382cc6300 tempest-CreateVolumesFromImageTest-1017882793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ebf70375-6d3e-4fd3-8fda-6d5b0c6facda {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:13 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ebf70375-6d3e-4fd3-8fda-6d5b0c6facda Jul 16 23:36:13 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:13 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-01192d36-a93f-41dd-9389-9c9eb662307a tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-e245bb89-22e4-4e73-98f8-a8578619077b" returned: 0 in 0.300s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:14 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8cf1e657-ff5f-4328-8093-fb199cda8c7e tempest-CinderUnicodeTest-1912490025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040 1073741824" returned: 0 in 0.500s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:14 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-01192d36-a93f-41dd-9389-9c9eb662307a tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-e245bb89-22e4-4e73-98f8-a8578619077b" released by "delete_volume" :: held 0.940s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8cf1e657-ff5f-4328-8093-fb199cda8c7e tempest-CinderUnicodeTest-1912490025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:14 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040 Jul 16 23:36:14 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:14 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-01192d36-a93f-41dd-9389-9c9eb662307a tempest-ProjectMemberTests-1023405772 None] Created reservations ['4da530bb-0578-4f7c-8040-a7f7d539d948', '21409151-be3f-4f68-95e4-ba2e49600ce6', '42fd05bb-6835-4487-8e34-ff5b6b4d6554', 'e7233583-3ae1-4b58-acac-63047351e46a'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:36:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-01192d36-a93f-41dd-9389-9c9eb662307a tempest-ProjectMemberTests-1023405772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-01192d36-a93f-41dd-9389-9c9eb662307a tempest-ProjectMemberTests-1023405772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:14 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-01192d36-a93f-41dd-9389-9c9eb662307a tempest-ProjectMemberTests-1023405772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:14 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:14 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-01192d36-a93f-41dd-9389-9c9eb662307a tempest-ProjectMemberTests-1023405772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-01192d36-a93f-41dd-9389-9c9eb662307a tempest-ProjectMemberTests-1023405772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-01192d36-a93f-41dd-9389-9c9eb662307a tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-80014c04-d95b-409f-b05e-8b4382cc6300 tempest-CreateVolumesFromImageTest-1017882793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-ebf70375-6d3e-4fd3-8fda-6d5b0c6facda" returned: 0 in 0.397s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:14 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:36:14 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:14 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-80014c04-d95b-409f-b05e-8b4382cc6300 tempest-CreateVolumesFromImageTest-1017882793 None] Lock "cinder-quobyte-ebf70375-6d3e-4fd3-8fda-6d5b0c6facda" released by "delete_volume" :: held 0.895s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:14 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-80014c04-d95b-409f-b05e-8b4382cc6300 tempest-CreateVolumesFromImageTest-1017882793 None] Created reservations ['a156479a-efd5-4f4e-a8c2-78d4b2efe240', '0d95e3eb-d1a9-43b3-91a2-bb02b6d49f54', 'a39f2fde-acbc-44f2-b929-62ed1ede316e', '9804f82f-a6ca-4a85-a6aa-1d6abb624580'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:36:14 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8cf1e657-ff5f-4328-8093-fb199cda8c7e tempest-CinderUnicodeTest-1912490025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040" returned: 0 in 0.368s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:14 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-8cf1e657-ff5f-4328-8093-fb199cda8c7e tempest-CinderUnicodeTest-1912490025 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:36:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-8cf1e657-ff5f-4328-8093-fb199cda8c7e tempest-CinderUnicodeTest-1912490025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:14 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-8cf1e657-ff5f-4328-8093-fb199cda8c7e tempest-CinderUnicodeTest-1912490025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbd79648-0074-4939-b03f-c0609e430256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d91d040-557b-4f5c-8aa9-d43f98e25040', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:14 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-8cf1e657-ff5f-4328-8093-fb199cda8c7e tempest-CinderUnicodeTest-1912490025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a196ce6-23f8-4283-9cba-54904a25f9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-80014c04-d95b-409f-b05e-8b4382cc6300 tempest-CreateVolumesFromImageTest-1017882793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-80014c04-d95b-409f-b05e-8b4382cc6300 tempest-CreateVolumesFromImageTest-1017882793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:14 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-80014c04-d95b-409f-b05e-8b4382cc6300 tempest-CreateVolumesFromImageTest-1017882793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:14 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-80014c04-d95b-409f-b05e-8b4382cc6300 tempest-CreateVolumesFromImageTest-1017882793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-80014c04-d95b-409f-b05e-8b4382cc6300 tempest-CreateVolumesFromImageTest-1017882793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-80014c04-d95b-409f-b05e-8b4382cc6300 tempest-CreateVolumesFromImageTest-1017882793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:14 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-8cf1e657-ff5f-4328-8093-fb199cda8c7e tempest-CinderUnicodeTest-1912490025 None] Volume volume-0d91d040-557b-4f5c-8aa9-d43f98e25040 (0d91d040-557b-4f5c-8aa9-d43f98e25040): created successfully Jul 16 23:36:14 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-8cf1e657-ff5f-4328-8093-fb199cda8c7e tempest-CinderUnicodeTest-1912490025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a196ce6-23f8-4283-9cba-54904a25f9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:14 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-8cf1e657-ff5f-4328-8093-fb199cda8c7e tempest-CinderUnicodeTest-1912490025 None] Flow 'volume_create_manager' (f01cabaa-af38-4655-8362-c1c6a41e6da6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:36:14 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-01192d36-a93f-41dd-9389-9c9eb662307a tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.329s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:14 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-01192d36-a93f-41dd-9389-9c9eb662307a tempest-ProjectMemberTests-1023405772 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:36:14 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:36:14 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:14 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-01192d36-a93f-41dd-9389-9c9eb662307a tempest-ProjectMemberTests-1023405772 None] Deleted volume successfully. Jul 16 23:36:14 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-8cf1e657-ff5f-4328-8093-fb199cda8c7e tempest-CinderUnicodeTest-1912490025 None] Created volume successfully. Jul 16 23:36:14 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-01192d36-a93f-41dd-9389-9c9eb662307a tempest-ProjectMemberTests-1023405772 None] Lock "cinder-e245bb89-22e4-4e73-98f8-a8578619077b-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:14 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-80014c04-d95b-409f-b05e-8b4382cc6300 tempest-CreateVolumesFromImageTest-1017882793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.294s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:14 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-80014c04-d95b-409f-b05e-8b4382cc6300 tempest-CreateVolumesFromImageTest-1017882793 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:36:14 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-80014c04-d95b-409f-b05e-8b4382cc6300 tempest-CreateVolumesFromImageTest-1017882793 None] Deleted volume successfully. Jul 16 23:36:14 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-80014c04-d95b-409f-b05e-8b4382cc6300 tempest-CreateVolumesFromImageTest-1017882793 None] Lock "cinder-ebf70375-6d3e-4fd3-8fda-6d5b0c6facda-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:14 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-998f6516-25df-4a82-b879-39f7507c191c tempest-CreateVolumesFromImageTest-1017882793 None] Acquiring lock "cinder-8f988a10-3b8e-404e-b798-65233272d5d4-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:14 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-998f6516-25df-4a82-b879-39f7507c191c tempest-CreateVolumesFromImageTest-1017882793 None] Lock "cinder-8f988a10-3b8e-404e-b798-65233272d5d4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:14 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-998f6516-25df-4a82-b879-39f7507c191c tempest-CreateVolumesFromImageTest-1017882793 None] Acquiring lock "cinder-quobyte-8f988a10-3b8e-404e-b798-65233272d5d4" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:14 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-998f6516-25df-4a82-b879-39f7507c191c tempest-CreateVolumesFromImageTest-1017882793 None] Lock "cinder-quobyte-8f988a10-3b8e-404e-b798-65233272d5d4" acquired by "delete_volume" :: waited 0.022s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7552b1b-f261-4572-a79a-f697d4b90e90]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-998f6516-25df-4a82-b879-39f7507c191c tempest-CreateVolumesFromImageTest-1017882793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8f988a10-3b8e-404e-b798-65233272d5d4 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:15 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8f988a10-3b8e-404e-b798-65233272d5d4 Jul 16 23:36:15 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4e3a776-dce6-42f9-ac54-eac607606bf1 tempest-ProjectMemberTests-1023405772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d4e3a776-dce6-42f9-ac54-eac607606bf1 tempest-ProjectMemberTests-1023405772 None] Flow 'volume_create_manager' (3586819b-0461-4409-bd58-9db1a75db728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d4e3a776-dce6-42f9-ac54-eac607606bf1 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42b4b93-4052-427a-87fc-d901c2e07603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d4e3a776-dce6-42f9-ac54-eac607606bf1 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42b4b93-4052-427a-87fc-d901c2e07603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1048999451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06a7400e-249c-474d-9c9e-41cd44e64b92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b14a0052f8fb4344b121d3a20292b053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:36:15Z,use_quota=True,user_id='faa7527cbba84668895a85e3faa36efb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d4e3a776-dce6-42f9-ac54-eac607606bf1 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fc162f9-622d-454b-966e-aa81fdd9eaf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d4e3a776-dce6-42f9-ac54-eac607606bf1 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fc162f9-622d-454b-966e-aa81fdd9eaf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d4e3a776-dce6-42f9-ac54-eac607606bf1 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (194c0893-6cef-4e65-850c-7548b27cd1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d4e3a776-dce6-42f9-ac54-eac607606bf1 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (194c0893-6cef-4e65-850c-7548b27cd1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06a7400e-249c-474d-9c9e-41cd44e64b92', 'volume_name': 'volume-06a7400e-249c-474d-9c9e-41cd44e64b92', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d4e3a776-dce6-42f9-ac54-eac607606bf1 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b9593e4-3f2b-4e10-8461-a729152e718b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d4e3a776-dce6-42f9-ac54-eac607606bf1 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b9593e4-3f2b-4e10-8461-a729152e718b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d4e3a776-dce6-42f9-ac54-eac607606bf1 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (697476f1-308e-498c-9028-65f282e0d1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:15 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-d4e3a776-dce6-42f9-ac54-eac607606bf1 tempest-ProjectMemberTests-1023405772 None] Volume 06a7400e-249c-474d-9c9e-41cd44e64b92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06a7400e-249c-474d-9c9e-41cd44e64b92', 'volume_size': 1} Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-d4e3a776-dce6-42f9-ac54-eac607606bf1 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-d4e3a776-dce6-42f9-ac54-eac607606bf1 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-d4e3a776-dce6-42f9-ac54-eac607606bf1 tempest-ProjectMemberTests-1023405772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1048999451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06a7400e-249c-474d-9c9e-41cd44e64b92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b14a0052f8fb4344b121d3a20292b053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:36:15Z,use_quota=True,user_id='faa7527cbba84668895a85e3faa36efb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-d4e3a776-dce6-42f9-ac54-eac607606bf1 tempest-ProjectMemberTests-1023405772 None] Creating volume 06a7400e-249c-474d-9c9e-41cd44e64b92 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-d4e3a776-dce6-42f9-ac54-eac607606bf1 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-d4e3a776-dce6-42f9-ac54-eac607606bf1 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-d4e3a776-dce6-42f9-ac54-eac607606bf1 tempest-ProjectMemberTests-1023405772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-d4e3a776-dce6-42f9-ac54-eac607606bf1 tempest-ProjectMemberTests-1023405772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-d4e3a776-dce6-42f9-ac54-eac607606bf1 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-d4e3a776-dce6-42f9-ac54-eac607606bf1 tempest-ProjectMemberTests-1023405772 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:36:15 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-d4e3a776-dce6-42f9-ac54-eac607606bf1 tempest-ProjectMemberTests-1023405772 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d4e3a776-dce6-42f9-ac54-eac607606bf1 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:15 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92 1073741824 Jul 16 23:36:15 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ebc8658-c834-4084-b69e-9a9034d7e5d8 tempest-ProjectReaderTests-1123006400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-2ebc8658-c834-4084-b69e-9a9034d7e5d8 tempest-ProjectReaderTests-1123006400 None] Flow 'volume_create_manager' (bdf9c00e-b3a6-4411-8373-f811bc5ef8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-2ebc8658-c834-4084-b69e-9a9034d7e5d8 tempest-ProjectReaderTests-1123006400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (163daef3-63e0-4404-9d13-7fed9f977a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b7c61bd9-c59c-4eab-9f78-757820100ae1 tempest-CinderUnicodeTest-1912490025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-2ebc8658-c834-4084-b69e-9a9034d7e5d8 tempest-ProjectReaderTests-1123006400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (163daef3-63e0-4404-9d13-7fed9f977a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-364864192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=965f0da6-0e56-44d6-8024-cbf37645d3e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3716167c74ef4724806c6bf7f079cf9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:36:15Z,use_quota=True,user_id='f38d1cecaf8544afa1783ea2d33c78e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-2ebc8658-c834-4084-b69e-9a9034d7e5d8 tempest-ProjectReaderTests-1123006400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (591acf28-8f4d-49df-9496-76269a48cc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-2ebc8658-c834-4084-b69e-9a9034d7e5d8 tempest-ProjectReaderTests-1123006400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (591acf28-8f4d-49df-9496-76269a48cc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-2ebc8658-c834-4084-b69e-9a9034d7e5d8 tempest-ProjectReaderTests-1123006400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88c09576-7cfe-49f4-934b-2e51f2779d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-2ebc8658-c834-4084-b69e-9a9034d7e5d8 tempest-ProjectReaderTests-1123006400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88c09576-7cfe-49f4-934b-2e51f2779d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '965f0da6-0e56-44d6-8024-cbf37645d3e0', 'volume_name': 'volume-965f0da6-0e56-44d6-8024-cbf37645d3e0', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-2ebc8658-c834-4084-b69e-9a9034d7e5d8 tempest-ProjectReaderTests-1123006400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3efa2c2a-314d-4183-98a7-c888a82eaf3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-2ebc8658-c834-4084-b69e-9a9034d7e5d8 tempest-ProjectReaderTests-1123006400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3efa2c2a-314d-4183-98a7-c888a82eaf3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-2ebc8658-c834-4084-b69e-9a9034d7e5d8 tempest-ProjectReaderTests-1123006400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (108c32f2-9fbf-43dd-bf1c-7f91da871d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:15 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-2ebc8658-c834-4084-b69e-9a9034d7e5d8 tempest-ProjectReaderTests-1123006400 None] Volume 965f0da6-0e56-44d6-8024-cbf37645d3e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-965f0da6-0e56-44d6-8024-cbf37645d3e0', 'volume_size': 1} Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-2ebc8658-c834-4084-b69e-9a9034d7e5d8 tempest-ProjectReaderTests-1123006400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:15 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-998f6516-25df-4a82-b879-39f7507c191c tempest-CreateVolumesFromImageTest-1017882793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8f988a10-3b8e-404e-b798-65233272d5d4" returned: 0 in 0.412s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-998f6516-25df-4a82-b879-39f7507c191c tempest-CreateVolumesFromImageTest-1017882793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8f988a10-3b8e-404e-b798-65233272d5d4 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:15 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8f988a10-3b8e-404e-b798-65233272d5d4 Jul 16 23:36:15 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:15 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-998f6516-25df-4a82-b879-39f7507c191c tempest-CreateVolumesFromImageTest-1017882793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-8f988a10-3b8e-404e-b798-65233272d5d4" returned: 0 in 0.253s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-998f6516-25df-4a82-b879-39f7507c191c tempest-CreateVolumesFromImageTest-1017882793 None] Lock "cinder-quobyte-8f988a10-3b8e-404e-b798-65233272d5d4" released by "delete_volume" :: held 0.719s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:15 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d4e3a776-dce6-42f9-ac54-eac607606bf1 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92 1073741824" returned: 0 in 0.444s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-998f6516-25df-4a82-b879-39f7507c191c tempest-CreateVolumesFromImageTest-1017882793 None] Created reservations ['80cbed49-71e7-499f-84bf-06f9f1c22d81', 'a306c89c-7a4a-4199-a0bd-8f840ab2ac58', '1902a926-1092-4f60-b43e-e46bb25b8588', '59c244ac-9694-4f1d-9643-6fbf592378d3'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d4e3a776-dce6-42f9-ac54-eac607606bf1 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:15 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92 Jul 16 23:36:15 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-998f6516-25df-4a82-b879-39f7507c191c tempest-CreateVolumesFromImageTest-1017882793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-998f6516-25df-4a82-b879-39f7507c191c tempest-CreateVolumesFromImageTest-1017882793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-998f6516-25df-4a82-b879-39f7507c191c tempest-CreateVolumesFromImageTest-1017882793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-998f6516-25df-4a82-b879-39f7507c191c tempest-CreateVolumesFromImageTest-1017882793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-998f6516-25df-4a82-b879-39f7507c191c tempest-CreateVolumesFromImageTest-1017882793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-998f6516-25df-4a82-b879-39f7507c191c tempest-CreateVolumesFromImageTest-1017882793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:15 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:36:15 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:16 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d4e3a776-dce6-42f9-ac54-eac607606bf1 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92" returned: 0 in 0.276s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:16 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-d4e3a776-dce6-42f9-ac54-eac607606bf1 tempest-ProjectMemberTests-1023405772 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:36:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-d4e3a776-dce6-42f9-ac54-eac607606bf1 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b7c61bd9-c59c-4eab-9f78-757820100ae1 tempest-CinderUnicodeTest-1912490025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.687s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:16 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d4e3a776-dce6-42f9-ac54-eac607606bf1 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (697476f1-308e-498c-9028-65f282e0d1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06a7400e-249c-474d-9c9e-41cd44e64b92', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:16 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d4e3a776-dce6-42f9-ac54-eac607606bf1 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e5dfb5d-8d3a-4908-aa97-07dbd346911a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:16 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-b7c61bd9-c59c-4eab-9f78-757820100ae1 tempest-CinderUnicodeTest-1912490025 None] Creating offline snapshot 3ad24e6e-031e-4064-8a0c-bc95f762c637 of volume 0d91d040-557b-4f5c-8aa9-d43f98e25040 {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:36:16 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-d4e3a776-dce6-42f9-ac54-eac607606bf1 tempest-ProjectMemberTests-1023405772 None] Volume volume-06a7400e-249c-474d-9c9e-41cd44e64b92 (06a7400e-249c-474d-9c9e-41cd44e64b92): created successfully Jul 16 23:36:16 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d4e3a776-dce6-42f9-ac54-eac607606bf1 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e5dfb5d-8d3a-4908-aa97-07dbd346911a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:16 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-d4e3a776-dce6-42f9-ac54-eac607606bf1 tempest-ProjectMemberTests-1023405772 None] Flow 'volume_create_manager' (3586819b-0461-4409-bd58-9db1a75db728) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:36:16 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[89841613-66d2-4382-99aa-ef0add3706b8]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:36:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b7c61bd9-c59c-4eab-9f78-757820100ae1 tempest-CinderUnicodeTest-1912490025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:16 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:16 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-d4e3a776-dce6-42f9-ac54-eac607606bf1 tempest-ProjectMemberTests-1023405772 None] Created volume successfully. Jul 16 23:36:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-998f6516-25df-4a82-b879-39f7507c191c tempest-CreateVolumesFromImageTest-1017882793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.296s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:16 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-998f6516-25df-4a82-b879-39f7507c191c tempest-CreateVolumesFromImageTest-1017882793 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:36:16 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-998f6516-25df-4a82-b879-39f7507c191c tempest-CreateVolumesFromImageTest-1017882793 None] Deleted volume successfully. Jul 16 23:36:16 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-998f6516-25df-4a82-b879-39f7507c191c tempest-CreateVolumesFromImageTest-1017882793 None] Lock "cinder-8f988a10-3b8e-404e-b798-65233272d5d4-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:16 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040 Jul 16 23:36:16 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:16 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b7c61bd9-c59c-4eab-9f78-757820100ae1 tempest-CinderUnicodeTest-1912490025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040" returned: 0 in 0.393s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b7c61bd9-c59c-4eab-9f78-757820100ae1 tempest-CinderUnicodeTest-1912490025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040.3ad24e6e-031e-4064-8a0c-bc95f762c637 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:16 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040.3ad24e6e-031e-4064-8a0c-bc95f762c637 1G Jul 16 23:36:16 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:16 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b7c61bd9-c59c-4eab-9f78-757820100ae1 tempest-CinderUnicodeTest-1912490025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040.3ad24e6e-031e-4064-8a0c-bc95f762c637 1G" returned: 0 in 0.472s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:17 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b7c61bd9-c59c-4eab-9f78-757820100ae1 tempest-CinderUnicodeTest-1912490025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d91d040-557b-4f5c-8aa9-d43f98e25040 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040.3ad24e6e-031e-4064-8a0c-bc95f762c637 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:17 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d91d040-557b-4f5c-8aa9-d43f98e25040 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040.3ad24e6e-031e-4064-8a0c-bc95f762c637 Jul 16 23:36:17 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:17 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f0d97da8-d3ef-4136-8e52-b57c9a896c06 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:17 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:17 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b7c61bd9-c59c-4eab-9f78-757820100ae1 tempest-CinderUnicodeTest-1912490025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d91d040-557b-4f5c-8aa9-d43f98e25040 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040.3ad24e6e-031e-4064-8a0c-bc95f762c637" returned: 0 in 0.335s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:17 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-b7c61bd9-c59c-4eab-9f78-757820100ae1 tempest-CinderUnicodeTest-1912490025 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040.3ad24e6e-031e-4064-8a0c-bc95f762c637 is being set with open permissions: ugo+rw Jul 16 23:36:17 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b7c61bd9-c59c-4eab-9f78-757820100ae1 tempest-CinderUnicodeTest-1912490025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040.3ad24e6e-031e-4064-8a0c-bc95f762c637 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:17 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040.3ad24e6e-031e-4064-8a0c-bc95f762c637 Jul 16 23:36:17 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:17 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:17 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b7c61bd9-c59c-4eab-9f78-757820100ae1 tempest-CinderUnicodeTest-1912490025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040.3ad24e6e-031e-4064-8a0c-bc95f762c637" returned: 0 in 0.269s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:17 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b7c61bd9-c59c-4eab-9f78-757820100ae1 tempest-CinderUnicodeTest-1912490025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:17 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040.info Jul 16 23:36:17 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:17 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:17 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b7c61bd9-c59c-4eab-9f78-757820100ae1 tempest-CinderUnicodeTest-1912490025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040.info" returned: 0 in 0.259s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:17 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-b7c61bd9-c59c-4eab-9f78-757820100ae1 tempest-CinderUnicodeTest-1912490025 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040.info is being set with open permissions: ugo+rw Jul 16 23:36:17 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b7c61bd9-c59c-4eab-9f78-757820100ae1 tempest-CinderUnicodeTest-1912490025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:17 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040.info Jul 16 23:36:17 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:18 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b7c61bd9-c59c-4eab-9f78-757820100ae1 tempest-CinderUnicodeTest-1912490025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040.info" returned: 0 in 0.273s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b7c61bd9-c59c-4eab-9f78-757820100ae1 tempest-CinderUnicodeTest-1912490025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.131s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-2ebc8658-c834-4084-b69e-9a9034d7e5d8 tempest-ProjectReaderTests-1123006400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.774s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:18 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-2ebc8658-c834-4084-b69e-9a9034d7e5d8 tempest-ProjectReaderTests-1123006400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-364864192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=965f0da6-0e56-44d6-8024-cbf37645d3e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3716167c74ef4724806c6bf7f079cf9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:36:15Z,use_quota=True,user_id='f38d1cecaf8544afa1783ea2d33c78e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:36:18 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-2ebc8658-c834-4084-b69e-9a9034d7e5d8 tempest-ProjectReaderTests-1123006400 None] Creating volume 965f0da6-0e56-44d6-8024-cbf37645d3e0 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:36:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-2ebc8658-c834-4084-b69e-9a9034d7e5d8 tempest-ProjectReaderTests-1123006400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-2ebc8658-c834-4084-b69e-9a9034d7e5d8 tempest-ProjectReaderTests-1123006400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:18 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-2ebc8658-c834-4084-b69e-9a9034d7e5d8 tempest-ProjectReaderTests-1123006400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:18 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-2ebc8658-c834-4084-b69e-9a9034d7e5d8 tempest-ProjectReaderTests-1123006400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-2ebc8658-c834-4084-b69e-9a9034d7e5d8 tempest-ProjectReaderTests-1123006400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:18 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-2ebc8658-c834-4084-b69e-9a9034d7e5d8 tempest-ProjectReaderTests-1123006400 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:36:18 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-2ebc8658-c834-4084-b69e-9a9034d7e5d8 tempest-ProjectReaderTests-1123006400 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:36:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2ebc8658-c834-4084-b69e-9a9034d7e5d8 tempest-ProjectReaderTests-1123006400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965f0da6-0e56-44d6-8024-cbf37645d3e0 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:18 devstack sudo[106680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965f0da6-0e56-44d6-8024-cbf37645d3e0 1073741824 Jul 16 23:36:18 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:18 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-b7c61bd9-c59c-4eab-9f78-757820100ae1 tempest-CinderUnicodeTest-1912490025 None] Create snapshot completed successfully Jul 16 23:36:18 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2ebc8658-c834-4084-b69e-9a9034d7e5d8 tempest-ProjectReaderTests-1123006400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965f0da6-0e56-44d6-8024-cbf37645d3e0 1073741824" returned: 0 in 0.429s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2ebc8658-c834-4084-b69e-9a9034d7e5d8 tempest-ProjectReaderTests-1123006400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965f0da6-0e56-44d6-8024-cbf37645d3e0 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:18 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965f0da6-0e56-44d6-8024-cbf37645d3e0 Jul 16 23:36:18 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:18 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2ebc8658-c834-4084-b69e-9a9034d7e5d8 tempest-ProjectReaderTests-1123006400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965f0da6-0e56-44d6-8024-cbf37645d3e0" returned: 0 in 0.260s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:18 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-2ebc8658-c834-4084-b69e-9a9034d7e5d8 tempest-ProjectReaderTests-1123006400 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:36:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-2ebc8658-c834-4084-b69e-9a9034d7e5d8 tempest-ProjectReaderTests-1123006400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f0d97da8-d3ef-4136-8e52-b57c9a896c06 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.692s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-2ebc8658-c834-4084-b69e-9a9034d7e5d8 tempest-ProjectReaderTests-1123006400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (108c32f2-9fbf-43dd-bf1c-7f91da871d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-965f0da6-0e56-44d6-8024-cbf37645d3e0', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-2ebc8658-c834-4084-b69e-9a9034d7e5d8 tempest-ProjectReaderTests-1123006400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a8d6db9-dded-40c9-bd3d-e34d876ef6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:18 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-f0d97da8-d3ef-4136-8e52-b57c9a896c06 tempest-ProjectMemberTests-1023405772 None] Creating offline snapshot 2222d519-ecf5-41f4-a2ef-749e71668d8d of volume 06a7400e-249c-474d-9c9e-41cd44e64b92 {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:36:18 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-2ebc8658-c834-4084-b69e-9a9034d7e5d8 tempest-ProjectReaderTests-1123006400 None] Volume volume-965f0da6-0e56-44d6-8024-cbf37645d3e0 (965f0da6-0e56-44d6-8024-cbf37645d3e0): created successfully Jul 16 23:36:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-2ebc8658-c834-4084-b69e-9a9034d7e5d8 tempest-ProjectReaderTests-1123006400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a8d6db9-dded-40c9-bd3d-e34d876ef6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-2ebc8658-c834-4084-b69e-9a9034d7e5d8 tempest-ProjectReaderTests-1123006400 None] Flow 'volume_create_manager' (bdf9c00e-b3a6-4411-8373-f811bc5ef8c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:36:18 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[9570c07c-03df-4518-81e3-463d6acb4e47]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:36:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f0d97da8-d3ef-4136-8e52-b57c9a896c06 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:19 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-2ebc8658-c834-4084-b69e-9a9034d7e5d8 tempest-ProjectReaderTests-1123006400 None] Created volume successfully. Jul 16 23:36:19 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfa1b8fd-f0c2-4122-a095-2aa119a69723 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:36:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-dfa1b8fd-f0c2-4122-a095-2aa119a69723 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Flow 'volume_create_manager' (cd2abea8-5e27-4da3-9e8c-759c0e2845a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:36:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-dfa1b8fd-f0c2-4122-a095-2aa119a69723 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42e6b5b0-62bf-492c-b9db-95fd4216b250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-dfa1b8fd-f0c2-4122-a095-2aa119a69723 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42e6b5b0-62bf-492c-b9db-95fd4216b250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1345601766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a91cc8af-6335-40a4-9168-f5ebbd314338,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80677140fff7434fafb4492f3b4bf630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:36:19Z,use_quota=True,user_id='70d72bf92940418fa9c2bffc766ab1b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-dfa1b8fd-f0c2-4122-a095-2aa119a69723 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c659e7-4c74-4f23-9e42-bf356f1326a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-dfa1b8fd-f0c2-4122-a095-2aa119a69723 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c659e7-4c74-4f23-9e42-bf356f1326a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-dfa1b8fd-f0c2-4122-a095-2aa119a69723 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6905b3ba-2e0e-4b06-b2a0-9d0afde608bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-dfa1b8fd-f0c2-4122-a095-2aa119a69723 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6905b3ba-2e0e-4b06-b2a0-9d0afde608bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a91cc8af-6335-40a4-9168-f5ebbd314338', 'volume_name': 'volume-a91cc8af-6335-40a4-9168-f5ebbd314338', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-dfa1b8fd-f0c2-4122-a095-2aa119a69723 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d2ae2bd-032d-4804-a539-52685448a318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-dfa1b8fd-f0c2-4122-a095-2aa119a69723 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d2ae2bd-032d-4804-a539-52685448a318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-dfa1b8fd-f0c2-4122-a095-2aa119a69723 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (649ea812-2e16-4208-9c6e-4dbb875b5d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:19 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-dfa1b8fd-f0c2-4122-a095-2aa119a69723 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Volume a91cc8af-6335-40a4-9168-f5ebbd314338: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a91cc8af-6335-40a4-9168-f5ebbd314338', 'volume_size': 1} Jul 16 23:36:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-dfa1b8fd-f0c2-4122-a095-2aa119a69723 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:19 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92 Jul 16 23:36:19 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:19 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-479c7ac3-9182-4559-b320-ea01aa0c0e5f tempest-ProjectReaderTests-1123006400 None] Acquiring lock "cinder-965f0da6-0e56-44d6-8024-cbf37645d3e0-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:19 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-479c7ac3-9182-4559-b320-ea01aa0c0e5f tempest-ProjectReaderTests-1123006400 None] Lock "cinder-965f0da6-0e56-44d6-8024-cbf37645d3e0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:19 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-479c7ac3-9182-4559-b320-ea01aa0c0e5f tempest-ProjectReaderTests-1123006400 None] Acquiring lock "cinder-quobyte-965f0da6-0e56-44d6-8024-cbf37645d3e0" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:19 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d4720436-7119-4e1b-b860-7619df85024b tempest-CinderUnicodeTest-1912490025 None] Acquiring lock "cinder-3ad24e6e-031e-4064-8a0c-bc95f762c637-delete_snapshot" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:19 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-479c7ac3-9182-4559-b320-ea01aa0c0e5f tempest-ProjectReaderTests-1123006400 None] Lock "cinder-quobyte-965f0da6-0e56-44d6-8024-cbf37645d3e0" acquired by "delete_volume" :: waited 0.028s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:19 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d4720436-7119-4e1b-b860-7619df85024b tempest-CinderUnicodeTest-1912490025 None] Lock "cinder-3ad24e6e-031e-4064-8a0c-bc95f762c637-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:19 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d4720436-7119-4e1b-b860-7619df85024b tempest-CinderUnicodeTest-1912490025 None] Acquiring lock "cinder-quobyte-0d91d040-557b-4f5c-8aa9-d43f98e25040" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:19 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bf8ade-2109-44da-916c-149b627c60be]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:36:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-479c7ac3-9182-4559-b320-ea01aa0c0e5f tempest-ProjectReaderTests-1123006400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965f0da6-0e56-44d6-8024-cbf37645d3e0 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:19 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:19 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d4720436-7119-4e1b-b860-7619df85024b tempest-CinderUnicodeTest-1912490025 None] Lock "cinder-quobyte-0d91d040-557b-4f5c-8aa9-d43f98e25040" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:19 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d4720436-7119-4e1b-b860-7619df85024b tempest-CinderUnicodeTest-1912490025 None] Acquiring lock "cinder-quobyte-3ad24e6e-031e-4064-8a0c-bc95f762c637" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f0d97da8-d3ef-4136-8e52-b57c9a896c06 tempest-ProjectMemberTests-1023405772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92" returned: 0 in 0.459s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f0d97da8-d3ef-4136-8e52-b57c9a896c06 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92.2222d519-ecf5-41f4-a2ef-749e71668d8d 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:19 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d4720436-7119-4e1b-b860-7619df85024b tempest-CinderUnicodeTest-1912490025 None] Lock "cinder-quobyte-3ad24e6e-031e-4064-8a0c-bc95f762c637" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:19 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-d4720436-7119-4e1b-b860-7619df85024b tempest-CinderUnicodeTest-1912490025 None] Deleting offline snapshot 3ad24e6e-031e-4064-8a0c-bc95f762c637 of volume 0d91d040-557b-4f5c-8aa9-d43f98e25040 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:36:19 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92.2222d519-ecf5-41f4-a2ef-749e71668d8d 1G Jul 16 23:36:19 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:19 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-d4720436-7119-4e1b-b860-7619df85024b tempest-CinderUnicodeTest-1912490025 None] snapshot_file for this snap is: volume-0d91d040-557b-4f5c-8aa9-d43f98e25040.3ad24e6e-031e-4064-8a0c-bc95f762c637 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:36:19 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b8c878-6ee4-4c06-9349-5a787f08e97d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:36:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d4720436-7119-4e1b-b860-7619df85024b tempest-CinderUnicodeTest-1912490025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040.3ad24e6e-031e-4064-8a0c-bc95f762c637 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:19 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965f0da6-0e56-44d6-8024-cbf37645d3e0 Jul 16 23:36:19 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:19 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040.3ad24e6e-031e-4064-8a0c-bc95f762c637 Jul 16 23:36:19 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:19 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-479c7ac3-9182-4559-b320-ea01aa0c0e5f tempest-ProjectReaderTests-1123006400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965f0da6-0e56-44d6-8024-cbf37645d3e0" returned: 0 in 0.375s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-479c7ac3-9182-4559-b320-ea01aa0c0e5f tempest-ProjectReaderTests-1123006400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965f0da6-0e56-44d6-8024-cbf37645d3e0 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:19 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965f0da6-0e56-44d6-8024-cbf37645d3e0 Jul 16 23:36:19 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:19 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f0d97da8-d3ef-4136-8e52-b57c9a896c06 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92.2222d519-ecf5-41f4-a2ef-749e71668d8d 1G" returned: 0 in 0.436s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f0d97da8-d3ef-4136-8e52-b57c9a896c06 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06a7400e-249c-474d-9c9e-41cd44e64b92 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92.2222d519-ecf5-41f4-a2ef-749e71668d8d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:19 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d4720436-7119-4e1b-b860-7619df85024b tempest-CinderUnicodeTest-1912490025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040.3ad24e6e-031e-4064-8a0c-bc95f762c637" returned: 0 in 0.386s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:19 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-d4720436-7119-4e1b-b860-7619df85024b tempest-CinderUnicodeTest-1912490025 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d91d040-557b-4f5c-8aa9-d43f98e25040(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:36:19 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06a7400e-249c-474d-9c9e-41cd44e64b92 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92.2222d519-ecf5-41f4-a2ef-749e71668d8d Jul 16 23:36:19 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:19 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[0748a99b-f729-4779-83e0-02003c06cc1a]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:36:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d4720436-7119-4e1b-b860-7619df85024b tempest-CinderUnicodeTest-1912490025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:20 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040 Jul 16 23:36:20 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:20 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-479c7ac3-9182-4559-b320-ea01aa0c0e5f tempest-ProjectReaderTests-1123006400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965f0da6-0e56-44d6-8024-cbf37645d3e0" returned: 0 in 0.292s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:20 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-479c7ac3-9182-4559-b320-ea01aa0c0e5f tempest-ProjectReaderTests-1123006400 None] Lock "cinder-quobyte-965f0da6-0e56-44d6-8024-cbf37645d3e0" released by "delete_volume" :: held 0.718s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:20 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-479c7ac3-9182-4559-b320-ea01aa0c0e5f tempest-ProjectReaderTests-1123006400 None] Created reservations ['18da9cae-4668-4ef6-8219-7ecad19780c6', 'c4961590-21a1-421e-a634-8f06a85f2bb9', 'aa71541d-6e97-4216-92c4-8f2b60a5832e', 'ac0adc68-c44f-4892-80aa-3558bf7470ce'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:36:20 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f0d97da8-d3ef-4136-8e52-b57c9a896c06 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06a7400e-249c-474d-9c9e-41cd44e64b92 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92.2222d519-ecf5-41f4-a2ef-749e71668d8d" returned: 0 in 0.325s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:20 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-f0d97da8-d3ef-4136-8e52-b57c9a896c06 tempest-ProjectMemberTests-1023405772 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92.2222d519-ecf5-41f4-a2ef-749e71668d8d is being set with open permissions: ugo+rw Jul 16 23:36:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f0d97da8-d3ef-4136-8e52-b57c9a896c06 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92.2222d519-ecf5-41f4-a2ef-749e71668d8d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:20 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92.2222d519-ecf5-41f4-a2ef-749e71668d8d Jul 16 23:36:20 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-479c7ac3-9182-4559-b320-ea01aa0c0e5f tempest-ProjectReaderTests-1123006400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-479c7ac3-9182-4559-b320-ea01aa0c0e5f tempest-ProjectReaderTests-1123006400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:20 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-479c7ac3-9182-4559-b320-ea01aa0c0e5f tempest-ProjectReaderTests-1123006400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:20 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-479c7ac3-9182-4559-b320-ea01aa0c0e5f tempest-ProjectReaderTests-1123006400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-479c7ac3-9182-4559-b320-ea01aa0c0e5f tempest-ProjectReaderTests-1123006400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-479c7ac3-9182-4559-b320-ea01aa0c0e5f tempest-ProjectReaderTests-1123006400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:20 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:36:20 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:20 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d4720436-7119-4e1b-b860-7619df85024b tempest-CinderUnicodeTest-1912490025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040" returned: 0 in 0.390s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d4720436-7119-4e1b-b860-7619df85024b tempest-CinderUnicodeTest-1912490025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040.3ad24e6e-031e-4064-8a0c-bc95f762c637 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:20 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040.3ad24e6e-031e-4064-8a0c-bc95f762c637 Jul 16 23:36:20 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:20 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f0d97da8-d3ef-4136-8e52-b57c9a896c06 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92.2222d519-ecf5-41f4-a2ef-749e71668d8d" returned: 0 in 0.282s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f0d97da8-d3ef-4136-8e52-b57c9a896c06 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:20 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-479c7ac3-9182-4559-b320-ea01aa0c0e5f tempest-ProjectReaderTests-1123006400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.280s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:20 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-479c7ac3-9182-4559-b320-ea01aa0c0e5f tempest-ProjectReaderTests-1123006400 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:36:20 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92.info Jul 16 23:36:20 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-479c7ac3-9182-4559-b320-ea01aa0c0e5f tempest-ProjectReaderTests-1123006400 None] Deleted volume successfully. Jul 16 23:36:20 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:20 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-479c7ac3-9182-4559-b320-ea01aa0c0e5f tempest-ProjectReaderTests-1123006400 None] Lock "cinder-965f0da6-0e56-44d6-8024-cbf37645d3e0-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:20 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d4720436-7119-4e1b-b860-7619df85024b tempest-CinderUnicodeTest-1912490025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040.3ad24e6e-031e-4064-8a0c-bc95f762c637" returned: 0 in 0.421s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d4720436-7119-4e1b-b860-7619df85024b tempest-CinderUnicodeTest-1912490025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040.3ad24e6e-031e-4064-8a0c-bc95f762c637 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:20 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040.3ad24e6e-031e-4064-8a0c-bc95f762c637 Jul 16 23:36:20 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:20 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f0d97da8-d3ef-4136-8e52-b57c9a896c06 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92.info" returned: 0 in 0.300s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:20 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-f0d97da8-d3ef-4136-8e52-b57c9a896c06 tempest-ProjectMemberTests-1023405772 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92.info is being set with open permissions: ugo+rw Jul 16 23:36:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f0d97da8-d3ef-4136-8e52-b57c9a896c06 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:20 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92.info Jul 16 23:36:20 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5276a02-9e4a-472e-8599-9c5e73106a23 tempest-ProjectReaderTests-1123006400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b5276a02-9e4a-472e-8599-9c5e73106a23 tempest-ProjectReaderTests-1123006400 None] Flow 'volume_create_manager' (80b6877c-1cef-43a0-9c03-99dbefdbbbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:36:21 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b5276a02-9e4a-472e-8599-9c5e73106a23 tempest-ProjectReaderTests-1123006400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f80361-6b13-44bd-8910-a7bd16592aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-d4720436-7119-4e1b-b860-7619df85024b tempest-CinderUnicodeTest-1912490025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040.3ad24e6e-031e-4064-8a0c-bc95f762c637" returned: 0 in 0.309s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b5276a02-9e4a-472e-8599-9c5e73106a23 tempest-ProjectReaderTests-1123006400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f80361-6b13-44bd-8910-a7bd16592aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-165002146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e89f0f2-1979-4fe6-b9cf-0afe89d066e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3716167c74ef4724806c6bf7f079cf9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:36:21Z,use_quota=True,user_id='f38d1cecaf8544afa1783ea2d33c78e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b5276a02-9e4a-472e-8599-9c5e73106a23 tempest-ProjectReaderTests-1123006400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d27a4e2-d334-412d-b5d2-e1ee7f21bc47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b5276a02-9e4a-472e-8599-9c5e73106a23 tempest-ProjectReaderTests-1123006400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d27a4e2-d334-412d-b5d2-e1ee7f21bc47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:21 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b5276a02-9e4a-472e-8599-9c5e73106a23 tempest-ProjectReaderTests-1123006400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b1357a-0751-49e1-b95b-b3915957b0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b5276a02-9e4a-472e-8599-9c5e73106a23 tempest-ProjectReaderTests-1123006400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b1357a-0751-49e1-b95b-b3915957b0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e89f0f2-1979-4fe6-b9cf-0afe89d066e8', 'volume_name': 'volume-4e89f0f2-1979-4fe6-b9cf-0afe89d066e8', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b5276a02-9e4a-472e-8599-9c5e73106a23 tempest-ProjectReaderTests-1123006400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58b4d849-ffcd-4686-a231-47b1d19e4794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b5276a02-9e4a-472e-8599-9c5e73106a23 tempest-ProjectReaderTests-1123006400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58b4d849-ffcd-4686-a231-47b1d19e4794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b5276a02-9e4a-472e-8599-9c5e73106a23 tempest-ProjectReaderTests-1123006400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6179f670-93dc-4b47-aa23-6cb9e8e67c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:21 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-b5276a02-9e4a-472e-8599-9c5e73106a23 tempest-ProjectReaderTests-1123006400 None] Volume 4e89f0f2-1979-4fe6-b9cf-0afe89d066e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e89f0f2-1979-4fe6-b9cf-0afe89d066e8', 'volume_size': 1} Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b5276a02-9e4a-472e-8599-9c5e73106a23 tempest-ProjectReaderTests-1123006400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f0d97da8-d3ef-4136-8e52-b57c9a896c06 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92.info" returned: 0 in 0.330s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f0d97da8-d3ef-4136-8e52-b57c9a896c06 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.246s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-dfa1b8fd-f0c2-4122-a095-2aa119a69723 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.057s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-dfa1b8fd-f0c2-4122-a095-2aa119a69723 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1345601766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a91cc8af-6335-40a4-9168-f5ebbd314338,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80677140fff7434fafb4492f3b4bf630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:36:19Z,use_quota=True,user_id='70d72bf92940418fa9c2bffc766ab1b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-dfa1b8fd-f0c2-4122-a095-2aa119a69723 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Creating volume a91cc8af-6335-40a4-9168-f5ebbd314338 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-dfa1b8fd-f0c2-4122-a095-2aa119a69723 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-dfa1b8fd-f0c2-4122-a095-2aa119a69723 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-dfa1b8fd-f0c2-4122-a095-2aa119a69723 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-dfa1b8fd-f0c2-4122-a095-2aa119a69723 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-dfa1b8fd-f0c2-4122-a095-2aa119a69723 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-dfa1b8fd-f0c2-4122-a095-2aa119a69723 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:36:21 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-dfa1b8fd-f0c2-4122-a095-2aa119a69723 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-dfa1b8fd-f0c2-4122-a095-2aa119a69723 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a91cc8af-6335-40a4-9168-f5ebbd314338 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d4720436-7119-4e1b-b860-7619df85024b tempest-CinderUnicodeTest-1912490025 None] Lock "cinder-quobyte-3ad24e6e-031e-4064-8a0c-bc95f762c637" released by "_delete_snapshot" :: held 1.730s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:21 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a91cc8af-6335-40a4-9168-f5ebbd314338 1073741824 Jul 16 23:36:21 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d4720436-7119-4e1b-b860-7619df85024b tempest-CinderUnicodeTest-1912490025 None] Lock "cinder-quobyte-0d91d040-557b-4f5c-8aa9-d43f98e25040" released by "delete_snapshot" :: held 1.775s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:21 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-f0d97da8-d3ef-4136-8e52-b57c9a896c06 tempest-ProjectMemberTests-1023405772 None] Create snapshot completed successfully Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-d4720436-7119-4e1b-b860-7619df85024b tempest-CinderUnicodeTest-1912490025 None] Created reservations ['5d87d5fc-9164-4ea9-ab9c-5960a4815e4e', '878e70b8-cbc8-42b5-b186-ea5e393060a4', '6a59eb4c-d8a3-48ba-b46d-87cb43ec617f', '5ea76ffe-34ad-40fa-939e-f6bd210f1063'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:36:21 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-d4720436-7119-4e1b-b860-7619df85024b tempest-CinderUnicodeTest-1912490025 None] Delete snapshot completed successfully. Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-d4720436-7119-4e1b-b860-7619df85024b tempest-CinderUnicodeTest-1912490025 None] Lock "cinder-3ad24e6e-031e-4064-8a0c-bc95f762c637-delete_snapshot" released by "delete_snapshot" :: held 1.941s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-15be89d7-4b98-4bbc-9842-8ec784fd81d7 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-2222d519-ecf5-41f4-a2ef-749e71668d8d-delete_snapshot" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-15be89d7-4b98-4bbc-9842-8ec784fd81d7 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-2222d519-ecf5-41f4-a2ef-749e71668d8d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-15be89d7-4b98-4bbc-9842-8ec784fd81d7 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-quobyte-06a7400e-249c-474d-9c9e-41cd44e64b92" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-15be89d7-4b98-4bbc-9842-8ec784fd81d7 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-06a7400e-249c-474d-9c9e-41cd44e64b92" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-15be89d7-4b98-4bbc-9842-8ec784fd81d7 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-quobyte-2222d519-ecf5-41f4-a2ef-749e71668d8d" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-15be89d7-4b98-4bbc-9842-8ec784fd81d7 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-2222d519-ecf5-41f4-a2ef-749e71668d8d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-15be89d7-4b98-4bbc-9842-8ec784fd81d7 tempest-ProjectMemberTests-1023405772 None] Deleting offline snapshot 2222d519-ecf5-41f4-a2ef-749e71668d8d of volume 06a7400e-249c-474d-9c9e-41cd44e64b92 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-15be89d7-4b98-4bbc-9842-8ec784fd81d7 tempest-ProjectMemberTests-1023405772 None] snapshot_file for this snap is: volume-06a7400e-249c-474d-9c9e-41cd44e64b92.2222d519-ecf5-41f4-a2ef-749e71668d8d {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f36d20b-2afe-47de-9829-5ff16c36e271]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-15be89d7-4b98-4bbc-9842-8ec784fd81d7 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92.2222d519-ecf5-41f4-a2ef-749e71668d8d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-5fa9f02e-d6d1-4a72-abdc-891ca092c5ac tempest-CinderUnicodeTest-1912490025 None] Acquiring lock "cinder-0d91d040-557b-4f5c-8aa9-d43f98e25040-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-5fa9f02e-d6d1-4a72-abdc-891ca092c5ac tempest-CinderUnicodeTest-1912490025 None] Lock "cinder-0d91d040-557b-4f5c-8aa9-d43f98e25040-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:21 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92.2222d519-ecf5-41f4-a2ef-749e71668d8d Jul 16 23:36:21 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-5fa9f02e-d6d1-4a72-abdc-891ca092c5ac tempest-CinderUnicodeTest-1912490025 None] Acquiring lock "cinder-quobyte-0d91d040-557b-4f5c-8aa9-d43f98e25040" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-5fa9f02e-d6d1-4a72-abdc-891ca092c5ac tempest-CinderUnicodeTest-1912490025 None] Lock "cinder-quobyte-0d91d040-557b-4f5c-8aa9-d43f98e25040" acquired by "delete_volume" :: waited 0.016s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09e4e81-1a4f-4509-8ea1-a9dc52177911]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5fa9f02e-d6d1-4a72-abdc-891ca092c5ac tempest-CinderUnicodeTest-1912490025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:21 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-dfa1b8fd-f0c2-4122-a095-2aa119a69723 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a91cc8af-6335-40a4-9168-f5ebbd314338 1073741824" returned: 0 in 0.521s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-dfa1b8fd-f0c2-4122-a095-2aa119a69723 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a91cc8af-6335-40a4-9168-f5ebbd314338 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:21 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a91cc8af-6335-40a4-9168-f5ebbd314338 Jul 16 23:36:21 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:21 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040 Jul 16 23:36:21 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:21 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-15be89d7-4b98-4bbc-9842-8ec784fd81d7 tempest-ProjectMemberTests-1023405772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92.2222d519-ecf5-41f4-a2ef-749e71668d8d" returned: 0 in 0.406s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-15be89d7-4b98-4bbc-9842-8ec784fd81d7 tempest-ProjectMemberTests-1023405772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06a7400e-249c-474d-9c9e-41cd44e64b92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf78af4-b174-4e86-9a75-81f83b5dec6c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:36:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-15be89d7-4b98-4bbc-9842-8ec784fd81d7 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:22 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92 Jul 16 23:36:22 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:22 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-dfa1b8fd-f0c2-4122-a095-2aa119a69723 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a91cc8af-6335-40a4-9168-f5ebbd314338" returned: 0 in 0.317s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-dfa1b8fd-f0c2-4122-a095-2aa119a69723 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-dfa1b8fd-f0c2-4122-a095-2aa119a69723 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b5276a02-9e4a-472e-8599-9c5e73106a23 tempest-ProjectReaderTests-1123006400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.937s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-b5276a02-9e4a-472e-8599-9c5e73106a23 tempest-ProjectReaderTests-1123006400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-165002146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e89f0f2-1979-4fe6-b9cf-0afe89d066e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3716167c74ef4724806c6bf7f079cf9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:36:21Z,use_quota=True,user_id='f38d1cecaf8544afa1783ea2d33c78e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-b5276a02-9e4a-472e-8599-9c5e73106a23 tempest-ProjectReaderTests-1123006400 None] Creating volume 4e89f0f2-1979-4fe6-b9cf-0afe89d066e8 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b5276a02-9e4a-472e-8599-9c5e73106a23 tempest-ProjectReaderTests-1123006400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b5276a02-9e4a-472e-8599-9c5e73106a23 tempest-ProjectReaderTests-1123006400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-b5276a02-9e4a-472e-8599-9c5e73106a23 tempest-ProjectReaderTests-1123006400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-b5276a02-9e4a-472e-8599-9c5e73106a23 tempest-ProjectReaderTests-1123006400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b5276a02-9e4a-472e-8599-9c5e73106a23 tempest-ProjectReaderTests-1123006400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-b5276a02-9e4a-472e-8599-9c5e73106a23 tempest-ProjectReaderTests-1123006400 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:36:22 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-b5276a02-9e4a-472e-8599-9c5e73106a23 tempest-ProjectReaderTests-1123006400 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b5276a02-9e4a-472e-8599-9c5e73106a23 tempest-ProjectReaderTests-1123006400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4e89f0f2-1979-4fe6-b9cf-0afe89d066e8 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-dfa1b8fd-f0c2-4122-a095-2aa119a69723 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (649ea812-2e16-4208-9c6e-4dbb875b5d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a91cc8af-6335-40a4-9168-f5ebbd314338', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-dfa1b8fd-f0c2-4122-a095-2aa119a69723 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00063b15-54f3-4b74-99b4-17d5a92ae607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:22 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4e89f0f2-1979-4fe6-b9cf-0afe89d066e8 1073741824 Jul 16 23:36:22 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:22 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5fa9f02e-d6d1-4a72-abdc-891ca092c5ac tempest-CinderUnicodeTest-1912490025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040" returned: 0 in 0.429s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5fa9f02e-d6d1-4a72-abdc-891ca092c5ac tempest-CinderUnicodeTest-1912490025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:22 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-dfa1b8fd-f0c2-4122-a095-2aa119a69723 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Volume volume-a91cc8af-6335-40a4-9168-f5ebbd314338 (a91cc8af-6335-40a4-9168-f5ebbd314338): created successfully Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-dfa1b8fd-f0c2-4122-a095-2aa119a69723 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00063b15-54f3-4b74-99b4-17d5a92ae607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-dfa1b8fd-f0c2-4122-a095-2aa119a69723 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Flow 'volume_create_manager' (cd2abea8-5e27-4da3-9e8c-759c0e2845a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:36:22 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040 Jul 16 23:36:22 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:22 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-dfa1b8fd-f0c2-4122-a095-2aa119a69723 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Created volume successfully. Jul 16 23:36:22 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-15be89d7-4b98-4bbc-9842-8ec784fd81d7 tempest-ProjectMemberTests-1023405772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92" returned: 0 in 0.416s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-15be89d7-4b98-4bbc-9842-8ec784fd81d7 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92.2222d519-ecf5-41f4-a2ef-749e71668d8d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:22 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92.2222d519-ecf5-41f4-a2ef-749e71668d8d Jul 16 23:36:22 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:22 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5fa9f02e-d6d1-4a72-abdc-891ca092c5ac tempest-CinderUnicodeTest-1912490025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-0d91d040-557b-4f5c-8aa9-d43f98e25040" returned: 0 in 0.283s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-5fa9f02e-d6d1-4a72-abdc-891ca092c5ac tempest-CinderUnicodeTest-1912490025 None] Lock "cinder-quobyte-0d91d040-557b-4f5c-8aa9-d43f98e25040" released by "delete_volume" :: held 0.784s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-5fa9f02e-d6d1-4a72-abdc-891ca092c5ac tempest-CinderUnicodeTest-1912490025 None] Created reservations ['ddfd4c88-971b-401f-bf30-823f80a9fbc7', 'f78b8821-2ffe-4429-83cc-3e53786b9b7b', '6338f12a-8318-475a-b0bc-a575965fcb80', '7a8d6a14-0e3e-4926-82e7-22f0e65eb25f'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5fa9f02e-d6d1-4a72-abdc-891ca092c5ac tempest-CinderUnicodeTest-1912490025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5fa9f02e-d6d1-4a72-abdc-891ca092c5ac tempest-CinderUnicodeTest-1912490025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-5fa9f02e-d6d1-4a72-abdc-891ca092c5ac tempest-CinderUnicodeTest-1912490025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-5fa9f02e-d6d1-4a72-abdc-891ca092c5ac tempest-CinderUnicodeTest-1912490025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-5fa9f02e-d6d1-4a72-abdc-891ca092c5ac tempest-CinderUnicodeTest-1912490025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5fa9f02e-d6d1-4a72-abdc-891ca092c5ac tempest-CinderUnicodeTest-1912490025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:22 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b5276a02-9e4a-472e-8599-9c5e73106a23 tempest-ProjectReaderTests-1123006400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4e89f0f2-1979-4fe6-b9cf-0afe89d066e8 1073741824" returned: 0 in 0.507s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:22 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:36:22 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b5276a02-9e4a-472e-8599-9c5e73106a23 tempest-ProjectReaderTests-1123006400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4e89f0f2-1979-4fe6-b9cf-0afe89d066e8 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:22 devstack sudo[106784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4e89f0f2-1979-4fe6-b9cf-0afe89d066e8 Jul 16 23:36:22 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:22 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-15be89d7-4b98-4bbc-9842-8ec784fd81d7 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92.2222d519-ecf5-41f4-a2ef-749e71668d8d" returned: 0 in 0.429s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-15be89d7-4b98-4bbc-9842-8ec784fd81d7 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92.2222d519-ecf5-41f4-a2ef-749e71668d8d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-2e9732d1-2d30-4169-b2d2-e20175d82ac9 tempest-CinderUnicodeTest-1912490025 None] Acquiring lock "cinder-c211226f-6fc7-4fcc-8873-a48e49aca258-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:22 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92.2222d519-ecf5-41f4-a2ef-749e71668d8d Jul 16 23:36:22 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-2e9732d1-2d30-4169-b2d2-e20175d82ac9 tempest-CinderUnicodeTest-1912490025 None] Lock "cinder-c211226f-6fc7-4fcc-8873-a48e49aca258-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:22 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-5fa9f02e-d6d1-4a72-abdc-891ca092c5ac tempest-CinderUnicodeTest-1912490025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.290s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-5fa9f02e-d6d1-4a72-abdc-891ca092c5ac tempest-CinderUnicodeTest-1912490025 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-2e9732d1-2d30-4169-b2d2-e20175d82ac9 tempest-CinderUnicodeTest-1912490025 None] Acquiring lock "cinder-quobyte-c211226f-6fc7-4fcc-8873-a48e49aca258" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:22 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-5fa9f02e-d6d1-4a72-abdc-891ca092c5ac tempest-CinderUnicodeTest-1912490025 None] Deleted volume successfully. Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-5fa9f02e-d6d1-4a72-abdc-891ca092c5ac tempest-CinderUnicodeTest-1912490025 None] Lock "cinder-0d91d040-557b-4f5c-8aa9-d43f98e25040-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-2e9732d1-2d30-4169-b2d2-e20175d82ac9 tempest-CinderUnicodeTest-1912490025 None] Lock "cinder-quobyte-c211226f-6fc7-4fcc-8873-a48e49aca258" acquired by "delete_volume" :: waited 0.033s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:22 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b5276a02-9e4a-472e-8599-9c5e73106a23 tempest-ProjectReaderTests-1123006400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4e89f0f2-1979-4fe6-b9cf-0afe89d066e8" returned: 0 in 0.319s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-b5276a02-9e4a-472e-8599-9c5e73106a23 tempest-ProjectReaderTests-1123006400 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b5276a02-9e4a-472e-8599-9c5e73106a23 tempest-ProjectReaderTests-1123006400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2adb196-2cbf-490b-a64f-e33f22c66d37]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:36:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2e9732d1-2d30-4169-b2d2-e20175d82ac9 tempest-CinderUnicodeTest-1912490025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-c211226f-6fc7-4fcc-8873-a48e49aca258 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b5276a02-9e4a-472e-8599-9c5e73106a23 tempest-ProjectReaderTests-1123006400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6179f670-93dc-4b47-aa23-6cb9e8e67c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e89f0f2-1979-4fe6-b9cf-0afe89d066e8', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b5276a02-9e4a-472e-8599-9c5e73106a23 tempest-ProjectReaderTests-1123006400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c30b7168-14d5-4ca1-93a8-ee6093815928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:23 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-b5276a02-9e4a-472e-8599-9c5e73106a23 tempest-ProjectReaderTests-1123006400 None] Volume volume-4e89f0f2-1979-4fe6-b9cf-0afe89d066e8 (4e89f0f2-1979-4fe6-b9cf-0afe89d066e8): created successfully Jul 16 23:36:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b5276a02-9e4a-472e-8599-9c5e73106a23 tempest-ProjectReaderTests-1123006400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c30b7168-14d5-4ca1-93a8-ee6093815928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-b5276a02-9e4a-472e-8599-9c5e73106a23 tempest-ProjectReaderTests-1123006400 None] Flow 'volume_create_manager' (80b6877c-1cef-43a0-9c03-99dbefdbbbd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:36:23 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-b5276a02-9e4a-472e-8599-9c5e73106a23 tempest-ProjectReaderTests-1123006400 None] Created volume successfully. Jul 16 23:36:23 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-15be89d7-4b98-4bbc-9842-8ec784fd81d7 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92.2222d519-ecf5-41f4-a2ef-749e71668d8d" returned: 0 in 0.344s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:23 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-c211226f-6fc7-4fcc-8873-a48e49aca258 Jul 16 23:36:23 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:23 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-15be89d7-4b98-4bbc-9842-8ec784fd81d7 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-2222d519-ecf5-41f4-a2ef-749e71668d8d" released by "_delete_snapshot" :: held 1.713s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:23 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-15be89d7-4b98-4bbc-9842-8ec784fd81d7 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-06a7400e-249c-474d-9c9e-41cd44e64b92" released by "delete_snapshot" :: held 1.733s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:23 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-15be89d7-4b98-4bbc-9842-8ec784fd81d7 tempest-ProjectMemberTests-1023405772 None] Created reservations ['957fc3e7-4de9-41c3-91a0-61858af96d8f', 'cabf26c0-4dc0-4722-bdf7-2d2a8e1df591', 'ef9f83d0-621f-4960-a8f9-5f92fcb03f3d', 'd1560553-2cc3-4530-89c4-8ea13a11fbc6'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:36:23 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-15be89d7-4b98-4bbc-9842-8ec784fd81d7 tempest-ProjectMemberTests-1023405772 None] Delete snapshot completed successfully. Jul 16 23:36:23 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-15be89d7-4b98-4bbc-9842-8ec784fd81d7 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-2222d519-ecf5-41f4-a2ef-749e71668d8d-delete_snapshot" released by "delete_snapshot" :: held 1.926s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:23 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2e9732d1-2d30-4169-b2d2-e20175d82ac9 tempest-CinderUnicodeTest-1912490025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-c211226f-6fc7-4fcc-8873-a48e49aca258" returned: 0 in 0.461s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2e9732d1-2d30-4169-b2d2-e20175d82ac9 tempest-CinderUnicodeTest-1912490025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-c211226f-6fc7-4fcc-8873-a48e49aca258 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:23 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-c211226f-6fc7-4fcc-8873-a48e49aca258 Jul 16 23:36:23 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:23 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-25081e62-b478-4f3d-9211-7cd67b31323b tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-06a7400e-249c-474d-9c9e-41cd44e64b92-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:23 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-25081e62-b478-4f3d-9211-7cd67b31323b tempest-ProjectMemberTests-1023405772 None] Lock "cinder-06a7400e-249c-474d-9c9e-41cd44e64b92-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:23 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-25081e62-b478-4f3d-9211-7cd67b31323b tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-quobyte-06a7400e-249c-474d-9c9e-41cd44e64b92" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:23 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-25081e62-b478-4f3d-9211-7cd67b31323b tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-06a7400e-249c-474d-9c9e-41cd44e64b92" acquired by "delete_volume" :: waited 0.018s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:23 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2e9732d1-2d30-4169-b2d2-e20175d82ac9 tempest-CinderUnicodeTest-1912490025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-c211226f-6fc7-4fcc-8873-a48e49aca258" returned: 0 in 0.335s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:23 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[937a43f8-e8ee-444e-b0fa-93150ecfd9ec]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:36:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-25081e62-b478-4f3d-9211-7cd67b31323b tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:23 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-2e9732d1-2d30-4169-b2d2-e20175d82ac9 tempest-CinderUnicodeTest-1912490025 None] Lock "cinder-quobyte-c211226f-6fc7-4fcc-8873-a48e49aca258" released by "delete_volume" :: held 0.883s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:23 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-255945a4-6407-4d5a-ab2d-f60b682ea3cc tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:36:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-255945a4-6407-4d5a-ab2d-f60b682ea3cc tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Flow 'volume_create_manager' (4ba8e853-ad26-4010-9510-85bb9204752d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:36:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-255945a4-6407-4d5a-ab2d-f60b682ea3cc tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1116ebaf-533a-4975-b672-9bafae014cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-255945a4-6407-4d5a-ab2d-f60b682ea3cc tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1116ebaf-533a-4975-b672-9bafae014cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-192352303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2056f9b9-d9bd-4b7c-8e45-10a92b347288,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80677140fff7434fafb4492f3b4bf630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:36:24Z,use_quota=True,user_id='70d72bf92940418fa9c2bffc766ab1b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-255945a4-6407-4d5a-ab2d-f60b682ea3cc tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f296ff5c-0c34-4632-9720-218fc579e37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-255945a4-6407-4d5a-ab2d-f60b682ea3cc tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f296ff5c-0c34-4632-9720-218fc579e37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-255945a4-6407-4d5a-ab2d-f60b682ea3cc tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adaf10fc-e595-4753-b23d-d8a0e5fe66c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:23 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92 Jul 16 23:36:23 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-255945a4-6407-4d5a-ab2d-f60b682ea3cc tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adaf10fc-e595-4753-b23d-d8a0e5fe66c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2056f9b9-d9bd-4b7c-8e45-10a92b347288', 'volume_name': 'volume-2056f9b9-d9bd-4b7c-8e45-10a92b347288', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-255945a4-6407-4d5a-ab2d-f60b682ea3cc tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b5300d3-65fa-4e18-8c8c-095bad6c5d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-255945a4-6407-4d5a-ab2d-f60b682ea3cc tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b5300d3-65fa-4e18-8c8c-095bad6c5d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-255945a4-6407-4d5a-ab2d-f60b682ea3cc tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3b16727-91fb-41b2-af13-221dbef21f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:23 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-255945a4-6407-4d5a-ab2d-f60b682ea3cc tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Volume 2056f9b9-d9bd-4b7c-8e45-10a92b347288: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2056f9b9-d9bd-4b7c-8e45-10a92b347288', 'volume_size': 1} Jul 16 23:36:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-255945a4-6407-4d5a-ab2d-f60b682ea3cc tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-255945a4-6407-4d5a-ab2d-f60b682ea3cc tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:23 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-255945a4-6407-4d5a-ab2d-f60b682ea3cc tempest-CreateVolumesFromSourceVolumeTest-593114566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-192352303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2056f9b9-d9bd-4b7c-8e45-10a92b347288,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80677140fff7434fafb4492f3b4bf630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:36:24Z,use_quota=True,user_id='70d72bf92940418fa9c2bffc766ab1b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:36:23 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-255945a4-6407-4d5a-ab2d-f60b682ea3cc tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Creating volume 2056f9b9-d9bd-4b7c-8e45-10a92b347288 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:36:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-255945a4-6407-4d5a-ab2d-f60b682ea3cc tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-255945a4-6407-4d5a-ab2d-f60b682ea3cc tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:23 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-255945a4-6407-4d5a-ab2d-f60b682ea3cc tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:23 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-255945a4-6407-4d5a-ab2d-f60b682ea3cc tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-255945a4-6407-4d5a-ab2d-f60b682ea3cc tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:23 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-255945a4-6407-4d5a-ab2d-f60b682ea3cc tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:36:23 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-255945a4-6407-4d5a-ab2d-f60b682ea3cc tempest-CreateVolumesFromSourceVolumeTest-593114566 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:36:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-255945a4-6407-4d5a-ab2d-f60b682ea3cc tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2056f9b9-d9bd-4b7c-8e45-10a92b347288 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-2e9732d1-2d30-4169-b2d2-e20175d82ac9 tempest-CinderUnicodeTest-1912490025 None] Created reservations ['41efbbcd-9e0e-489c-b4a0-9b74c379eb62', '84407d56-d908-46e7-988e-33fc8ab62481', '9c3feffe-5379-4ea7-84a5-a635c5ab55a5', 'ea9b2eaf-af56-4730-89f6-8c37193c7443'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:36:23 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2056f9b9-d9bd-4b7c-8e45-10a92b347288 1073741824 Jul 16 23:36:23 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-2e9732d1-2d30-4169-b2d2-e20175d82ac9 tempest-CinderUnicodeTest-1912490025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-2e9732d1-2d30-4169-b2d2-e20175d82ac9 tempest-CinderUnicodeTest-1912490025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-2e9732d1-2d30-4169-b2d2-e20175d82ac9 tempest-CinderUnicodeTest-1912490025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-2e9732d1-2d30-4169-b2d2-e20175d82ac9 tempest-CinderUnicodeTest-1912490025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-2e9732d1-2d30-4169-b2d2-e20175d82ac9 tempest-CinderUnicodeTest-1912490025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2e9732d1-2d30-4169-b2d2-e20175d82ac9 tempest-CinderUnicodeTest-1912490025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:24 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:36:24 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-76e86119-648e-4280-a934-11e7ab0ce623 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-76e86119-648e-4280-a934-11e7ab0ce623 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Flow 'volume_create_manager' (34b77077-a321-45c8-a7bf-cc1f236953ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-76e86119-648e-4280-a934-11e7ab0ce623 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65635993-cfb1-47dc-8d27-af326b149dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-76e86119-648e-4280-a934-11e7ab0ce623 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65635993-cfb1-47dc-8d27-af326b149dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-783528475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29b03c93-49c6-4572-9df6-e73525cc63d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80677140fff7434fafb4492f3b4bf630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:36:24Z,use_quota=True,user_id='70d72bf92940418fa9c2bffc766ab1b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-76e86119-648e-4280-a934-11e7ab0ce623 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3bcc06a-cb49-469b-a8e1-53596f96a30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-76e86119-648e-4280-a934-11e7ab0ce623 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3bcc06a-cb49-469b-a8e1-53596f96a30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-76e86119-648e-4280-a934-11e7ab0ce623 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27c341db-24ea-418d-9dca-f1835f6c0892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-76e86119-648e-4280-a934-11e7ab0ce623 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27c341db-24ea-418d-9dca-f1835f6c0892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29b03c93-49c6-4572-9df6-e73525cc63d9', 'volume_name': 'volume-29b03c93-49c6-4572-9df6-e73525cc63d9', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-76e86119-648e-4280-a934-11e7ab0ce623 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2c66168-145f-48df-871a-68932382b98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-76e86119-648e-4280-a934-11e7ab0ce623 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2c66168-145f-48df-871a-68932382b98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-76e86119-648e-4280-a934-11e7ab0ce623 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfbd2393-f469-4158-8750-3da78dc7fd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:24 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-76e86119-648e-4280-a934-11e7ab0ce623 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Volume 29b03c93-49c6-4572-9df6-e73525cc63d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29b03c93-49c6-4572-9df6-e73525cc63d9', 'volume_size': 1} Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-76e86119-648e-4280-a934-11e7ab0ce623 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-09df03f8-62b3-4e42-ba5b-8249e5dc3999 tempest-ProjectReaderTests-1123006400 None] Acquiring lock "cinder-4e89f0f2-1979-4fe6-b9cf-0afe89d066e8-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:24 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-09df03f8-62b3-4e42-ba5b-8249e5dc3999 tempest-ProjectReaderTests-1123006400 None] Lock "cinder-4e89f0f2-1979-4fe6-b9cf-0afe89d066e8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-25081e62-b478-4f3d-9211-7cd67b31323b tempest-ProjectMemberTests-1023405772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92" returned: 0 in 0.627s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-25081e62-b478-4f3d-9211-7cd67b31323b tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-09df03f8-62b3-4e42-ba5b-8249e5dc3999 tempest-ProjectReaderTests-1123006400 None] Acquiring lock "cinder-quobyte-4e89f0f2-1979-4fe6-b9cf-0afe89d066e8" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:24 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92 Jul 16 23:36:24 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-09df03f8-62b3-4e42-ba5b-8249e5dc3999 tempest-ProjectReaderTests-1123006400 None] Lock "cinder-quobyte-4e89f0f2-1979-4fe6-b9cf-0afe89d066e8" acquired by "delete_volume" :: waited 0.025s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c872e9f-5143-4901-8161-76d4ae38abe2]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-09df03f8-62b3-4e42-ba5b-8249e5dc3999 tempest-ProjectReaderTests-1123006400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4e89f0f2-1979-4fe6-b9cf-0afe89d066e8 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:24 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2e9732d1-2d30-4169-b2d2-e20175d82ac9 tempest-CinderUnicodeTest-1912490025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.482s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-2e9732d1-2d30-4169-b2d2-e20175d82ac9 tempest-CinderUnicodeTest-1912490025 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:36:24 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-2e9732d1-2d30-4169-b2d2-e20175d82ac9 tempest-CinderUnicodeTest-1912490025 None] Deleted volume successfully. Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-2e9732d1-2d30-4169-b2d2-e20175d82ac9 tempest-CinderUnicodeTest-1912490025 None] Lock "cinder-c211226f-6fc7-4fcc-8873-a48e49aca258-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:24 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4e89f0f2-1979-4fe6-b9cf-0afe89d066e8 Jul 16 23:36:24 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-6267e021-6a30-407d-83b6-2d5f7d0dc56e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6267e021-6a30-407d-83b6-2d5f7d0dc56e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Flow 'volume_create_manager' (dc2fe7fe-3f46-4fdc-b2cf-04be9f63d3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:36:24 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6267e021-6a30-407d-83b6-2d5f7d0dc56e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33aecabe-a466-40e4-90ac-76d2bfc6e067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-255945a4-6407-4d5a-ab2d-f60b682ea3cc tempest-CreateVolumesFromSourceVolumeTest-593114566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2056f9b9-d9bd-4b7c-8e45-10a92b347288 1073741824" returned: 0 in 0.871s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6267e021-6a30-407d-83b6-2d5f7d0dc56e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33aecabe-a466-40e4-90ac-76d2bfc6e067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-294651444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0e99130-76fd-4751-bba6-7cbffb8ab420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80677140fff7434fafb4492f3b4bf630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:36:25Z,use_quota=True,user_id='70d72bf92940418fa9c2bffc766ab1b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6267e021-6a30-407d-83b6-2d5f7d0dc56e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a3ea0a1-e9ef-4d38-aeeb-f2a38a94fc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6267e021-6a30-407d-83b6-2d5f7d0dc56e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a3ea0a1-e9ef-4d38-aeeb-f2a38a94fc6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:24 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6267e021-6a30-407d-83b6-2d5f7d0dc56e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd10b947-8fb9-41ce-8fcd-f5b6a710b49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6267e021-6a30-407d-83b6-2d5f7d0dc56e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd10b947-8fb9-41ce-8fcd-f5b6a710b49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0e99130-76fd-4751-bba6-7cbffb8ab420', 'volume_name': 'volume-f0e99130-76fd-4751-bba6-7cbffb8ab420', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6267e021-6a30-407d-83b6-2d5f7d0dc56e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (006ad506-3cc8-4c51-a885-48f1a2f7f7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6267e021-6a30-407d-83b6-2d5f7d0dc56e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (006ad506-3cc8-4c51-a885-48f1a2f7f7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6267e021-6a30-407d-83b6-2d5f7d0dc56e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42970563-9300-40fd-ad32-1849dff6f164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:24 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-6267e021-6a30-407d-83b6-2d5f7d0dc56e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Volume f0e99130-76fd-4751-bba6-7cbffb8ab420: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0e99130-76fd-4751-bba6-7cbffb8ab420', 'volume_size': 1} Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6267e021-6a30-407d-83b6-2d5f7d0dc56e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-25081e62-b478-4f3d-9211-7cd67b31323b tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-06a7400e-249c-474d-9c9e-41cd44e64b92" returned: 0 in 0.476s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-25081e62-b478-4f3d-9211-7cd67b31323b tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-06a7400e-249c-474d-9c9e-41cd44e64b92" released by "delete_volume" :: held 1.181s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-255945a4-6407-4d5a-ab2d-f60b682ea3cc tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2056f9b9-d9bd-4b7c-8e45-10a92b347288 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:24 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2056f9b9-d9bd-4b7c-8e45-10a92b347288 Jul 16 23:36:24 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-25081e62-b478-4f3d-9211-7cd67b31323b tempest-ProjectMemberTests-1023405772 None] Created reservations ['3cea6a10-38d3-4850-9e9f-74868a53a64a', '334a64b9-08d0-4807-bd35-eccaaa221be1', 'c7375fbe-d25f-403c-b83f-076298cbb918', '776e05e9-9aa6-4e0e-ad35-2a80864c5564'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:36:25 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-09df03f8-62b3-4e42-ba5b-8249e5dc3999 tempest-ProjectReaderTests-1123006400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4e89f0f2-1979-4fe6-b9cf-0afe89d066e8" returned: 0 in 0.640s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-09df03f8-62b3-4e42-ba5b-8249e5dc3999 tempest-ProjectReaderTests-1123006400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4e89f0f2-1979-4fe6-b9cf-0afe89d066e8 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-25081e62-b478-4f3d-9211-7cd67b31323b tempest-ProjectMemberTests-1023405772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-25081e62-b478-4f3d-9211-7cd67b31323b tempest-ProjectMemberTests-1023405772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-25081e62-b478-4f3d-9211-7cd67b31323b tempest-ProjectMemberTests-1023405772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:25 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4e89f0f2-1979-4fe6-b9cf-0afe89d066e8 Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-25081e62-b478-4f3d-9211-7cd67b31323b tempest-ProjectMemberTests-1023405772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-25081e62-b478-4f3d-9211-7cd67b31323b tempest-ProjectMemberTests-1023405772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-25081e62-b478-4f3d-9211-7cd67b31323b tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:25 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:25 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:25 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:36:25 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-255945a4-6407-4d5a-ab2d-f60b682ea3cc tempest-CreateVolumesFromSourceVolumeTest-593114566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2056f9b9-d9bd-4b7c-8e45-10a92b347288" returned: 0 in 0.364s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-255945a4-6407-4d5a-ab2d-f60b682ea3cc tempest-CreateVolumesFromSourceVolumeTest-593114566 None] <== create_volume: return (1343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-255945a4-6407-4d5a-ab2d-f60b682ea3cc tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.346s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-76e86119-648e-4280-a934-11e7ab0ce623 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.937s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-76e86119-648e-4280-a934-11e7ab0ce623 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-783528475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29b03c93-49c6-4572-9df6-e73525cc63d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80677140fff7434fafb4492f3b4bf630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:36:24Z,use_quota=True,user_id='70d72bf92940418fa9c2bffc766ab1b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-76e86119-648e-4280-a934-11e7ab0ce623 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Creating volume 29b03c93-49c6-4572-9df6-e73525cc63d9 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-76e86119-648e-4280-a934-11e7ab0ce623 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-76e86119-648e-4280-a934-11e7ab0ce623 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-76e86119-648e-4280-a934-11e7ab0ce623 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-76e86119-648e-4280-a934-11e7ab0ce623 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-76e86119-648e-4280-a934-11e7ab0ce623 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-76e86119-648e-4280-a934-11e7ab0ce623 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:36:25 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-76e86119-648e-4280-a934-11e7ab0ce623 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-76e86119-648e-4280-a934-11e7ab0ce623 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-29b03c93-49c6-4572-9df6-e73525cc63d9 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-255945a4-6407-4d5a-ab2d-f60b682ea3cc tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3b16727-91fb-41b2-af13-221dbef21f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2056f9b9-d9bd-4b7c-8e45-10a92b347288', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-255945a4-6407-4d5a-ab2d-f60b682ea3cc tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d12790ef-a535-42bb-97ee-8868907b7df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f582b30-075b-44f5-a99e-4ee924bdc61e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:36:25 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-29b03c93-49c6-4572-9df6-e73525cc63d9 1073741824 Jul 16 23:36:25 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3f582b30-075b-44f5-a99e-4ee924bdc61e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Flow 'volume_create_manager' (cc3c3c2f-1424-405a-b042-6cf0b9e920be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3f582b30-075b-44f5-a99e-4ee924bdc61e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de368b2f-a684-440a-af6d-42d2ffb19979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:25 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-255945a4-6407-4d5a-ab2d-f60b682ea3cc tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Volume volume-2056f9b9-d9bd-4b7c-8e45-10a92b347288 (2056f9b9-d9bd-4b7c-8e45-10a92b347288): created successfully Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-255945a4-6407-4d5a-ab2d-f60b682ea3cc tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d12790ef-a535-42bb-97ee-8868907b7df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-255945a4-6407-4d5a-ab2d-f60b682ea3cc tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Flow 'volume_create_manager' (4ba8e853-ad26-4010-9510-85bb9204752d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3f582b30-075b-44f5-a99e-4ee924bdc61e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de368b2f-a684-440a-af6d-42d2ffb19979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1430875902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5db9d5c7-5c7b-4448-929f-38894da01547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80677140fff7434fafb4492f3b4bf630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:36:25Z,use_quota=True,user_id='70d72bf92940418fa9c2bffc766ab1b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3f582b30-075b-44f5-a99e-4ee924bdc61e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16a69ce2-650e-402e-9ac0-07dc71ae196c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3f582b30-075b-44f5-a99e-4ee924bdc61e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16a69ce2-650e-402e-9ac0-07dc71ae196c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3f582b30-075b-44f5-a99e-4ee924bdc61e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27b3aa37-8804-4be0-b243-d0df320a7422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3f582b30-075b-44f5-a99e-4ee924bdc61e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27b3aa37-8804-4be0-b243-d0df320a7422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5db9d5c7-5c7b-4448-929f-38894da01547', 'volume_name': 'volume-5db9d5c7-5c7b-4448-929f-38894da01547', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3f582b30-075b-44f5-a99e-4ee924bdc61e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06f847ac-9a1b-4d6a-ad32-eaa081e4b015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3f582b30-075b-44f5-a99e-4ee924bdc61e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06f847ac-9a1b-4d6a-ad32-eaa081e4b015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3f582b30-075b-44f5-a99e-4ee924bdc61e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (118376f4-72af-4d1f-9b58-f819dca88701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:25 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-3f582b30-075b-44f5-a99e-4ee924bdc61e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Volume 5db9d5c7-5c7b-4448-929f-38894da01547: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5db9d5c7-5c7b-4448-929f-38894da01547', 'volume_size': 1} Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3f582b30-075b-44f5-a99e-4ee924bdc61e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:25 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-255945a4-6407-4d5a-ab2d-f60b682ea3cc tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Created volume successfully. Jul 16 23:36:25 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-09df03f8-62b3-4e42-ba5b-8249e5dc3999 tempest-ProjectReaderTests-1123006400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4e89f0f2-1979-4fe6-b9cf-0afe89d066e8" returned: 0 in 0.479s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-09df03f8-62b3-4e42-ba5b-8249e5dc3999 tempest-ProjectReaderTests-1123006400 None] Lock "cinder-quobyte-4e89f0f2-1979-4fe6-b9cf-0afe89d066e8" released by "delete_volume" :: held 1.177s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:25 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-25081e62-b478-4f3d-9211-7cd67b31323b tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.468s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-25081e62-b478-4f3d-9211-7cd67b31323b tempest-ProjectMemberTests-1023405772 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:36:25 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-25081e62-b478-4f3d-9211-7cd67b31323b tempest-ProjectMemberTests-1023405772 None] Deleted volume successfully. Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-25081e62-b478-4f3d-9211-7cd67b31323b tempest-ProjectMemberTests-1023405772 None] Lock "cinder-06a7400e-249c-474d-9c9e-41cd44e64b92-delete_volume" released by "delete_volume" :: held 2.103s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-09df03f8-62b3-4e42-ba5b-8249e5dc3999 tempest-ProjectReaderTests-1123006400 None] Created reservations ['e3bccdd3-189e-427f-8f54-a00a33587678', 'cbf61ea5-7743-4a2a-a398-1f4ee9b5e418', '332317c3-8b4a-46b5-8ccb-539ff07e727e', 'e7e20898-32c1-4bb5-b9f2-cbab810d0cba'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-09df03f8-62b3-4e42-ba5b-8249e5dc3999 tempest-ProjectReaderTests-1123006400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-09df03f8-62b3-4e42-ba5b-8249e5dc3999 tempest-ProjectReaderTests-1123006400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-09df03f8-62b3-4e42-ba5b-8249e5dc3999 tempest-ProjectReaderTests-1123006400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-09df03f8-62b3-4e42-ba5b-8249e5dc3999 tempest-ProjectReaderTests-1123006400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-09df03f8-62b3-4e42-ba5b-8249e5dc3999 tempest-ProjectReaderTests-1123006400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-09df03f8-62b3-4e42-ba5b-8249e5dc3999 tempest-ProjectReaderTests-1123006400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:25 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:36:25 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-02f39008-11bd-4682-a8bd-6001a69fdbd7 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-02f39008-11bd-4682-a8bd-6001a69fdbd7 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Flow 'volume_create_manager' (f07a5ff3-c749-4910-b7bf-54aa35f07e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:36:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-02f39008-11bd-4682-a8bd-6001a69fdbd7 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc985a7-32cf-4234-8723-77b4bfaf5175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-02f39008-11bd-4682-a8bd-6001a69fdbd7 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc985a7-32cf-4234-8723-77b4bfaf5175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1127979474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbd4b7d1-80e3-4c64-9d23-7f753e8a12e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80677140fff7434fafb4492f3b4bf630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:36:26Z,use_quota=True,user_id='70d72bf92940418fa9c2bffc766ab1b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:26 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-02f39008-11bd-4682-a8bd-6001a69fdbd7 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22bc7782-0f1f-405b-b7b8-806d0a12b22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-02f39008-11bd-4682-a8bd-6001a69fdbd7 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22bc7782-0f1f-405b-b7b8-806d0a12b22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-02f39008-11bd-4682-a8bd-6001a69fdbd7 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5730e9dd-d517-4490-8b5f-6b9e7d91033b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-02f39008-11bd-4682-a8bd-6001a69fdbd7 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5730e9dd-d517-4490-8b5f-6b9e7d91033b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbd4b7d1-80e3-4c64-9d23-7f753e8a12e2', 'volume_name': 'volume-cbd4b7d1-80e3-4c64-9d23-7f753e8a12e2', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-02f39008-11bd-4682-a8bd-6001a69fdbd7 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1f48a54-f480-4fe5-8cf7-272c395367b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-02f39008-11bd-4682-a8bd-6001a69fdbd7 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1f48a54-f480-4fe5-8cf7-272c395367b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-02f39008-11bd-4682-a8bd-6001a69fdbd7 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f0a1c69-de73-4bb0-b5c8-00fa5bb34835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:26 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-02f39008-11bd-4682-a8bd-6001a69fdbd7 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Volume cbd4b7d1-80e3-4c64-9d23-7f753e8a12e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbd4b7d1-80e3-4c64-9d23-7f753e8a12e2', 'volume_size': 1} Jul 16 23:36:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-02f39008-11bd-4682-a8bd-6001a69fdbd7 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-76e86119-648e-4280-a934-11e7ab0ce623 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-29b03c93-49c6-4572-9df6-e73525cc63d9 1073741824" returned: 0 in 0.824s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-76e86119-648e-4280-a934-11e7ab0ce623 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-29b03c93-49c6-4572-9df6-e73525cc63d9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:26 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-09df03f8-62b3-4e42-ba5b-8249e5dc3999 tempest-ProjectReaderTests-1123006400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.315s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:26 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-09df03f8-62b3-4e42-ba5b-8249e5dc3999 tempest-ProjectReaderTests-1123006400 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:36:26 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-29b03c93-49c6-4572-9df6-e73525cc63d9 Jul 16 23:36:26 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:26 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-09df03f8-62b3-4e42-ba5b-8249e5dc3999 tempest-ProjectReaderTests-1123006400 None] Deleted volume successfully. Jul 16 23:36:26 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-09df03f8-62b3-4e42-ba5b-8249e5dc3999 tempest-ProjectReaderTests-1123006400 None] Lock "cinder-4e89f0f2-1979-4fe6-b9cf-0afe89d066e8-delete_volume" released by "delete_volume" :: held 1.844s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:26 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-76e86119-648e-4280-a934-11e7ab0ce623 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-29b03c93-49c6-4572-9df6-e73525cc63d9" returned: 0 in 0.306s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:26 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-76e86119-648e-4280-a934-11e7ab0ce623 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:36:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-76e86119-648e-4280-a934-11e7ab0ce623 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6267e021-6a30-407d-83b6-2d5f7d0dc56e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.604s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:26 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-6267e021-6a30-407d-83b6-2d5f7d0dc56e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-294651444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0e99130-76fd-4751-bba6-7cbffb8ab420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80677140fff7434fafb4492f3b4bf630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:36:25Z,use_quota=True,user_id='70d72bf92940418fa9c2bffc766ab1b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:36:26 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-6267e021-6a30-407d-83b6-2d5f7d0dc56e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Creating volume f0e99130-76fd-4751-bba6-7cbffb8ab420 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:36:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6267e021-6a30-407d-83b6-2d5f7d0dc56e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6267e021-6a30-407d-83b6-2d5f7d0dc56e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:26 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-6267e021-6a30-407d-83b6-2d5f7d0dc56e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:26 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-6267e021-6a30-407d-83b6-2d5f7d0dc56e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6267e021-6a30-407d-83b6-2d5f7d0dc56e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:26 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-6267e021-6a30-407d-83b6-2d5f7d0dc56e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:36:26 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-6267e021-6a30-407d-83b6-2d5f7d0dc56e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:36:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6267e021-6a30-407d-83b6-2d5f7d0dc56e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f0e99130-76fd-4751-bba6-7cbffb8ab420 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:26 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f0e99130-76fd-4751-bba6-7cbffb8ab420 1073741824 Jul 16 23:36:26 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-76e86119-648e-4280-a934-11e7ab0ce623 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfbd2393-f469-4158-8750-3da78dc7fd4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29b03c93-49c6-4572-9df6-e73525cc63d9', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-76e86119-648e-4280-a934-11e7ab0ce623 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68629a8d-44fd-4b65-aa8d-6d6ece953617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:26 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ccf4eb4-310d-4b05-9a1b-e748327784cc tempest-ProjectMemberTests-1023405772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:36:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4ccf4eb4-310d-4b05-9a1b-e748327784cc tempest-ProjectMemberTests-1023405772 None] Flow 'volume_create_manager' (07516a07-b782-4155-b145-dbb7adacf8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:36:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4ccf4eb4-310d-4b05-9a1b-e748327784cc tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e40fa21-7600-4e24-973a-86405a6e9d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:26 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-76e86119-648e-4280-a934-11e7ab0ce623 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Volume volume-29b03c93-49c6-4572-9df6-e73525cc63d9 (29b03c93-49c6-4572-9df6-e73525cc63d9): created successfully Jul 16 23:36:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-76e86119-648e-4280-a934-11e7ab0ce623 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68629a8d-44fd-4b65-aa8d-6d6ece953617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-76e86119-648e-4280-a934-11e7ab0ce623 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Flow 'volume_create_manager' (34b77077-a321-45c8-a7bf-cc1f236953ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:36:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4ccf4eb4-310d-4b05-9a1b-e748327784cc tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e40fa21-7600-4e24-973a-86405a6e9d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-314605022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=224a9a44-c52d-46dc-ada5-9de8fbce166d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b14a0052f8fb4344b121d3a20292b053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:36:26Z,use_quota=True,user_id='faa7527cbba84668895a85e3faa36efb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4ccf4eb4-310d-4b05-9a1b-e748327784cc tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de3e72ff-2cc3-4b86-9e1b-4d43b7b73d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4ccf4eb4-310d-4b05-9a1b-e748327784cc tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de3e72ff-2cc3-4b86-9e1b-4d43b7b73d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4ccf4eb4-310d-4b05-9a1b-e748327784cc tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d2dcc0e-9b0e-4d11-b4f2-ba9c40d0d812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4ccf4eb4-310d-4b05-9a1b-e748327784cc tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d2dcc0e-9b0e-4d11-b4f2-ba9c40d0d812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '224a9a44-c52d-46dc-ada5-9de8fbce166d', 'volume_name': 'volume-224a9a44-c52d-46dc-ada5-9de8fbce166d', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4ccf4eb4-310d-4b05-9a1b-e748327784cc tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31b55906-c33e-40f9-9a41-ee81f8909b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4ccf4eb4-310d-4b05-9a1b-e748327784cc tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31b55906-c33e-40f9-9a41-ee81f8909b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4ccf4eb4-310d-4b05-9a1b-e748327784cc tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66fc16c3-d4ee-495d-918e-eae633585816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:26 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-4ccf4eb4-310d-4b05-9a1b-e748327784cc tempest-ProjectMemberTests-1023405772 None] Volume 224a9a44-c52d-46dc-ada5-9de8fbce166d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-224a9a44-c52d-46dc-ada5-9de8fbce166d', 'volume_size': 1} Jul 16 23:36:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4ccf4eb4-310d-4b05-9a1b-e748327784cc tempest-ProjectMemberTests-1023405772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:26 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-76e86119-648e-4280-a934-11e7ab0ce623 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Created volume successfully. Jul 16 23:36:27 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6267e021-6a30-407d-83b6-2d5f7d0dc56e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f0e99130-76fd-4751-bba6-7cbffb8ab420 1073741824" returned: 0 in 0.642s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6267e021-6a30-407d-83b6-2d5f7d0dc56e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f0e99130-76fd-4751-bba6-7cbffb8ab420 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:27 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f0e99130-76fd-4751-bba6-7cbffb8ab420 Jul 16 23:36:27 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:27 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6267e021-6a30-407d-83b6-2d5f7d0dc56e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f0e99130-76fd-4751-bba6-7cbffb8ab420" returned: 0 in 0.292s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:27 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-6267e021-6a30-407d-83b6-2d5f7d0dc56e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:36:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6267e021-6a30-407d-83b6-2d5f7d0dc56e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3f582b30-075b-44f5-a99e-4ee924bdc61e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.931s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:27 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3f582b30-075b-44f5-a99e-4ee924bdc61e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1430875902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5db9d5c7-5c7b-4448-929f-38894da01547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80677140fff7434fafb4492f3b4bf630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:36:25Z,use_quota=True,user_id='70d72bf92940418fa9c2bffc766ab1b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:36:27 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-3f582b30-075b-44f5-a99e-4ee924bdc61e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Creating volume 5db9d5c7-5c7b-4448-929f-38894da01547 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:36:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3f582b30-075b-44f5-a99e-4ee924bdc61e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3f582b30-075b-44f5-a99e-4ee924bdc61e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:27 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3f582b30-075b-44f5-a99e-4ee924bdc61e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:27 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3f582b30-075b-44f5-a99e-4ee924bdc61e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3f582b30-075b-44f5-a99e-4ee924bdc61e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:27 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3f582b30-075b-44f5-a99e-4ee924bdc61e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:36:27 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-3f582b30-075b-44f5-a99e-4ee924bdc61e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:36:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3f582b30-075b-44f5-a99e-4ee924bdc61e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5db9d5c7-5c7b-4448-929f-38894da01547 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:27 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5db9d5c7-5c7b-4448-929f-38894da01547 1073741824 Jul 16 23:36:27 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6267e021-6a30-407d-83b6-2d5f7d0dc56e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42970563-9300-40fd-ad32-1849dff6f164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0e99130-76fd-4751-bba6-7cbffb8ab420', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6267e021-6a30-407d-83b6-2d5f7d0dc56e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e1179e5-d046-4c5b-81d1-928a73fc9078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:27 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-6267e021-6a30-407d-83b6-2d5f7d0dc56e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Volume volume-f0e99130-76fd-4751-bba6-7cbffb8ab420 (f0e99130-76fd-4751-bba6-7cbffb8ab420): created successfully Jul 16 23:36:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6267e021-6a30-407d-83b6-2d5f7d0dc56e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e1179e5-d046-4c5b-81d1-928a73fc9078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:27 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6267e021-6a30-407d-83b6-2d5f7d0dc56e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Flow 'volume_create_manager' (dc2fe7fe-3f46-4fdc-b2cf-04be9f63d3e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:36:27 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-6267e021-6a30-407d-83b6-2d5f7d0dc56e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Created volume successfully. Jul 16 23:36:28 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3f582b30-075b-44f5-a99e-4ee924bdc61e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5db9d5c7-5c7b-4448-929f-38894da01547 1073741824" returned: 0 in 0.520s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3f582b30-075b-44f5-a99e-4ee924bdc61e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5db9d5c7-5c7b-4448-929f-38894da01547 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:28 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5db9d5c7-5c7b-4448-929f-38894da01547 Jul 16 23:36:28 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:28 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3f582b30-075b-44f5-a99e-4ee924bdc61e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5db9d5c7-5c7b-4448-929f-38894da01547" returned: 0 in 0.299s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:28 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3f582b30-075b-44f5-a99e-4ee924bdc61e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:36:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3f582b30-075b-44f5-a99e-4ee924bdc61e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-02f39008-11bd-4682-a8bd-6001a69fdbd7 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.250s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:28 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-02f39008-11bd-4682-a8bd-6001a69fdbd7 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1127979474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbd4b7d1-80e3-4c64-9d23-7f753e8a12e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80677140fff7434fafb4492f3b4bf630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:36:26Z,use_quota=True,user_id='70d72bf92940418fa9c2bffc766ab1b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:36:28 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-02f39008-11bd-4682-a8bd-6001a69fdbd7 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Creating volume cbd4b7d1-80e3-4c64-9d23-7f753e8a12e2 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:36:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-02f39008-11bd-4682-a8bd-6001a69fdbd7 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-02f39008-11bd-4682-a8bd-6001a69fdbd7 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:28 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-02f39008-11bd-4682-a8bd-6001a69fdbd7 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:28 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-02f39008-11bd-4682-a8bd-6001a69fdbd7 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-02f39008-11bd-4682-a8bd-6001a69fdbd7 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:28 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-02f39008-11bd-4682-a8bd-6001a69fdbd7 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:36:28 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-02f39008-11bd-4682-a8bd-6001a69fdbd7 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:36:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-02f39008-11bd-4682-a8bd-6001a69fdbd7 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cbd4b7d1-80e3-4c64-9d23-7f753e8a12e2 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:28 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3f582b30-075b-44f5-a99e-4ee924bdc61e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (118376f4-72af-4d1f-9b58-f819dca88701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5db9d5c7-5c7b-4448-929f-38894da01547', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:28 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3f582b30-075b-44f5-a99e-4ee924bdc61e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a27920fd-f100-42e4-8618-2f4730e9b241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:28 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cbd4b7d1-80e3-4c64-9d23-7f753e8a12e2 1073741824 Jul 16 23:36:28 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:28 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-3f582b30-075b-44f5-a99e-4ee924bdc61e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Volume volume-5db9d5c7-5c7b-4448-929f-38894da01547 (5db9d5c7-5c7b-4448-929f-38894da01547): created successfully Jul 16 23:36:28 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3f582b30-075b-44f5-a99e-4ee924bdc61e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a27920fd-f100-42e4-8618-2f4730e9b241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:28 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3f582b30-075b-44f5-a99e-4ee924bdc61e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Flow 'volume_create_manager' (cc3c3c2f-1424-405a-b042-6cf0b9e920be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:36:28 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-3f582b30-075b-44f5-a99e-4ee924bdc61e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Created volume successfully. Jul 16 23:36:29 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-02f39008-11bd-4682-a8bd-6001a69fdbd7 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cbd4b7d1-80e3-4c64-9d23-7f753e8a12e2 1073741824" returned: 0 in 0.600s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-02f39008-11bd-4682-a8bd-6001a69fdbd7 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cbd4b7d1-80e3-4c64-9d23-7f753e8a12e2 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:29 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cbd4b7d1-80e3-4c64-9d23-7f753e8a12e2 Jul 16 23:36:29 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:29 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-02f39008-11bd-4682-a8bd-6001a69fdbd7 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cbd4b7d1-80e3-4c64-9d23-7f753e8a12e2" returned: 0 in 0.297s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:29 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-02f39008-11bd-4682-a8bd-6001a69fdbd7 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:36:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-02f39008-11bd-4682-a8bd-6001a69fdbd7 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4ccf4eb4-310d-4b05-9a1b-e748327784cc tempest-ProjectMemberTests-1023405772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.655s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:29 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4ccf4eb4-310d-4b05-9a1b-e748327784cc tempest-ProjectMemberTests-1023405772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-314605022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=224a9a44-c52d-46dc-ada5-9de8fbce166d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b14a0052f8fb4344b121d3a20292b053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:36:26Z,use_quota=True,user_id='faa7527cbba84668895a85e3faa36efb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:36:29 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-4ccf4eb4-310d-4b05-9a1b-e748327784cc tempest-ProjectMemberTests-1023405772 None] Creating volume 224a9a44-c52d-46dc-ada5-9de8fbce166d {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:36:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4ccf4eb4-310d-4b05-9a1b-e748327784cc tempest-ProjectMemberTests-1023405772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4ccf4eb4-310d-4b05-9a1b-e748327784cc tempest-ProjectMemberTests-1023405772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:29 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4ccf4eb4-310d-4b05-9a1b-e748327784cc tempest-ProjectMemberTests-1023405772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:29 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4ccf4eb4-310d-4b05-9a1b-e748327784cc tempest-ProjectMemberTests-1023405772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4ccf4eb4-310d-4b05-9a1b-e748327784cc tempest-ProjectMemberTests-1023405772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:29 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4ccf4eb4-310d-4b05-9a1b-e748327784cc tempest-ProjectMemberTests-1023405772 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:36:29 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-4ccf4eb4-310d-4b05-9a1b-e748327784cc tempest-ProjectMemberTests-1023405772 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:36:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4ccf4eb4-310d-4b05-9a1b-e748327784cc tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:29 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-02f39008-11bd-4682-a8bd-6001a69fdbd7 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f0a1c69-de73-4bb0-b5c8-00fa5bb34835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbd4b7d1-80e3-4c64-9d23-7f753e8a12e2', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:29 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d 1073741824 Jul 16 23:36:29 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:29 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-02f39008-11bd-4682-a8bd-6001a69fdbd7 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30bfcc4c-1f7d-4990-9de1-f450d6cf166a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:29 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:SELECT=227,cinder:UPDATE=255,cinder:INSERT=80,cinder:DELETE=28 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:36:29 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-02f39008-11bd-4682-a8bd-6001a69fdbd7 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Volume volume-cbd4b7d1-80e3-4c64-9d23-7f753e8a12e2 (cbd4b7d1-80e3-4c64-9d23-7f753e8a12e2): created successfully Jul 16 23:36:29 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-02f39008-11bd-4682-a8bd-6001a69fdbd7 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30bfcc4c-1f7d-4990-9de1-f450d6cf166a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:29 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-02f39008-11bd-4682-a8bd-6001a69fdbd7 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Flow 'volume_create_manager' (f07a5ff3-c749-4910-b7bf-54aa35f07e89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:36:29 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-02f39008-11bd-4682-a8bd-6001a69fdbd7 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Created volume successfully. Jul 16 23:36:29 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:SELECT=205,cinder:INSERT=74,cinder:UPDATE=318,cinder:DELETE=25 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:36:29 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4ccf4eb4-310d-4b05-9a1b-e748327784cc tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d 1073741824" returned: 0 in 0.549s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4ccf4eb4-310d-4b05-9a1b-e748327784cc tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:30 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d Jul 16 23:36:30 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:30 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4ccf4eb4-310d-4b05-9a1b-e748327784cc tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d" returned: 0 in 0.261s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:30 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4ccf4eb4-310d-4b05-9a1b-e748327784cc tempest-ProjectMemberTests-1023405772 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:36:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4ccf4eb4-310d-4b05-9a1b-e748327784cc tempest-ProjectMemberTests-1023405772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:30 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4ccf4eb4-310d-4b05-9a1b-e748327784cc tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66fc16c3-d4ee-495d-918e-eae633585816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-224a9a44-c52d-46dc-ada5-9de8fbce166d', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:30 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4ccf4eb4-310d-4b05-9a1b-e748327784cc tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6944b0b-0b3e-4409-ae0a-f3ff20873bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:30 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-4ccf4eb4-310d-4b05-9a1b-e748327784cc tempest-ProjectMemberTests-1023405772 None] Volume volume-224a9a44-c52d-46dc-ada5-9de8fbce166d (224a9a44-c52d-46dc-ada5-9de8fbce166d): created successfully Jul 16 23:36:30 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4ccf4eb4-310d-4b05-9a1b-e748327784cc tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6944b0b-0b3e-4409-ae0a-f3ff20873bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:30 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-4ccf4eb4-310d-4b05-9a1b-e748327784cc tempest-ProjectMemberTests-1023405772 None] Flow 'volume_create_manager' (07516a07-b782-4155-b145-dbb7adacf8da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:36:30 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-4ccf4eb4-310d-4b05-9a1b-e748327784cc tempest-ProjectMemberTests-1023405772 None] Created volume successfully. Jul 16 23:36:30 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-48a7c970-3b4e-4abd-931c-02f4ded62448 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Acquiring lock "cinder-cbd4b7d1-80e3-4c64-9d23-7f753e8a12e2-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:30 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-48a7c970-3b4e-4abd-931c-02f4ded62448 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "cinder-cbd4b7d1-80e3-4c64-9d23-7f753e8a12e2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:30 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-48a7c970-3b4e-4abd-931c-02f4ded62448 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Acquiring lock "cinder-quobyte-cbd4b7d1-80e3-4c64-9d23-7f753e8a12e2" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:30 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-48a7c970-3b4e-4abd-931c-02f4ded62448 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "cinder-quobyte-cbd4b7d1-80e3-4c64-9d23-7f753e8a12e2" acquired by "delete_volume" :: waited 0.017s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:30 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fb8f16-bc0c-4c0c-9eff-7ed3a7a34fee]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:36:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-48a7c970-3b4e-4abd-931c-02f4ded62448 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cbd4b7d1-80e3-4c64-9d23-7f753e8a12e2 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:30 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cbd4b7d1-80e3-4c64-9d23-7f753e8a12e2 Jul 16 23:36:30 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:31 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-48a7c970-3b4e-4abd-931c-02f4ded62448 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cbd4b7d1-80e3-4c64-9d23-7f753e8a12e2" returned: 0 in 0.425s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-48a7c970-3b4e-4abd-931c-02f4ded62448 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cbd4b7d1-80e3-4c64-9d23-7f753e8a12e2 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:31 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cbd4b7d1-80e3-4c64-9d23-7f753e8a12e2 Jul 16 23:36:31 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-171a36c2-f52b-4bc6-9f4b-77f698f0ec8e tempest-ProjectMemberTests-1023405772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-171a36c2-f52b-4bc6-9f4b-77f698f0ec8e tempest-ProjectMemberTests-1023405772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:31 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-171a36c2-f52b-4bc6-9f4b-77f698f0ec8e tempest-ProjectMemberTests-1023405772 None] Creating offline snapshot 2b6576a6-33b5-4cd4-8810-caa493194deb of volume 224a9a44-c52d-46dc-ada5-9de8fbce166d {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:36:31 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[16bb5162-8673-4c9c-8cf4-a454a70ace64]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:36:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-171a36c2-f52b-4bc6-9f4b-77f698f0ec8e tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:31 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d Jul 16 23:36:31 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:31 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-48a7c970-3b4e-4abd-931c-02f4ded62448 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-cbd4b7d1-80e3-4c64-9d23-7f753e8a12e2" returned: 0 in 0.374s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:31 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-48a7c970-3b4e-4abd-931c-02f4ded62448 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "cinder-quobyte-cbd4b7d1-80e3-4c64-9d23-7f753e8a12e2" released by "delete_volume" :: held 0.860s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:31 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-48a7c970-3b4e-4abd-931c-02f4ded62448 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Created reservations ['9a44226d-abff-425a-bb1b-65dbc6288171', 'f652287b-3a1f-498c-945e-d0df2685940c', 'a4b6c0fc-975f-493c-aaaa-18b2f794684b', '4836dd12-3c6f-4798-b135-570360ea80d6'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:36:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-48a7c970-3b4e-4abd-931c-02f4ded62448 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-48a7c970-3b4e-4abd-931c-02f4ded62448 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:31 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-48a7c970-3b4e-4abd-931c-02f4ded62448 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:31 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-48a7c970-3b4e-4abd-931c-02f4ded62448 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-48a7c970-3b4e-4abd-931c-02f4ded62448 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-48a7c970-3b4e-4abd-931c-02f4ded62448 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:31 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:36:31 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:31 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-171a36c2-f52b-4bc6-9f4b-77f698f0ec8e tempest-ProjectMemberTests-1023405772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d" returned: 0 in 0.469s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-171a36c2-f52b-4bc6-9f4b-77f698f0ec8e tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d.2b6576a6-33b5-4cd4-8810-caa493194deb 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:31 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d.2b6576a6-33b5-4cd4-8810-caa493194deb 1G Jul 16 23:36:31 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:31 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e91b0985-01b9-4405-af79-6eead23506f4 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Acquiring lock "cinder-5db9d5c7-5c7b-4448-929f-38894da01547-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:31 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e91b0985-01b9-4405-af79-6eead23506f4 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "cinder-5db9d5c7-5c7b-4448-929f-38894da01547-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:31 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e91b0985-01b9-4405-af79-6eead23506f4 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Acquiring lock "cinder-quobyte-5db9d5c7-5c7b-4448-929f-38894da01547" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:31 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e91b0985-01b9-4405-af79-6eead23506f4 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "cinder-quobyte-5db9d5c7-5c7b-4448-929f-38894da01547" acquired by "delete_volume" :: waited 0.025s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:31 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2546387-dd4c-40a9-8238-90fa6bbc3b6b]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:36:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e91b0985-01b9-4405-af79-6eead23506f4 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5db9d5c7-5c7b-4448-929f-38894da01547 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:32 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-48a7c970-3b4e-4abd-931c-02f4ded62448 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.393s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:32 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-48a7c970-3b4e-4abd-931c-02f4ded62448 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:36:32 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-48a7c970-3b4e-4abd-931c-02f4ded62448 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Deleted volume successfully. Jul 16 23:36:32 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-48a7c970-3b4e-4abd-931c-02f4ded62448 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "cinder-cbd4b7d1-80e3-4c64-9d23-7f753e8a12e2-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:32 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5db9d5c7-5c7b-4448-929f-38894da01547 Jul 16 23:36:32 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:32 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-171a36c2-f52b-4bc6-9f4b-77f698f0ec8e tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d.2b6576a6-33b5-4cd4-8810-caa493194deb 1G" returned: 0 in 0.656s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-171a36c2-f52b-4bc6-9f4b-77f698f0ec8e tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-224a9a44-c52d-46dc-ada5-9de8fbce166d -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d.2b6576a6-33b5-4cd4-8810-caa493194deb {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:32 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-224a9a44-c52d-46dc-ada5-9de8fbce166d -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d.2b6576a6-33b5-4cd4-8810-caa493194deb Jul 16 23:36:32 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:32 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e91b0985-01b9-4405-af79-6eead23506f4 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5db9d5c7-5c7b-4448-929f-38894da01547" returned: 0 in 0.571s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e91b0985-01b9-4405-af79-6eead23506f4 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5db9d5c7-5c7b-4448-929f-38894da01547 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:32 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5db9d5c7-5c7b-4448-929f-38894da01547 Jul 16 23:36:32 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:32 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-171a36c2-f52b-4bc6-9f4b-77f698f0ec8e tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-224a9a44-c52d-46dc-ada5-9de8fbce166d -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d.2b6576a6-33b5-4cd4-8810-caa493194deb" returned: 0 in 0.323s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:32 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-171a36c2-f52b-4bc6-9f4b-77f698f0ec8e tempest-ProjectMemberTests-1023405772 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d.2b6576a6-33b5-4cd4-8810-caa493194deb is being set with open permissions: ugo+rw Jul 16 23:36:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-171a36c2-f52b-4bc6-9f4b-77f698f0ec8e tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d.2b6576a6-33b5-4cd4-8810-caa493194deb {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:32 devstack sudo[106916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d.2b6576a6-33b5-4cd4-8810-caa493194deb Jul 16 23:36:32 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:32 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e91b0985-01b9-4405-af79-6eead23506f4 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5db9d5c7-5c7b-4448-929f-38894da01547" returned: 0 in 0.290s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:32 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e91b0985-01b9-4405-af79-6eead23506f4 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "cinder-quobyte-5db9d5c7-5c7b-4448-929f-38894da01547" released by "delete_volume" :: held 0.923s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:32 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-e91b0985-01b9-4405-af79-6eead23506f4 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Created reservations ['848fb114-d6d6-4987-ae55-217533dbca3f', '54d35d8a-6a1e-45b7-8152-750eb5cd053c', '55748cdb-99d1-4ac2-8a68-c9981f047b5a', 'ed625f8b-ea3c-4478-a643-95f759027a8d'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:36:32 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-171a36c2-f52b-4bc6-9f4b-77f698f0ec8e tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d.2b6576a6-33b5-4cd4-8810-caa493194deb" returned: 0 in 0.289s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e91b0985-01b9-4405-af79-6eead23506f4 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e91b0985-01b9-4405-af79-6eead23506f4 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:32 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e91b0985-01b9-4405-af79-6eead23506f4 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:32 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e91b0985-01b9-4405-af79-6eead23506f4 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e91b0985-01b9-4405-af79-6eead23506f4 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e91b0985-01b9-4405-af79-6eead23506f4 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:33 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:36:33 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-171a36c2-f52b-4bc6-9f4b-77f698f0ec8e tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:33 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d.info Jul 16 23:36:33 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:33 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e91b0985-01b9-4405-af79-6eead23506f4 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.299s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:33 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-e91b0985-01b9-4405-af79-6eead23506f4 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:36:33 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-e91b0985-01b9-4405-af79-6eead23506f4 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Deleted volume successfully. Jul 16 23:36:33 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:33 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e91b0985-01b9-4405-af79-6eead23506f4 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "cinder-5db9d5c7-5c7b-4448-929f-38894da01547-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-171a36c2-f52b-4bc6-9f4b-77f698f0ec8e tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d.info" returned: 0 in 0.302s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:33 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-171a36c2-f52b-4bc6-9f4b-77f698f0ec8e tempest-ProjectMemberTests-1023405772 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d.info is being set with open permissions: ugo+rw Jul 16 23:36:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-171a36c2-f52b-4bc6-9f4b-77f698f0ec8e tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:33 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d.info Jul 16 23:36:33 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:33 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-171a36c2-f52b-4bc6-9f4b-77f698f0ec8e tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d.info" returned: 0 in 0.288s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-171a36c2-f52b-4bc6-9f4b-77f698f0ec8e tempest-ProjectMemberTests-1023405772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.482s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:33 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-171a36c2-f52b-4bc6-9f4b-77f698f0ec8e tempest-ProjectMemberTests-1023405772 None] Create snapshot completed successfully Jul 16 23:36:34 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-2726e82a-8c5a-4331-9782-b0875fbb4cff tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Acquiring lock "cinder-f0e99130-76fd-4751-bba6-7cbffb8ab420-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:34 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-2726e82a-8c5a-4331-9782-b0875fbb4cff tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "cinder-f0e99130-76fd-4751-bba6-7cbffb8ab420-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:34 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-2726e82a-8c5a-4331-9782-b0875fbb4cff tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Acquiring lock "cinder-quobyte-f0e99130-76fd-4751-bba6-7cbffb8ab420" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:34 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-2726e82a-8c5a-4331-9782-b0875fbb4cff tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "cinder-quobyte-f0e99130-76fd-4751-bba6-7cbffb8ab420" acquired by "delete_volume" :: waited 0.018s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:34 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3966f85-c96a-418f-bddd-08944006f834]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:36:34 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2726e82a-8c5a-4331-9782-b0875fbb4cff tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f0e99130-76fd-4751-bba6-7cbffb8ab420 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:34 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f0e99130-76fd-4751-bba6-7cbffb8ab420 Jul 16 23:36:34 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:34 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1571b540-03e1-4a4d-b931-efed915c4b86 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-2b6576a6-33b5-4cd4-8810-caa493194deb-delete_snapshot" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:34 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1571b540-03e1-4a4d-b931-efed915c4b86 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-2b6576a6-33b5-4cd4-8810-caa493194deb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:34 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1571b540-03e1-4a4d-b931-efed915c4b86 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-quobyte-224a9a44-c52d-46dc-ada5-9de8fbce166d" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:34 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1571b540-03e1-4a4d-b931-efed915c4b86 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-224a9a44-c52d-46dc-ada5-9de8fbce166d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:34 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1571b540-03e1-4a4d-b931-efed915c4b86 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-quobyte-2b6576a6-33b5-4cd4-8810-caa493194deb" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:34 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1571b540-03e1-4a4d-b931-efed915c4b86 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-2b6576a6-33b5-4cd4-8810-caa493194deb" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:34 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-1571b540-03e1-4a4d-b931-efed915c4b86 tempest-ProjectMemberTests-1023405772 None] Deleting offline snapshot 2b6576a6-33b5-4cd4-8810-caa493194deb of volume 224a9a44-c52d-46dc-ada5-9de8fbce166d {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:36:34 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-1571b540-03e1-4a4d-b931-efed915c4b86 tempest-ProjectMemberTests-1023405772 None] snapshot_file for this snap is: volume-224a9a44-c52d-46dc-ada5-9de8fbce166d.2b6576a6-33b5-4cd4-8810-caa493194deb {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:36:34 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e693ca-86b1-4b1b-ac52-59e031b7e2a9]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:36:34 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1571b540-03e1-4a4d-b931-efed915c4b86 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d.2b6576a6-33b5-4cd4-8810-caa493194deb {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:34 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d.2b6576a6-33b5-4cd4-8810-caa493194deb Jul 16 23:36:34 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:34 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:34 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2726e82a-8c5a-4331-9782-b0875fbb4cff tempest-CreateVolumesFromSourceVolumeTest-593114566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f0e99130-76fd-4751-bba6-7cbffb8ab420" returned: 0 in 0.449s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:34 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2726e82a-8c5a-4331-9782-b0875fbb4cff tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f0e99130-76fd-4751-bba6-7cbffb8ab420 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:34 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f0e99130-76fd-4751-bba6-7cbffb8ab420 Jul 16 23:36:34 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:34 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:34 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1571b540-03e1-4a4d-b931-efed915c4b86 tempest-ProjectMemberTests-1023405772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d.2b6576a6-33b5-4cd4-8810-caa493194deb" returned: 0 in 0.378s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:34 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-1571b540-03e1-4a4d-b931-efed915c4b86 tempest-ProjectMemberTests-1023405772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-224a9a44-c52d-46dc-ada5-9de8fbce166d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:36:34 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebbd8ac-5a66-494c-8b4c-2cb1dc4c443e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:36:34 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1571b540-03e1-4a4d-b931-efed915c4b86 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:34 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:34 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2726e82a-8c5a-4331-9782-b0875fbb4cff tempest-CreateVolumesFromSourceVolumeTest-593114566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-f0e99130-76fd-4751-bba6-7cbffb8ab420" returned: 0 in 0.273s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:34 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-2726e82a-8c5a-4331-9782-b0875fbb4cff tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "cinder-quobyte-f0e99130-76fd-4751-bba6-7cbffb8ab420" released by "delete_volume" :: held 0.783s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:35 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d Jul 16 23:36:35 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:35 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-2726e82a-8c5a-4331-9782-b0875fbb4cff tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Created reservations ['fbbcc20e-b0ce-4bf5-96bb-945545df0402', 'ea9e76d9-ebae-407a-9a99-0b26732006aa', '4059ec66-bc91-446e-b216-5562fd493173', '64286c4d-cd96-4985-aa4c-d42c6e30cb33'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:36:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-2726e82a-8c5a-4331-9782-b0875fbb4cff tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-2726e82a-8c5a-4331-9782-b0875fbb4cff tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:35 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-2726e82a-8c5a-4331-9782-b0875fbb4cff tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:35 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-2726e82a-8c5a-4331-9782-b0875fbb4cff tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-2726e82a-8c5a-4331-9782-b0875fbb4cff tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2726e82a-8c5a-4331-9782-b0875fbb4cff tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:35 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:36:35 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:35 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f739cb64-9552-4cae-8612-52877ccc423e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Acquiring lock "cinder-29b03c93-49c6-4572-9df6-e73525cc63d9-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:35 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f739cb64-9552-4cae-8612-52877ccc423e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "cinder-29b03c93-49c6-4572-9df6-e73525cc63d9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:35 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f739cb64-9552-4cae-8612-52877ccc423e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Acquiring lock "cinder-quobyte-29b03c93-49c6-4572-9df6-e73525cc63d9" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:35 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:35 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f739cb64-9552-4cae-8612-52877ccc423e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "cinder-quobyte-29b03c93-49c6-4572-9df6-e73525cc63d9" acquired by "delete_volume" :: waited 0.031s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1571b540-03e1-4a4d-b931-efed915c4b86 tempest-ProjectMemberTests-1023405772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d" returned: 0 in 0.565s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1571b540-03e1-4a4d-b931-efed915c4b86 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d.2b6576a6-33b5-4cd4-8810-caa493194deb {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:35 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f6e190-19f0-4faf-b2d6-77a34b404fd9]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:36:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f739cb64-9552-4cae-8612-52877ccc423e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-29b03c93-49c6-4572-9df6-e73525cc63d9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:35 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d.2b6576a6-33b5-4cd4-8810-caa493194deb Jul 16 23:36:35 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:35 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2726e82a-8c5a-4331-9782-b0875fbb4cff tempest-CreateVolumesFromSourceVolumeTest-593114566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.346s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:35 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-2726e82a-8c5a-4331-9782-b0875fbb4cff tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:36:35 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-2726e82a-8c5a-4331-9782-b0875fbb4cff tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Deleted volume successfully. Jul 16 23:36:35 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-2726e82a-8c5a-4331-9782-b0875fbb4cff tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "cinder-f0e99130-76fd-4751-bba6-7cbffb8ab420-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:35 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-29b03c93-49c6-4572-9df6-e73525cc63d9 Jul 16 23:36:35 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:35 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1571b540-03e1-4a4d-b931-efed915c4b86 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d.2b6576a6-33b5-4cd4-8810-caa493194deb" returned: 0 in 0.476s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:35 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1571b540-03e1-4a4d-b931-efed915c4b86 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d.2b6576a6-33b5-4cd4-8810-caa493194deb {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:35 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d.2b6576a6-33b5-4cd4-8810-caa493194deb Jul 16 23:36:35 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:36 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f739cb64-9552-4cae-8612-52877ccc423e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-29b03c93-49c6-4572-9df6-e73525cc63d9" returned: 0 in 0.537s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f739cb64-9552-4cae-8612-52877ccc423e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-29b03c93-49c6-4572-9df6-e73525cc63d9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:36 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-29b03c93-49c6-4572-9df6-e73525cc63d9 Jul 16 23:36:36 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:36 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1571b540-03e1-4a4d-b931-efed915c4b86 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d.2b6576a6-33b5-4cd4-8810-caa493194deb" returned: 0 in 0.311s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:36 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1571b540-03e1-4a4d-b931-efed915c4b86 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-2b6576a6-33b5-4cd4-8810-caa493194deb" released by "_delete_snapshot" :: held 1.836s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:36 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1571b540-03e1-4a4d-b931-efed915c4b86 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-224a9a44-c52d-46dc-ada5-9de8fbce166d" released by "delete_snapshot" :: held 1.864s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:36 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f739cb64-9552-4cae-8612-52877ccc423e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-29b03c93-49c6-4572-9df6-e73525cc63d9" returned: 0 in 0.327s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:36 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-1571b540-03e1-4a4d-b931-efed915c4b86 tempest-ProjectMemberTests-1023405772 None] Created reservations ['23502849-72df-4a4c-89cf-5c2bf6257c3d', 'e46a5c17-c863-44cc-837a-30657a10189e', 'b22552a9-a850-46ec-b0f2-8d3c78ae2341', '00ab25de-6e5b-45bd-9483-fb32e1164b03'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:36:36 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f739cb64-9552-4cae-8612-52877ccc423e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "cinder-quobyte-29b03c93-49c6-4572-9df6-e73525cc63d9" released by "delete_volume" :: held 0.945s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:36 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-1571b540-03e1-4a4d-b931-efed915c4b86 tempest-ProjectMemberTests-1023405772 None] Delete snapshot completed successfully. Jul 16 23:36:36 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1571b540-03e1-4a4d-b931-efed915c4b86 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-2b6576a6-33b5-4cd4-8810-caa493194deb-delete_snapshot" released by "delete_snapshot" :: held 2.088s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:36 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-f739cb64-9552-4cae-8612-52877ccc423e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Created reservations ['26c21d69-e28a-4675-a58d-a6b1f5cd1475', '90df00b1-85c4-4cbd-8c2a-a0fc4e943c12', '1271fe39-55b2-489d-a4c7-b8171f8e13c0', 'd2d1f130-4ac1-4970-9485-bce4f0cfa8bc'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:36:36 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-39748fab-3bb6-4e90-a152-3fd7bcf45982 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-224a9a44-c52d-46dc-ada5-9de8fbce166d-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:36 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-39748fab-3bb6-4e90-a152-3fd7bcf45982 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-224a9a44-c52d-46dc-ada5-9de8fbce166d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f739cb64-9552-4cae-8612-52877ccc423e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f739cb64-9552-4cae-8612-52877ccc423e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:36 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f739cb64-9552-4cae-8612-52877ccc423e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:36 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f739cb64-9552-4cae-8612-52877ccc423e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f739cb64-9552-4cae-8612-52877ccc423e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f739cb64-9552-4cae-8612-52877ccc423e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:36 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:36:36 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:36 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-39748fab-3bb6-4e90-a152-3fd7bcf45982 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-quobyte-224a9a44-c52d-46dc-ada5-9de8fbce166d" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:36 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-39748fab-3bb6-4e90-a152-3fd7bcf45982 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-224a9a44-c52d-46dc-ada5-9de8fbce166d" acquired by "delete_volume" :: waited 0.029s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:36 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[0095739f-5a91-428f-b97b-523c072c1e2c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:36:36 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-39748fab-3bb6-4e90-a152-3fd7bcf45982 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:36 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d Jul 16 23:36:36 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:37 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f739cb64-9552-4cae-8612-52877ccc423e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.366s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:37 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-f739cb64-9552-4cae-8612-52877ccc423e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:36:37 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-f739cb64-9552-4cae-8612-52877ccc423e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Deleted volume successfully. Jul 16 23:36:37 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f739cb64-9552-4cae-8612-52877ccc423e tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "cinder-29b03c93-49c6-4572-9df6-e73525cc63d9-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:37 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-39748fab-3bb6-4e90-a152-3fd7bcf45982 tempest-ProjectMemberTests-1023405772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d" returned: 0 in 0.457s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-39748fab-3bb6-4e90-a152-3fd7bcf45982 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:37 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d Jul 16 23:36:37 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:37 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-39748fab-3bb6-4e90-a152-3fd7bcf45982 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-224a9a44-c52d-46dc-ada5-9de8fbce166d" returned: 0 in 0.348s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:37 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-39748fab-3bb6-4e90-a152-3fd7bcf45982 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-224a9a44-c52d-46dc-ada5-9de8fbce166d" released by "delete_volume" :: held 0.882s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:37 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-44418651-1e02-4ae5-a387-c95b83ddad59 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Acquiring lock "cinder-2056f9b9-d9bd-4b7c-8e45-10a92b347288-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:37 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-44418651-1e02-4ae5-a387-c95b83ddad59 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "cinder-2056f9b9-d9bd-4b7c-8e45-10a92b347288-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:37 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-44418651-1e02-4ae5-a387-c95b83ddad59 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Acquiring lock "cinder-quobyte-2056f9b9-d9bd-4b7c-8e45-10a92b347288" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:37 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-39748fab-3bb6-4e90-a152-3fd7bcf45982 tempest-ProjectMemberTests-1023405772 None] Created reservations ['dcb7e3f9-d8cc-4e8a-b89a-d422043529aa', '763c9074-f831-4a41-a0ec-b33dd4df6f71', '02605850-5557-4a7c-aad1-eeb54a9ca2fc', 'fb400abc-e0ba-43c2-90e9-91eeaa588edf'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:36:37 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-44418651-1e02-4ae5-a387-c95b83ddad59 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "cinder-quobyte-2056f9b9-d9bd-4b7c-8e45-10a92b347288" acquired by "delete_volume" :: waited 0.022s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:37 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df40ba6-26c1-4b44-ae13-6bf169add048]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:36:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-44418651-1e02-4ae5-a387-c95b83ddad59 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2056f9b9-d9bd-4b7c-8e45-10a92b347288 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-39748fab-3bb6-4e90-a152-3fd7bcf45982 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-39748fab-3bb6-4e90-a152-3fd7bcf45982 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:37 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-39748fab-3bb6-4e90-a152-3fd7bcf45982 tempest-ProjectMemberTests-1023405772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:37 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-39748fab-3bb6-4e90-a152-3fd7bcf45982 tempest-ProjectMemberTests-1023405772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-39748fab-3bb6-4e90-a152-3fd7bcf45982 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:37 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-39748fab-3bb6-4e90-a152-3fd7bcf45982 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:37 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:36:37 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:37 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2056f9b9-d9bd-4b7c-8e45-10a92b347288 Jul 16 23:36:37 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:38 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-39748fab-3bb6-4e90-a152-3fd7bcf45982 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.341s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:38 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-39748fab-3bb6-4e90-a152-3fd7bcf45982 tempest-ProjectMemberTests-1023405772 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:36:38 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-39748fab-3bb6-4e90-a152-3fd7bcf45982 tempest-ProjectMemberTests-1023405772 None] Deleted volume successfully. Jul 16 23:36:38 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-39748fab-3bb6-4e90-a152-3fd7bcf45982 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-224a9a44-c52d-46dc-ada5-9de8fbce166d-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:38 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-44418651-1e02-4ae5-a387-c95b83ddad59 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2056f9b9-d9bd-4b7c-8e45-10a92b347288" returned: 0 in 0.478s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-44418651-1e02-4ae5-a387-c95b83ddad59 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2056f9b9-d9bd-4b7c-8e45-10a92b347288 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:38 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2056f9b9-d9bd-4b7c-8e45-10a92b347288 Jul 16 23:36:38 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:38 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-44418651-1e02-4ae5-a387-c95b83ddad59 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2056f9b9-d9bd-4b7c-8e45-10a92b347288" returned: 0 in 0.279s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:38 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-44418651-1e02-4ae5-a387-c95b83ddad59 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "cinder-quobyte-2056f9b9-d9bd-4b7c-8e45-10a92b347288" released by "delete_volume" :: held 0.809s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:38 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-44418651-1e02-4ae5-a387-c95b83ddad59 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Created reservations ['3e2df0aa-8b54-41c2-8a25-c6fc58b52cbc', 'afdee72f-07a6-4ea3-8217-041c700e88cd', 'aacae336-d1f0-48d8-8ce0-8a13c654365b', 'fd20da76-f24b-4732-a547-7b8c7eafee93'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:36:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-44418651-1e02-4ae5-a387-c95b83ddad59 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-44418651-1e02-4ae5-a387-c95b83ddad59 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:38 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-44418651-1e02-4ae5-a387-c95b83ddad59 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:38 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-44418651-1e02-4ae5-a387-c95b83ddad59 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-44418651-1e02-4ae5-a387-c95b83ddad59 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-44418651-1e02-4ae5-a387-c95b83ddad59 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:38 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:36:38 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:38 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-7d89ec9b-317f-4ec0-bbde-7a9cd29f753b tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Acquiring lock "cinder-a91cc8af-6335-40a4-9168-f5ebbd314338-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:38 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-7d89ec9b-317f-4ec0-bbde-7a9cd29f753b tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "cinder-a91cc8af-6335-40a4-9168-f5ebbd314338-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:39 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-7d89ec9b-317f-4ec0-bbde-7a9cd29f753b tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Acquiring lock "cinder-quobyte-a91cc8af-6335-40a4-9168-f5ebbd314338" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:39 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-7d89ec9b-317f-4ec0-bbde-7a9cd29f753b tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "cinder-quobyte-a91cc8af-6335-40a4-9168-f5ebbd314338" acquired by "delete_volume" :: waited 0.026s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:39 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fa00d3-d6bd-4c6a-859c-3637c987d1b4]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:36:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7d89ec9b-317f-4ec0-bbde-7a9cd29f753b tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a91cc8af-6335-40a4-9168-f5ebbd314338 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:39 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-44418651-1e02-4ae5-a387-c95b83ddad59 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.361s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:39 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-44418651-1e02-4ae5-a387-c95b83ddad59 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:36:39 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-44418651-1e02-4ae5-a387-c95b83ddad59 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Deleted volume successfully. Jul 16 23:36:39 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-44418651-1e02-4ae5-a387-c95b83ddad59 tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "cinder-2056f9b9-d9bd-4b7c-8e45-10a92b347288-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:39 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a91cc8af-6335-40a4-9168-f5ebbd314338 Jul 16 23:36:39 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:39 devstack cinder-volume[87607]: DEBUG oslo_service.periodic_task [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:36:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:39 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:36:39 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:39 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-6777c3a3-8005-47d2-8e72-f4c1f9a36255 tempest-ProjectMemberTests-1023405772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:36:39 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6777c3a3-8005-47d2-8e72-f4c1f9a36255 tempest-ProjectMemberTests-1023405772 None] Flow 'volume_create_manager' (b99d6cc0-85df-4563-a561-a3991c2f6cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:36:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6777c3a3-8005-47d2-8e72-f4c1f9a36255 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2378f458-10d5-4e11-862b-ba53264fde5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7d89ec9b-317f-4ec0-bbde-7a9cd29f753b tempest-CreateVolumesFromSourceVolumeTest-593114566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a91cc8af-6335-40a4-9168-f5ebbd314338" returned: 0 in 0.584s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7d89ec9b-317f-4ec0-bbde-7a9cd29f753b tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a91cc8af-6335-40a4-9168-f5ebbd314338 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:39 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a91cc8af-6335-40a4-9168-f5ebbd314338 Jul 16 23:36:39 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6777c3a3-8005-47d2-8e72-f4c1f9a36255 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2378f458-10d5-4e11-862b-ba53264fde5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-372059935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4297868f-204e-44a0-8fc2-38ca075f11fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b14a0052f8fb4344b121d3a20292b053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:36:40Z,use_quota=True,user_id='faa7527cbba84668895a85e3faa36efb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6777c3a3-8005-47d2-8e72-f4c1f9a36255 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26f33ea7-aed1-4266-9aa5-72d01d8fdca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6777c3a3-8005-47d2-8e72-f4c1f9a36255 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26f33ea7-aed1-4266-9aa5-72d01d8fdca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6777c3a3-8005-47d2-8e72-f4c1f9a36255 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42ce92cd-6dc4-425c-ae12-a1de0b34563b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6777c3a3-8005-47d2-8e72-f4c1f9a36255 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42ce92cd-6dc4-425c-ae12-a1de0b34563b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4297868f-204e-44a0-8fc2-38ca075f11fd', 'volume_name': 'volume-4297868f-204e-44a0-8fc2-38ca075f11fd', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6777c3a3-8005-47d2-8e72-f4c1f9a36255 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be77a761-b506-4dd6-b9f3-c2d985da6e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6777c3a3-8005-47d2-8e72-f4c1f9a36255 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be77a761-b506-4dd6-b9f3-c2d985da6e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6777c3a3-8005-47d2-8e72-f4c1f9a36255 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6990cd15-8232-418a-87fa-60c017e8689a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:39 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-6777c3a3-8005-47d2-8e72-f4c1f9a36255 tempest-ProjectMemberTests-1023405772 None] Volume 4297868f-204e-44a0-8fc2-38ca075f11fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4297868f-204e-44a0-8fc2-38ca075f11fd', 'volume_size': 1} Jul 16 23:36:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6777c3a3-8005-47d2-8e72-f4c1f9a36255 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6777c3a3-8005-47d2-8e72-f4c1f9a36255 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-6777c3a3-8005-47d2-8e72-f4c1f9a36255 tempest-ProjectMemberTests-1023405772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-372059935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4297868f-204e-44a0-8fc2-38ca075f11fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b14a0052f8fb4344b121d3a20292b053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:36:40Z,use_quota=True,user_id='faa7527cbba84668895a85e3faa36efb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:36:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-6777c3a3-8005-47d2-8e72-f4c1f9a36255 tempest-ProjectMemberTests-1023405772 None] Creating volume 4297868f-204e-44a0-8fc2-38ca075f11fd {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:36:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6777c3a3-8005-47d2-8e72-f4c1f9a36255 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6777c3a3-8005-47d2-8e72-f4c1f9a36255 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-6777c3a3-8005-47d2-8e72-f4c1f9a36255 tempest-ProjectMemberTests-1023405772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-6777c3a3-8005-47d2-8e72-f4c1f9a36255 tempest-ProjectMemberTests-1023405772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6777c3a3-8005-47d2-8e72-f4c1f9a36255 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-6777c3a3-8005-47d2-8e72-f4c1f9a36255 tempest-ProjectMemberTests-1023405772 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:36:39 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-6777c3a3-8005-47d2-8e72-f4c1f9a36255 tempest-ProjectMemberTests-1023405772 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:36:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6777c3a3-8005-47d2-8e72-f4c1f9a36255 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:39 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.356s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:39 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:36:39 devstack cinder-volume[87607]: DEBUG oslo_service.periodic_task [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running periodic task VolumeManager._thread_info {{(pid=87607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:36:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] thread count: 28 {{(pid=87607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 23:36:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] thread info: [<_MainThread(MainThread, started 139090403627136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 23:36:39 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd 1073741824 Jul 16 23:36:39 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:39 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7d89ec9b-317f-4ec0-bbde-7a9cd29f753b tempest-CreateVolumesFromSourceVolumeTest-593114566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-a91cc8af-6335-40a4-9168-f5ebbd314338" returned: 0 in 0.333s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:40 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-7d89ec9b-317f-4ec0-bbde-7a9cd29f753b tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "cinder-quobyte-a91cc8af-6335-40a4-9168-f5ebbd314338" released by "delete_volume" :: held 0.991s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:40 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-7d89ec9b-317f-4ec0-bbde-7a9cd29f753b tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Created reservations ['59cb67a0-5f08-4a07-be52-24cbec13a09c', '5e61a0e3-faf9-4955-ad20-f4ed0e37a4ec', '50858eaf-0935-46fa-9659-d19557c152eb', '314b417c-3da7-487d-b658-c29d46ef098d'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:36:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7d89ec9b-317f-4ec0-bbde-7a9cd29f753b tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7d89ec9b-317f-4ec0-bbde-7a9cd29f753b tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:40 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-7d89ec9b-317f-4ec0-bbde-7a9cd29f753b tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:40 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-7d89ec9b-317f-4ec0-bbde-7a9cd29f753b tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7d89ec9b-317f-4ec0-bbde-7a9cd29f753b tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7d89ec9b-317f-4ec0-bbde-7a9cd29f753b tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:40 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:36:40 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:40 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6777c3a3-8005-47d2-8e72-f4c1f9a36255 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd 1073741824" returned: 0 in 0.703s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:40 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6777c3a3-8005-47d2-8e72-f4c1f9a36255 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7d89ec9b-317f-4ec0-bbde-7a9cd29f753b tempest-CreateVolumesFromSourceVolumeTest-593114566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.333s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:40 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-7d89ec9b-317f-4ec0-bbde-7a9cd29f753b tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:36:40 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-7d89ec9b-317f-4ec0-bbde-7a9cd29f753b tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Deleted volume successfully. Jul 16 23:36:40 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd Jul 16 23:36:40 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:40 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-7d89ec9b-317f-4ec0-bbde-7a9cd29f753b tempest-CreateVolumesFromSourceVolumeTest-593114566 None] Lock "cinder-a91cc8af-6335-40a4-9168-f5ebbd314338-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:40 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6777c3a3-8005-47d2-8e72-f4c1f9a36255 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd" returned: 0 in 0.308s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:40 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-6777c3a3-8005-47d2-8e72-f4c1f9a36255 tempest-ProjectMemberTests-1023405772 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:36:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6777c3a3-8005-47d2-8e72-f4c1f9a36255 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6777c3a3-8005-47d2-8e72-f4c1f9a36255 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6990cd15-8232-418a-87fa-60c017e8689a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4297868f-204e-44a0-8fc2-38ca075f11fd', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6777c3a3-8005-47d2-8e72-f4c1f9a36255 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (856b7976-e775-4f25-b2a3-6aa7b70570fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:40 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-6777c3a3-8005-47d2-8e72-f4c1f9a36255 tempest-ProjectMemberTests-1023405772 None] Volume volume-4297868f-204e-44a0-8fc2-38ca075f11fd (4297868f-204e-44a0-8fc2-38ca075f11fd): created successfully Jul 16 23:36:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6777c3a3-8005-47d2-8e72-f4c1f9a36255 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (856b7976-e775-4f25-b2a3-6aa7b70570fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:40 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6777c3a3-8005-47d2-8e72-f4c1f9a36255 tempest-ProjectMemberTests-1023405772 None] Flow 'volume_create_manager' (b99d6cc0-85df-4563-a561-a3991c2f6cfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:36:40 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-6777c3a3-8005-47d2-8e72-f4c1f9a36255 tempest-ProjectMemberTests-1023405772 None] Created volume successfully. Jul 16 23:36:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-8c56157e-8cd8-409d-af7a-f86e70fe26e3 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-8c56157e-8cd8-409d-af7a-f86e70fe26e3 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:41 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-8c56157e-8cd8-409d-af7a-f86e70fe26e3 tempest-ProjectMemberTests-1023405772 None] Creating offline snapshot 93131f9c-6fee-44d0-9525-94a532a44e1e of volume 4297868f-204e-44a0-8fc2-38ca075f11fd {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:36:41 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[05605fa8-11f3-4972-af26-ab0aca729479]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:36:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8c56157e-8cd8-409d-af7a-f86e70fe26e3 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:42 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd Jul 16 23:36:42 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:42 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8c56157e-8cd8-409d-af7a-f86e70fe26e3 tempest-ProjectMemberTests-1023405772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd" returned: 0 in 0.497s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8c56157e-8cd8-409d-af7a-f86e70fe26e3 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd.93131f9c-6fee-44d0-9525-94a532a44e1e 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:42 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd.93131f9c-6fee-44d0-9525-94a532a44e1e 1G Jul 16 23:36:42 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:42 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8c56157e-8cd8-409d-af7a-f86e70fe26e3 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd.93131f9c-6fee-44d0-9525-94a532a44e1e 1G" returned: 0 in 0.477s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8c56157e-8cd8-409d-af7a-f86e70fe26e3 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4297868f-204e-44a0-8fc2-38ca075f11fd -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd.93131f9c-6fee-44d0-9525-94a532a44e1e {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:42 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4297868f-204e-44a0-8fc2-38ca075f11fd -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd.93131f9c-6fee-44d0-9525-94a532a44e1e Jul 16 23:36:42 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:43 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8c56157e-8cd8-409d-af7a-f86e70fe26e3 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4297868f-204e-44a0-8fc2-38ca075f11fd -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd.93131f9c-6fee-44d0-9525-94a532a44e1e" returned: 0 in 0.342s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:43 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-8c56157e-8cd8-409d-af7a-f86e70fe26e3 tempest-ProjectMemberTests-1023405772 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd.93131f9c-6fee-44d0-9525-94a532a44e1e is being set with open permissions: ugo+rw Jul 16 23:36:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8c56157e-8cd8-409d-af7a-f86e70fe26e3 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd.93131f9c-6fee-44d0-9525-94a532a44e1e {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:43 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd.93131f9c-6fee-44d0-9525-94a532a44e1e Jul 16 23:36:43 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:43 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8c56157e-8cd8-409d-af7a-f86e70fe26e3 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd.93131f9c-6fee-44d0-9525-94a532a44e1e" returned: 0 in 0.285s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8c56157e-8cd8-409d-af7a-f86e70fe26e3 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:43 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd.info Jul 16 23:36:43 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:43 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8c56157e-8cd8-409d-af7a-f86e70fe26e3 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd.info" returned: 0 in 0.303s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:43 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-8c56157e-8cd8-409d-af7a-f86e70fe26e3 tempest-ProjectMemberTests-1023405772 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd.info is being set with open permissions: ugo+rw Jul 16 23:36:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8c56157e-8cd8-409d-af7a-f86e70fe26e3 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:43 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd.info Jul 16 23:36:43 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:44 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8c56157e-8cd8-409d-af7a-f86e70fe26e3 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd.info" returned: 0 in 0.282s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-8c56157e-8cd8-409d-af7a-f86e70fe26e3 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.326s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:44 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-8c56157e-8cd8-409d-af7a-f86e70fe26e3 tempest-ProjectMemberTests-1023405772 None] Create snapshot completed successfully Jul 16 23:36:45 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b0081dcd-0173-4402-aaba-9e84007400a4 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-93131f9c-6fee-44d0-9525-94a532a44e1e-delete_snapshot" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:45 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b0081dcd-0173-4402-aaba-9e84007400a4 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-93131f9c-6fee-44d0-9525-94a532a44e1e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:45 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b0081dcd-0173-4402-aaba-9e84007400a4 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-quobyte-4297868f-204e-44a0-8fc2-38ca075f11fd" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:45 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b0081dcd-0173-4402-aaba-9e84007400a4 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-4297868f-204e-44a0-8fc2-38ca075f11fd" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:45 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b0081dcd-0173-4402-aaba-9e84007400a4 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-quobyte-93131f9c-6fee-44d0-9525-94a532a44e1e" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:45 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b0081dcd-0173-4402-aaba-9e84007400a4 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-93131f9c-6fee-44d0-9525-94a532a44e1e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:45 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-b0081dcd-0173-4402-aaba-9e84007400a4 tempest-ProjectMemberTests-1023405772 None] Deleting offline snapshot 93131f9c-6fee-44d0-9525-94a532a44e1e of volume 4297868f-204e-44a0-8fc2-38ca075f11fd {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:36:45 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-b0081dcd-0173-4402-aaba-9e84007400a4 tempest-ProjectMemberTests-1023405772 None] snapshot_file for this snap is: volume-4297868f-204e-44a0-8fc2-38ca075f11fd.93131f9c-6fee-44d0-9525-94a532a44e1e {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:36:45 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc99fe8-d91a-44eb-9a58-0c48665edcd3]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:36:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b0081dcd-0173-4402-aaba-9e84007400a4 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd.93131f9c-6fee-44d0-9525-94a532a44e1e {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:45 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd.93131f9c-6fee-44d0-9525-94a532a44e1e Jul 16 23:36:45 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:45 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b0081dcd-0173-4402-aaba-9e84007400a4 tempest-ProjectMemberTests-1023405772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd.93131f9c-6fee-44d0-9525-94a532a44e1e" returned: 0 in 0.413s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:45 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-b0081dcd-0173-4402-aaba-9e84007400a4 tempest-ProjectMemberTests-1023405772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4297868f-204e-44a0-8fc2-38ca075f11fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:36:45 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3bcec9-ccfa-4f9c-ba81-5be534873232]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:36:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b0081dcd-0173-4402-aaba-9e84007400a4 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:45 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd Jul 16 23:36:45 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:46 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b0081dcd-0173-4402-aaba-9e84007400a4 tempest-ProjectMemberTests-1023405772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd" returned: 0 in 0.431s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b0081dcd-0173-4402-aaba-9e84007400a4 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd.93131f9c-6fee-44d0-9525-94a532a44e1e {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:46 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd.93131f9c-6fee-44d0-9525-94a532a44e1e Jul 16 23:36:46 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:46 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b0081dcd-0173-4402-aaba-9e84007400a4 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd.93131f9c-6fee-44d0-9525-94a532a44e1e" returned: 0 in 0.428s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b0081dcd-0173-4402-aaba-9e84007400a4 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd.93131f9c-6fee-44d0-9525-94a532a44e1e {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:46 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd.93131f9c-6fee-44d0-9525-94a532a44e1e Jul 16 23:36:46 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:46 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b0081dcd-0173-4402-aaba-9e84007400a4 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd.93131f9c-6fee-44d0-9525-94a532a44e1e" returned: 0 in 0.317s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:46 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b0081dcd-0173-4402-aaba-9e84007400a4 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-93131f9c-6fee-44d0-9525-94a532a44e1e" released by "_delete_snapshot" :: held 1.716s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:46 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b0081dcd-0173-4402-aaba-9e84007400a4 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-4297868f-204e-44a0-8fc2-38ca075f11fd" released by "delete_snapshot" :: held 1.747s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:46 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-b0081dcd-0173-4402-aaba-9e84007400a4 tempest-ProjectMemberTests-1023405772 None] Created reservations ['2bf1c95d-2f5f-4753-bac4-c02722542e52', '31228888-2ada-4605-8d72-91ef280ed910', 'c4f8c045-c565-4320-8b3d-84d017569a56', '57c33fef-cdc9-41db-b6f2-5e03533e80e1'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:36:47 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-b0081dcd-0173-4402-aaba-9e84007400a4 tempest-ProjectMemberTests-1023405772 None] Delete snapshot completed successfully. Jul 16 23:36:47 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b0081dcd-0173-4402-aaba-9e84007400a4 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-93131f9c-6fee-44d0-9525-94a532a44e1e-delete_snapshot" released by "delete_snapshot" :: held 1.962s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:47 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b05e9a81-70d3-4c63-b8eb-da79632ca84e tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-4297868f-204e-44a0-8fc2-38ca075f11fd-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:47 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b05e9a81-70d3-4c63-b8eb-da79632ca84e tempest-ProjectMemberTests-1023405772 None] Lock "cinder-4297868f-204e-44a0-8fc2-38ca075f11fd-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:47 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b05e9a81-70d3-4c63-b8eb-da79632ca84e tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-quobyte-4297868f-204e-44a0-8fc2-38ca075f11fd" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:47 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b05e9a81-70d3-4c63-b8eb-da79632ca84e tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-4297868f-204e-44a0-8fc2-38ca075f11fd" acquired by "delete_volume" :: waited 0.023s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:47 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4d353b-1ba9-47e2-a2f2-fabd723f6147]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:36:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b05e9a81-70d3-4c63-b8eb-da79632ca84e tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:47 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd Jul 16 23:36:47 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:47 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b05e9a81-70d3-4c63-b8eb-da79632ca84e tempest-ProjectMemberTests-1023405772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd" returned: 0 in 0.433s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b05e9a81-70d3-4c63-b8eb-da79632ca84e tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:47 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd Jul 16 23:36:47 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:48 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b05e9a81-70d3-4c63-b8eb-da79632ca84e tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-4297868f-204e-44a0-8fc2-38ca075f11fd" returned: 0 in 0.313s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:48 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b05e9a81-70d3-4c63-b8eb-da79632ca84e tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-4297868f-204e-44a0-8fc2-38ca075f11fd" released by "delete_volume" :: held 0.828s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:48 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-b05e9a81-70d3-4c63-b8eb-da79632ca84e tempest-ProjectMemberTests-1023405772 None] Created reservations ['3108a4a8-00ea-4488-87a7-2ab4c1dbf46d', '02c40eeb-b1ad-4117-b8d3-ffad00998489', '1b79339d-41ef-441d-8894-cf7782493e44', 'd61e9d4a-a796-488c-9266-0828f4a81e86'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:36:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b05e9a81-70d3-4c63-b8eb-da79632ca84e tempest-ProjectMemberTests-1023405772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b05e9a81-70d3-4c63-b8eb-da79632ca84e tempest-ProjectMemberTests-1023405772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:48 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-b05e9a81-70d3-4c63-b8eb-da79632ca84e tempest-ProjectMemberTests-1023405772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:48 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-b05e9a81-70d3-4c63-b8eb-da79632ca84e tempest-ProjectMemberTests-1023405772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b05e9a81-70d3-4c63-b8eb-da79632ca84e tempest-ProjectMemberTests-1023405772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b05e9a81-70d3-4c63-b8eb-da79632ca84e tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:48 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:36:48 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:48 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b05e9a81-70d3-4c63-b8eb-da79632ca84e tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.281s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:48 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-b05e9a81-70d3-4c63-b8eb-da79632ca84e tempest-ProjectMemberTests-1023405772 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:36:48 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-b05e9a81-70d3-4c63-b8eb-da79632ca84e tempest-ProjectMemberTests-1023405772 None] Deleted volume successfully. Jul 16 23:36:48 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b05e9a81-70d3-4c63-b8eb-da79632ca84e tempest-ProjectMemberTests-1023405772 None] Lock "cinder-4297868f-204e-44a0-8fc2-38ca075f11fd-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:49 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-82e0c99d-488d-4180-8b84-4b3f52353b51 tempest-ProjectMemberTests-1023405772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:36:49 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-82e0c99d-488d-4180-8b84-4b3f52353b51 tempest-ProjectMemberTests-1023405772 None] Flow 'volume_create_manager' (3f71dd02-71f8-4c06-9b23-ef6ffed6e5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:36:49 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-82e0c99d-488d-4180-8b84-4b3f52353b51 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (007c0e34-bcc0-4017-b746-7c237cf9f27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:49 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-82e0c99d-488d-4180-8b84-4b3f52353b51 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (007c0e34-bcc0-4017-b746-7c237cf9f27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1159390066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9ef2382-a49e-4512-9e04-7390c9d9fbe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b14a0052f8fb4344b121d3a20292b053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:36:49Z,use_quota=True,user_id='faa7527cbba84668895a85e3faa36efb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:49 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-82e0c99d-488d-4180-8b84-4b3f52353b51 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bb4dd32-5ce3-49ee-91a4-f9cf6ae61eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:49 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-82e0c99d-488d-4180-8b84-4b3f52353b51 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bb4dd32-5ce3-49ee-91a4-f9cf6ae61eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:49 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-82e0c99d-488d-4180-8b84-4b3f52353b51 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a23b1c9-90da-4bd3-8595-e7f6e0864d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:49 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-82e0c99d-488d-4180-8b84-4b3f52353b51 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a23b1c9-90da-4bd3-8595-e7f6e0864d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9ef2382-a49e-4512-9e04-7390c9d9fbe4', 'volume_name': 'volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:49 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-82e0c99d-488d-4180-8b84-4b3f52353b51 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c46b97f2-5ecb-45ce-baa3-6fbfe7546883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:49 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-82e0c99d-488d-4180-8b84-4b3f52353b51 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c46b97f2-5ecb-45ce-baa3-6fbfe7546883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:49 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-82e0c99d-488d-4180-8b84-4b3f52353b51 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e11beae3-fa74-41fe-bded-8b538518ca7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:49 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-82e0c99d-488d-4180-8b84-4b3f52353b51 tempest-ProjectMemberTests-1023405772 None] Volume d9ef2382-a49e-4512-9e04-7390c9d9fbe4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4', 'volume_size': 1} Jul 16 23:36:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-82e0c99d-488d-4180-8b84-4b3f52353b51 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-82e0c99d-488d-4180-8b84-4b3f52353b51 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:49 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-82e0c99d-488d-4180-8b84-4b3f52353b51 tempest-ProjectMemberTests-1023405772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1159390066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9ef2382-a49e-4512-9e04-7390c9d9fbe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b14a0052f8fb4344b121d3a20292b053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:36:49Z,use_quota=True,user_id='faa7527cbba84668895a85e3faa36efb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:36:49 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-82e0c99d-488d-4180-8b84-4b3f52353b51 tempest-ProjectMemberTests-1023405772 None] Creating volume d9ef2382-a49e-4512-9e04-7390c9d9fbe4 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:36:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-82e0c99d-488d-4180-8b84-4b3f52353b51 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-82e0c99d-488d-4180-8b84-4b3f52353b51 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:49 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-82e0c99d-488d-4180-8b84-4b3f52353b51 tempest-ProjectMemberTests-1023405772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:49 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-82e0c99d-488d-4180-8b84-4b3f52353b51 tempest-ProjectMemberTests-1023405772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-82e0c99d-488d-4180-8b84-4b3f52353b51 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:49 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-82e0c99d-488d-4180-8b84-4b3f52353b51 tempest-ProjectMemberTests-1023405772 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:36:49 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-82e0c99d-488d-4180-8b84-4b3f52353b51 tempest-ProjectMemberTests-1023405772 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:36:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-82e0c99d-488d-4180-8b84-4b3f52353b51 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:49 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4 1073741824 Jul 16 23:36:49 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:49 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-82e0c99d-488d-4180-8b84-4b3f52353b51 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4 1073741824" returned: 0 in 0.589s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-82e0c99d-488d-4180-8b84-4b3f52353b51 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:49 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4 Jul 16 23:36:49 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:50 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-82e0c99d-488d-4180-8b84-4b3f52353b51 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4" returned: 0 in 0.303s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:50 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-82e0c99d-488d-4180-8b84-4b3f52353b51 tempest-ProjectMemberTests-1023405772 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:36:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-82e0c99d-488d-4180-8b84-4b3f52353b51 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:50 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-82e0c99d-488d-4180-8b84-4b3f52353b51 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e11beae3-fa74-41fe-bded-8b538518ca7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:50 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-82e0c99d-488d-4180-8b84-4b3f52353b51 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65943d83-33f7-4e53-9a14-7df356114293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:50 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-82e0c99d-488d-4180-8b84-4b3f52353b51 tempest-ProjectMemberTests-1023405772 None] Volume volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4 (d9ef2382-a49e-4512-9e04-7390c9d9fbe4): created successfully Jul 16 23:36:50 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-82e0c99d-488d-4180-8b84-4b3f52353b51 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65943d83-33f7-4e53-9a14-7df356114293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:50 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-82e0c99d-488d-4180-8b84-4b3f52353b51 tempest-ProjectMemberTests-1023405772 None] Flow 'volume_create_manager' (3f71dd02-71f8-4c06-9b23-ef6ffed6e5a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:36:50 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-82e0c99d-488d-4180-8b84-4b3f52353b51 tempest-ProjectMemberTests-1023405772 None] Created volume successfully. Jul 16 23:36:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-30a2bf9e-a8c0-4b45-afac-638bc174b0ab tempest-ProjectMemberTests-1023405772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-30a2bf9e-a8c0-4b45-afac-638bc174b0ab tempest-ProjectMemberTests-1023405772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:51 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-30a2bf9e-a8c0-4b45-afac-638bc174b0ab tempest-ProjectMemberTests-1023405772 None] Creating offline snapshot ac958e42-649e-48aa-a243-71e0f7196d70 of volume d9ef2382-a49e-4512-9e04-7390c9d9fbe4 {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:36:51 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[accfd99d-88f6-4d02-8c61-d13efc11c464]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:36:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-30a2bf9e-a8c0-4b45-afac-638bc174b0ab tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:51 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4 Jul 16 23:36:51 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:51 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-30a2bf9e-a8c0-4b45-afac-638bc174b0ab tempest-ProjectMemberTests-1023405772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4" returned: 0 in 0.419s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-30a2bf9e-a8c0-4b45-afac-638bc174b0ab tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4.ac958e42-649e-48aa-a243-71e0f7196d70 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:51 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4.ac958e42-649e-48aa-a243-71e0f7196d70 1G Jul 16 23:36:51 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:52 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-30a2bf9e-a8c0-4b45-afac-638bc174b0ab tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4.ac958e42-649e-48aa-a243-71e0f7196d70 1G" returned: 0 in 0.527s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-30a2bf9e-a8c0-4b45-afac-638bc174b0ab tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4.ac958e42-649e-48aa-a243-71e0f7196d70 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:52 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4.ac958e42-649e-48aa-a243-71e0f7196d70 Jul 16 23:36:52 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:52 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-30a2bf9e-a8c0-4b45-afac-638bc174b0ab tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4.ac958e42-649e-48aa-a243-71e0f7196d70" returned: 0 in 0.363s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:52 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-30a2bf9e-a8c0-4b45-afac-638bc174b0ab tempest-ProjectMemberTests-1023405772 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4.ac958e42-649e-48aa-a243-71e0f7196d70 is being set with open permissions: ugo+rw Jul 16 23:36:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-30a2bf9e-a8c0-4b45-afac-638bc174b0ab tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4.ac958e42-649e-48aa-a243-71e0f7196d70 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:52 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4.ac958e42-649e-48aa-a243-71e0f7196d70 Jul 16 23:36:52 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:53 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-30a2bf9e-a8c0-4b45-afac-638bc174b0ab tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4.ac958e42-649e-48aa-a243-71e0f7196d70" returned: 0 in 0.325s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-30a2bf9e-a8c0-4b45-afac-638bc174b0ab tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:53 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4.info Jul 16 23:36:53 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:53 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-30a2bf9e-a8c0-4b45-afac-638bc174b0ab tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4.info" returned: 0 in 0.283s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:53 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-30a2bf9e-a8c0-4b45-afac-638bc174b0ab tempest-ProjectMemberTests-1023405772 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4.info is being set with open permissions: ugo+rw Jul 16 23:36:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-30a2bf9e-a8c0-4b45-afac-638bc174b0ab tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:53 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4.info Jul 16 23:36:53 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:53 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-30a2bf9e-a8c0-4b45-afac-638bc174b0ab tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4.info" returned: 0 in 0.251s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-30a2bf9e-a8c0-4b45-afac-638bc174b0ab tempest-ProjectMemberTests-1023405772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.272s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:53 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-30a2bf9e-a8c0-4b45-afac-638bc174b0ab tempest-ProjectMemberTests-1023405772 None] Create snapshot completed successfully Jul 16 23:36:54 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c765b007-7eb0-4882-8c4a-30a79ef56538 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-ac958e42-649e-48aa-a243-71e0f7196d70-delete_snapshot" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:54 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c765b007-7eb0-4882-8c4a-30a79ef56538 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-ac958e42-649e-48aa-a243-71e0f7196d70-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:54 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c765b007-7eb0-4882-8c4a-30a79ef56538 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-quobyte-d9ef2382-a49e-4512-9e04-7390c9d9fbe4" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:54 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c765b007-7eb0-4882-8c4a-30a79ef56538 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-d9ef2382-a49e-4512-9e04-7390c9d9fbe4" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:54 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c765b007-7eb0-4882-8c4a-30a79ef56538 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-quobyte-ac958e42-649e-48aa-a243-71e0f7196d70" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:54 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c765b007-7eb0-4882-8c4a-30a79ef56538 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-ac958e42-649e-48aa-a243-71e0f7196d70" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:54 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-c765b007-7eb0-4882-8c4a-30a79ef56538 tempest-ProjectMemberTests-1023405772 None] Deleting offline snapshot ac958e42-649e-48aa-a243-71e0f7196d70 of volume d9ef2382-a49e-4512-9e04-7390c9d9fbe4 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:36:54 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-c765b007-7eb0-4882-8c4a-30a79ef56538 tempest-ProjectMemberTests-1023405772 None] snapshot_file for this snap is: volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4.ac958e42-649e-48aa-a243-71e0f7196d70 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:36:54 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b55642e-45f2-4ecd-8839-3e7a2db9f9b6]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:36:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c765b007-7eb0-4882-8c4a-30a79ef56538 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4.ac958e42-649e-48aa-a243-71e0f7196d70 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:54 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4.ac958e42-649e-48aa-a243-71e0f7196d70 Jul 16 23:36:54 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:55 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c765b007-7eb0-4882-8c4a-30a79ef56538 tempest-ProjectMemberTests-1023405772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4.ac958e42-649e-48aa-a243-71e0f7196d70" returned: 0 in 0.441s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:55 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-c765b007-7eb0-4882-8c4a-30a79ef56538 tempest-ProjectMemberTests-1023405772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:36:55 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[98231fb0-824f-49da-b0ce-6df1a8012ee7]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:36:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c765b007-7eb0-4882-8c4a-30a79ef56538 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:55 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4 Jul 16 23:36:55 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:55 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c765b007-7eb0-4882-8c4a-30a79ef56538 tempest-ProjectMemberTests-1023405772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4" returned: 0 in 0.381s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c765b007-7eb0-4882-8c4a-30a79ef56538 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4.ac958e42-649e-48aa-a243-71e0f7196d70 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:55 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4.ac958e42-649e-48aa-a243-71e0f7196d70 Jul 16 23:36:55 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:55 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c765b007-7eb0-4882-8c4a-30a79ef56538 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4.ac958e42-649e-48aa-a243-71e0f7196d70" returned: 0 in 0.394s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c765b007-7eb0-4882-8c4a-30a79ef56538 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4.ac958e42-649e-48aa-a243-71e0f7196d70 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:55 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4.ac958e42-649e-48aa-a243-71e0f7196d70 Jul 16 23:36:55 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:56 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c765b007-7eb0-4882-8c4a-30a79ef56538 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4.ac958e42-649e-48aa-a243-71e0f7196d70" returned: 0 in 0.295s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:56 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c765b007-7eb0-4882-8c4a-30a79ef56538 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-ac958e42-649e-48aa-a243-71e0f7196d70" released by "_delete_snapshot" :: held 1.630s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:56 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c765b007-7eb0-4882-8c4a-30a79ef56538 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-d9ef2382-a49e-4512-9e04-7390c9d9fbe4" released by "delete_snapshot" :: held 1.658s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:56 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-c765b007-7eb0-4882-8c4a-30a79ef56538 tempest-ProjectMemberTests-1023405772 None] Created reservations ['1532e1cb-3502-4d33-98ae-6549eb0bed9e', 'dc5818fb-5a08-437b-b009-a3aa19c3d792', 'cb161026-df6a-4ec9-b98d-de548201d493', '484a78a2-16e9-4a59-9600-c7ae921680a5'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:36:56 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-c765b007-7eb0-4882-8c4a-30a79ef56538 tempest-ProjectMemberTests-1023405772 None] Delete snapshot completed successfully. Jul 16 23:36:56 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c765b007-7eb0-4882-8c4a-30a79ef56538 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-ac958e42-649e-48aa-a243-71e0f7196d70-delete_snapshot" released by "delete_snapshot" :: held 1.814s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:56 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ce5d006f-a4a2-46cd-a2d4-08a737026f58 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-d9ef2382-a49e-4512-9e04-7390c9d9fbe4-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:56 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ce5d006f-a4a2-46cd-a2d4-08a737026f58 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-d9ef2382-a49e-4512-9e04-7390c9d9fbe4-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:56 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ce5d006f-a4a2-46cd-a2d4-08a737026f58 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-quobyte-d9ef2382-a49e-4512-9e04-7390c9d9fbe4" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:36:56 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ce5d006f-a4a2-46cd-a2d4-08a737026f58 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-d9ef2382-a49e-4512-9e04-7390c9d9fbe4" acquired by "delete_volume" :: waited 0.040s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:36:57 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba78150-949e-4292-ad80-ecd6c64d8b28]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:36:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ce5d006f-a4a2-46cd-a2d4-08a737026f58 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:57 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4 Jul 16 23:36:57 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:57 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ce5d006f-a4a2-46cd-a2d4-08a737026f58 tempest-ProjectMemberTests-1023405772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4" returned: 0 in 0.467s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ce5d006f-a4a2-46cd-a2d4-08a737026f58 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:57 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4 Jul 16 23:36:57 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:57 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ce5d006f-a4a2-46cd-a2d4-08a737026f58 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d9ef2382-a49e-4512-9e04-7390c9d9fbe4" returned: 0 in 0.304s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:57 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ce5d006f-a4a2-46cd-a2d4-08a737026f58 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-d9ef2382-a49e-4512-9e04-7390c9d9fbe4" released by "delete_volume" :: held 0.892s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:57 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-ce5d006f-a4a2-46cd-a2d4-08a737026f58 tempest-ProjectMemberTests-1023405772 None] Created reservations ['fe4dd809-80da-4382-ae1c-f48144ad4c99', '3b1a0521-966b-462c-8cba-ad69ec8d4f95', '254538f0-f91d-4970-b20b-d3973bd85fd3', '6067da44-c372-4f91-9d00-6d2d47c7f9c4'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:36:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ce5d006f-a4a2-46cd-a2d4-08a737026f58 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ce5d006f-a4a2-46cd-a2d4-08a737026f58 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:58 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ce5d006f-a4a2-46cd-a2d4-08a737026f58 tempest-ProjectMemberTests-1023405772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:58 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ce5d006f-a4a2-46cd-a2d4-08a737026f58 tempest-ProjectMemberTests-1023405772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ce5d006f-a4a2-46cd-a2d4-08a737026f58 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ce5d006f-a4a2-46cd-a2d4-08a737026f58 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:58 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:36:58 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:58 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ce5d006f-a4a2-46cd-a2d4-08a737026f58 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.367s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:58 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-ce5d006f-a4a2-46cd-a2d4-08a737026f58 tempest-ProjectMemberTests-1023405772 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:36:58 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-ce5d006f-a4a2-46cd-a2d4-08a737026f58 tempest-ProjectMemberTests-1023405772 None] Deleted volume successfully. Jul 16 23:36:58 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ce5d006f-a4a2-46cd-a2d4-08a737026f58 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-d9ef2382-a49e-4512-9e04-7390c9d9fbe4-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:36:58 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8476ce9-100b-4c5a-a88a-7f3d91340d86 tempest-ProjectMemberTests-1023405772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:36:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a8476ce9-100b-4c5a-a88a-7f3d91340d86 tempest-ProjectMemberTests-1023405772 None] Flow 'volume_create_manager' (e3f25432-683f-4f77-ac43-724761f4dee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:36:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a8476ce9-100b-4c5a-a88a-7f3d91340d86 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb2ea9b0-866a-43dc-9649-710186ead521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a8476ce9-100b-4c5a-a88a-7f3d91340d86 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb2ea9b0-866a-43dc-9649-710186ead521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1662741989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5c26d9a-d386-468a-a5d9-62b7b8230d33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b14a0052f8fb4344b121d3a20292b053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:36:59Z,use_quota=True,user_id='faa7527cbba84668895a85e3faa36efb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a8476ce9-100b-4c5a-a88a-7f3d91340d86 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35d61b69-ae72-4d15-9e72-69d6498a7f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a8476ce9-100b-4c5a-a88a-7f3d91340d86 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35d61b69-ae72-4d15-9e72-69d6498a7f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a8476ce9-100b-4c5a-a88a-7f3d91340d86 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (988e0723-a363-45ef-9c0c-aa66615a34e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a8476ce9-100b-4c5a-a88a-7f3d91340d86 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (988e0723-a363-45ef-9c0c-aa66615a34e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5c26d9a-d386-468a-a5d9-62b7b8230d33', 'volume_name': 'volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a8476ce9-100b-4c5a-a88a-7f3d91340d86 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e580d20d-a59e-460d-bf49-014f5fe02c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a8476ce9-100b-4c5a-a88a-7f3d91340d86 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e580d20d-a59e-460d-bf49-014f5fe02c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:58 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a8476ce9-100b-4c5a-a88a-7f3d91340d86 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a4912a5-87bd-4fd9-85f6-585d322798db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:58 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-a8476ce9-100b-4c5a-a88a-7f3d91340d86 tempest-ProjectMemberTests-1023405772 None] Volume d5c26d9a-d386-468a-a5d9-62b7b8230d33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33', 'volume_size': 1} Jul 16 23:36:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a8476ce9-100b-4c5a-a88a-7f3d91340d86 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a8476ce9-100b-4c5a-a88a-7f3d91340d86 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:58 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a8476ce9-100b-4c5a-a88a-7f3d91340d86 tempest-ProjectMemberTests-1023405772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1662741989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5c26d9a-d386-468a-a5d9-62b7b8230d33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b14a0052f8fb4344b121d3a20292b053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:36:59Z,use_quota=True,user_id='faa7527cbba84668895a85e3faa36efb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:36:58 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-a8476ce9-100b-4c5a-a88a-7f3d91340d86 tempest-ProjectMemberTests-1023405772 None] Creating volume d5c26d9a-d386-468a-a5d9-62b7b8230d33 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:36:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a8476ce9-100b-4c5a-a88a-7f3d91340d86 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:36:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a8476ce9-100b-4c5a-a88a-7f3d91340d86 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:36:58 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a8476ce9-100b-4c5a-a88a-7f3d91340d86 tempest-ProjectMemberTests-1023405772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:36:58 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a8476ce9-100b-4c5a-a88a-7f3d91340d86 tempest-ProjectMemberTests-1023405772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:36:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a8476ce9-100b-4c5a-a88a-7f3d91340d86 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:58 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a8476ce9-100b-4c5a-a88a-7f3d91340d86 tempest-ProjectMemberTests-1023405772 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:36:58 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-a8476ce9-100b-4c5a-a88a-7f3d91340d86 tempest-ProjectMemberTests-1023405772 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:36:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a8476ce9-100b-4c5a-a88a-7f3d91340d86 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:58 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33 1073741824 Jul 16 23:36:58 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:59 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a8476ce9-100b-4c5a-a88a-7f3d91340d86 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33 1073741824" returned: 0 in 0.576s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a8476ce9-100b-4c5a-a88a-7f3d91340d86 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:36:59 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33 Jul 16 23:36:59 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:36:59 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Jul 16 23:36:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a8476ce9-100b-4c5a-a88a-7f3d91340d86 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33" returned: 0 in 0.354s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:36:59 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a8476ce9-100b-4c5a-a88a-7f3d91340d86 tempest-ProjectMemberTests-1023405772 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:36:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a8476ce9-100b-4c5a-a88a-7f3d91340d86 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:36:59 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a8476ce9-100b-4c5a-a88a-7f3d91340d86 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a4912a5-87bd-4fd9-85f6-585d322798db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:59 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a8476ce9-100b-4c5a-a88a-7f3d91340d86 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (802df4e6-ad06-4b97-981a-9c1dc66a8f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:36:59 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-a8476ce9-100b-4c5a-a88a-7f3d91340d86 tempest-ProjectMemberTests-1023405772 None] Volume volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33 (d5c26d9a-d386-468a-a5d9-62b7b8230d33): created successfully Jul 16 23:36:59 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a8476ce9-100b-4c5a-a88a-7f3d91340d86 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (802df4e6-ad06-4b97-981a-9c1dc66a8f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:36:59 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a8476ce9-100b-4c5a-a88a-7f3d91340d86 tempest-ProjectMemberTests-1023405772 None] Flow 'volume_create_manager' (e3f25432-683f-4f77-ac43-724761f4dee2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:36:59 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-a8476ce9-100b-4c5a-a88a-7f3d91340d86 tempest-ProjectMemberTests-1023405772 None] Created volume successfully. Jul 16 23:37:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-cc2fede5-1984-48d1-a95d-6ad472a1c20d tempest-ProjectMemberTests-1023405772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:37:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-cc2fede5-1984-48d1-a95d-6ad472a1c20d tempest-ProjectMemberTests-1023405772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:37:01 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-cc2fede5-1984-48d1-a95d-6ad472a1c20d tempest-ProjectMemberTests-1023405772 None] Creating offline snapshot e1ecc9a3-c9fb-42fe-aa98-8aa0aeb0e7d4 of volume d5c26d9a-d386-468a-a5d9-62b7b8230d33 {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:37:01 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[904abe09-fec4-4e3d-97d3-90698ff7fd80]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:37:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cc2fede5-1984-48d1-a95d-6ad472a1c20d tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:01 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33 Jul 16 23:37:01 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:01 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cc2fede5-1984-48d1-a95d-6ad472a1c20d tempest-ProjectMemberTests-1023405772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33" returned: 0 in 0.423s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cc2fede5-1984-48d1-a95d-6ad472a1c20d tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33.e1ecc9a3-c9fb-42fe-aa98-8aa0aeb0e7d4 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:01 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33.e1ecc9a3-c9fb-42fe-aa98-8aa0aeb0e7d4 1G Jul 16 23:37:01 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:02 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cc2fede5-1984-48d1-a95d-6ad472a1c20d tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33.e1ecc9a3-c9fb-42fe-aa98-8aa0aeb0e7d4 1G" returned: 0 in 0.564s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cc2fede5-1984-48d1-a95d-6ad472a1c20d tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33.e1ecc9a3-c9fb-42fe-aa98-8aa0aeb0e7d4 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:02 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33.e1ecc9a3-c9fb-42fe-aa98-8aa0aeb0e7d4 Jul 16 23:37:02 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:02 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cc2fede5-1984-48d1-a95d-6ad472a1c20d tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33.e1ecc9a3-c9fb-42fe-aa98-8aa0aeb0e7d4" returned: 0 in 0.398s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:02 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-cc2fede5-1984-48d1-a95d-6ad472a1c20d tempest-ProjectMemberTests-1023405772 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33.e1ecc9a3-c9fb-42fe-aa98-8aa0aeb0e7d4 is being set with open permissions: ugo+rw Jul 16 23:37:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cc2fede5-1984-48d1-a95d-6ad472a1c20d tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33.e1ecc9a3-c9fb-42fe-aa98-8aa0aeb0e7d4 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:02 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33.e1ecc9a3-c9fb-42fe-aa98-8aa0aeb0e7d4 Jul 16 23:37:02 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:02 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cc2fede5-1984-48d1-a95d-6ad472a1c20d tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33.e1ecc9a3-c9fb-42fe-aa98-8aa0aeb0e7d4" returned: 0 in 0.363s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cc2fede5-1984-48d1-a95d-6ad472a1c20d tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:02 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33.info Jul 16 23:37:02 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:03 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cc2fede5-1984-48d1-a95d-6ad472a1c20d tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33.info" returned: 0 in 0.316s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:03 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-cc2fede5-1984-48d1-a95d-6ad472a1c20d tempest-ProjectMemberTests-1023405772 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33.info is being set with open permissions: ugo+rw Jul 16 23:37:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cc2fede5-1984-48d1-a95d-6ad472a1c20d tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:03 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33.info Jul 16 23:37:03 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:03 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad6e85b5-b521-4cd7-a035-e0346d9daa40 tempest-SnapshotDependencyTests-770087735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:37:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ad6e85b5-b521-4cd7-a035-e0346d9daa40 tempest-SnapshotDependencyTests-770087735 None] Flow 'volume_create_manager' (5bbf7221-bb91-457b-887f-21e561123faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:37:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ad6e85b5-b521-4cd7-a035-e0346d9daa40 tempest-SnapshotDependencyTests-770087735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d003c84f-8468-408b-8328-f823212a7f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ad6e85b5-b521-4cd7-a035-e0346d9daa40 tempest-SnapshotDependencyTests-770087735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d003c84f-8468-408b-8328-f823212a7f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-652564791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87f4cad9-73fd-4634-89a0-1eecc0587420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89ed1353613444088ad402cef4b3b8d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:37:03Z,use_quota=True,user_id='6fbfde75753845eb82bf9b6a22db005a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ad6e85b5-b521-4cd7-a035-e0346d9daa40 tempest-SnapshotDependencyTests-770087735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55c69426-28a0-4efb-87e2-876f2f91e55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ad6e85b5-b521-4cd7-a035-e0346d9daa40 tempest-SnapshotDependencyTests-770087735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55c69426-28a0-4efb-87e2-876f2f91e55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ad6e85b5-b521-4cd7-a035-e0346d9daa40 tempest-SnapshotDependencyTests-770087735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0926bd28-efb4-4eea-b669-77081475fd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ad6e85b5-b521-4cd7-a035-e0346d9daa40 tempest-SnapshotDependencyTests-770087735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0926bd28-efb4-4eea-b669-77081475fd0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87f4cad9-73fd-4634-89a0-1eecc0587420', 'volume_name': 'volume-87f4cad9-73fd-4634-89a0-1eecc0587420', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ad6e85b5-b521-4cd7-a035-e0346d9daa40 tempest-SnapshotDependencyTests-770087735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a6411df-e662-4dd8-b07d-5ae3aed3ac31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ad6e85b5-b521-4cd7-a035-e0346d9daa40 tempest-SnapshotDependencyTests-770087735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a6411df-e662-4dd8-b07d-5ae3aed3ac31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:03 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ad6e85b5-b521-4cd7-a035-e0346d9daa40 tempest-SnapshotDependencyTests-770087735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcd60f6f-c550-4b1c-aa08-5151dd4367ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:03 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-ad6e85b5-b521-4cd7-a035-e0346d9daa40 tempest-SnapshotDependencyTests-770087735 None] Volume 87f4cad9-73fd-4634-89a0-1eecc0587420: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87f4cad9-73fd-4634-89a0-1eecc0587420', 'volume_size': 1} Jul 16 23:37:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ad6e85b5-b521-4cd7-a035-e0346d9daa40 tempest-SnapshotDependencyTests-770087735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:37:03 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cc2fede5-1984-48d1-a95d-6ad472a1c20d tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33.info" returned: 0 in 0.276s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-cc2fede5-1984-48d1-a95d-6ad472a1c20d tempest-ProjectMemberTests-1023405772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.450s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:37:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ad6e85b5-b521-4cd7-a035-e0346d9daa40 tempest-SnapshotDependencyTests-770087735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.039s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:37:03 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ad6e85b5-b521-4cd7-a035-e0346d9daa40 tempest-SnapshotDependencyTests-770087735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-652564791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87f4cad9-73fd-4634-89a0-1eecc0587420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89ed1353613444088ad402cef4b3b8d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:37:03Z,use_quota=True,user_id='6fbfde75753845eb82bf9b6a22db005a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:37:03 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-ad6e85b5-b521-4cd7-a035-e0346d9daa40 tempest-SnapshotDependencyTests-770087735 None] Creating volume 87f4cad9-73fd-4634-89a0-1eecc0587420 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:37:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ad6e85b5-b521-4cd7-a035-e0346d9daa40 tempest-SnapshotDependencyTests-770087735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:37:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ad6e85b5-b521-4cd7-a035-e0346d9daa40 tempest-SnapshotDependencyTests-770087735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:37:03 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ad6e85b5-b521-4cd7-a035-e0346d9daa40 tempest-SnapshotDependencyTests-770087735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:37:03 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ad6e85b5-b521-4cd7-a035-e0346d9daa40 tempest-SnapshotDependencyTests-770087735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:37:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ad6e85b5-b521-4cd7-a035-e0346d9daa40 tempest-SnapshotDependencyTests-770087735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:37:03 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ad6e85b5-b521-4cd7-a035-e0346d9daa40 tempest-SnapshotDependencyTests-770087735 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:37:03 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-ad6e85b5-b521-4cd7-a035-e0346d9daa40 tempest-SnapshotDependencyTests-770087735 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:37:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ad6e85b5-b521-4cd7-a035-e0346d9daa40 tempest-SnapshotDependencyTests-770087735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:03 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420 1073741824 Jul 16 23:37:03 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:03 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-cc2fede5-1984-48d1-a95d-6ad472a1c20d tempest-ProjectMemberTests-1023405772 None] Create snapshot completed successfully Jul 16 23:37:03 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ad6e85b5-b521-4cd7-a035-e0346d9daa40 tempest-SnapshotDependencyTests-770087735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420 1073741824" returned: 0 in 0.487s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ad6e85b5-b521-4cd7-a035-e0346d9daa40 tempest-SnapshotDependencyTests-770087735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:04 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420 Jul 16 23:37:04 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:04 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b3dc6111-fc02-4aaa-9f29-dd337e1211de tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-e1ecc9a3-c9fb-42fe-aa98-8aa0aeb0e7d4-delete_snapshot" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:37:04 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b3dc6111-fc02-4aaa-9f29-dd337e1211de tempest-ProjectMemberTests-1023405772 None] Lock "cinder-e1ecc9a3-c9fb-42fe-aa98-8aa0aeb0e7d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:37:04 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b3dc6111-fc02-4aaa-9f29-dd337e1211de tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-quobyte-d5c26d9a-d386-468a-a5d9-62b7b8230d33" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:37:04 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b3dc6111-fc02-4aaa-9f29-dd337e1211de tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-d5c26d9a-d386-468a-a5d9-62b7b8230d33" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:37:04 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b3dc6111-fc02-4aaa-9f29-dd337e1211de tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-quobyte-e1ecc9a3-c9fb-42fe-aa98-8aa0aeb0e7d4" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:37:04 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b3dc6111-fc02-4aaa-9f29-dd337e1211de tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-e1ecc9a3-c9fb-42fe-aa98-8aa0aeb0e7d4" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:37:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-b3dc6111-fc02-4aaa-9f29-dd337e1211de tempest-ProjectMemberTests-1023405772 None] Deleting offline snapshot e1ecc9a3-c9fb-42fe-aa98-8aa0aeb0e7d4 of volume d5c26d9a-d386-468a-a5d9-62b7b8230d33 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:37:04 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-b3dc6111-fc02-4aaa-9f29-dd337e1211de tempest-ProjectMemberTests-1023405772 None] snapshot_file for this snap is: volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33.e1ecc9a3-c9fb-42fe-aa98-8aa0aeb0e7d4 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:37:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ad6e85b5-b521-4cd7-a035-e0346d9daa40 tempest-SnapshotDependencyTests-770087735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420" returned: 0 in 0.297s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ad6e85b5-b521-4cd7-a035-e0346d9daa40 tempest-SnapshotDependencyTests-770087735 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:37:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ad6e85b5-b521-4cd7-a035-e0346d9daa40 tempest-SnapshotDependencyTests-770087735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:37:04 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[1356c75f-4267-4d8f-ba03-d3a4cf09f186]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:37:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b3dc6111-fc02-4aaa-9f29-dd337e1211de tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33.e1ecc9a3-c9fb-42fe-aa98-8aa0aeb0e7d4 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:04 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ad6e85b5-b521-4cd7-a035-e0346d9daa40 tempest-SnapshotDependencyTests-770087735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcd60f6f-c550-4b1c-aa08-5151dd4367ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87f4cad9-73fd-4634-89a0-1eecc0587420', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:04 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ad6e85b5-b521-4cd7-a035-e0346d9daa40 tempest-SnapshotDependencyTests-770087735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e341602-81a1-4961-86ef-603c290da41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:04 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-ad6e85b5-b521-4cd7-a035-e0346d9daa40 tempest-SnapshotDependencyTests-770087735 None] Volume volume-87f4cad9-73fd-4634-89a0-1eecc0587420 (87f4cad9-73fd-4634-89a0-1eecc0587420): created successfully Jul 16 23:37:04 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ad6e85b5-b521-4cd7-a035-e0346d9daa40 tempest-SnapshotDependencyTests-770087735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e341602-81a1-4961-86ef-603c290da41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:04 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ad6e85b5-b521-4cd7-a035-e0346d9daa40 tempest-SnapshotDependencyTests-770087735 None] Flow 'volume_create_manager' (5bbf7221-bb91-457b-887f-21e561123faf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:37:04 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-ad6e85b5-b521-4cd7-a035-e0346d9daa40 tempest-SnapshotDependencyTests-770087735 None] Created volume successfully. Jul 16 23:37:04 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33.e1ecc9a3-c9fb-42fe-aa98-8aa0aeb0e7d4 Jul 16 23:37:04 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:04 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b3dc6111-fc02-4aaa-9f29-dd337e1211de tempest-ProjectMemberTests-1023405772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33.e1ecc9a3-c9fb-42fe-aa98-8aa0aeb0e7d4" returned: 0 in 0.354s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:04 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-b3dc6111-fc02-4aaa-9f29-dd337e1211de tempest-ProjectMemberTests-1023405772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:37:04 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca980cba-869c-4eb8-aefb-a5bdbbb02d8d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:37:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b3dc6111-fc02-4aaa-9f29-dd337e1211de tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:04 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33 Jul 16 23:37:04 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:05 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b3dc6111-fc02-4aaa-9f29-dd337e1211de tempest-ProjectMemberTests-1023405772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33" returned: 0 in 0.392s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b3dc6111-fc02-4aaa-9f29-dd337e1211de tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33.e1ecc9a3-c9fb-42fe-aa98-8aa0aeb0e7d4 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:05 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33.e1ecc9a3-c9fb-42fe-aa98-8aa0aeb0e7d4 Jul 16 23:37:05 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:05 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b3dc6111-fc02-4aaa-9f29-dd337e1211de tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33.e1ecc9a3-c9fb-42fe-aa98-8aa0aeb0e7d4" returned: 0 in 0.419s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b3dc6111-fc02-4aaa-9f29-dd337e1211de tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33.e1ecc9a3-c9fb-42fe-aa98-8aa0aeb0e7d4 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:05 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33.e1ecc9a3-c9fb-42fe-aa98-8aa0aeb0e7d4 Jul 16 23:37:05 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a50098b3-a303-4486-ae18-bb0434bdc251 tempest-SnapshotDependencyTests-770087735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:37:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a50098b3-a303-4486-ae18-bb0434bdc251 tempest-SnapshotDependencyTests-770087735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:37:05 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-a50098b3-a303-4486-ae18-bb0434bdc251 tempest-SnapshotDependencyTests-770087735 None] Creating offline snapshot 78ab0cbb-05d0-4378-aac0-7fbf765ac5b5 of volume 87f4cad9-73fd-4634-89a0-1eecc0587420 {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:37:05 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[597e9cd0-13d7-4edb-b2b1-cbe292321079]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:37:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a50098b3-a303-4486-ae18-bb0434bdc251 tempest-SnapshotDependencyTests-770087735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:05 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b3dc6111-fc02-4aaa-9f29-dd337e1211de tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33.e1ecc9a3-c9fb-42fe-aa98-8aa0aeb0e7d4" returned: 0 in 0.321s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:05 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b3dc6111-fc02-4aaa-9f29-dd337e1211de tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-e1ecc9a3-c9fb-42fe-aa98-8aa0aeb0e7d4" released by "_delete_snapshot" :: held 1.586s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:37:05 devstack sudo[107252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420 Jul 16 23:37:05 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:05 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b3dc6111-fc02-4aaa-9f29-dd337e1211de tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-d5c26d9a-d386-468a-a5d9-62b7b8230d33" released by "delete_snapshot" :: held 1.612s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:37:05 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-b3dc6111-fc02-4aaa-9f29-dd337e1211de tempest-ProjectMemberTests-1023405772 None] Created reservations ['bc17b4c3-d90d-4065-ba0a-d90336395099', '14dcfdb0-940c-4aca-adb5-86ca586eeac9', '1ed60a0a-37e5-40d4-9935-8b731b5f150a', '1dc7c65a-1aa3-40f2-aa12-6c7b14604df0'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:37:06 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-b3dc6111-fc02-4aaa-9f29-dd337e1211de tempest-ProjectMemberTests-1023405772 None] Delete snapshot completed successfully. Jul 16 23:37:06 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b3dc6111-fc02-4aaa-9f29-dd337e1211de tempest-ProjectMemberTests-1023405772 None] Lock "cinder-e1ecc9a3-c9fb-42fe-aa98-8aa0aeb0e7d4-delete_snapshot" released by "delete_snapshot" :: held 1.813s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:37:06 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a50098b3-a303-4486-ae18-bb0434bdc251 tempest-SnapshotDependencyTests-770087735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420" returned: 0 in 0.435s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a50098b3-a303-4486-ae18-bb0434bdc251 tempest-SnapshotDependencyTests-770087735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420.78ab0cbb-05d0-4378-aac0-7fbf765ac5b5 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:06 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420.78ab0cbb-05d0-4378-aac0-7fbf765ac5b5 1G Jul 16 23:37:06 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:06 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-80cd7d66-edf6-4e4d-ab1d-07bba579c620 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-d5c26d9a-d386-468a-a5d9-62b7b8230d33-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:37:06 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-80cd7d66-edf6-4e4d-ab1d-07bba579c620 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-d5c26d9a-d386-468a-a5d9-62b7b8230d33-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:37:06 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-80cd7d66-edf6-4e4d-ab1d-07bba579c620 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-quobyte-d5c26d9a-d386-468a-a5d9-62b7b8230d33" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:37:06 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-80cd7d66-edf6-4e4d-ab1d-07bba579c620 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-d5c26d9a-d386-468a-a5d9-62b7b8230d33" acquired by "delete_volume" :: waited 0.018s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:37:06 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[3160cd5e-0267-4195-8bed-020a4341fc48]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:37:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-80cd7d66-edf6-4e4d-ab1d-07bba579c620 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:06 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a50098b3-a303-4486-ae18-bb0434bdc251 tempest-SnapshotDependencyTests-770087735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420.78ab0cbb-05d0-4378-aac0-7fbf765ac5b5 1G" returned: 0 in 0.468s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a50098b3-a303-4486-ae18-bb0434bdc251 tempest-SnapshotDependencyTests-770087735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87f4cad9-73fd-4634-89a0-1eecc0587420 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420.78ab0cbb-05d0-4378-aac0-7fbf765ac5b5 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:06 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33 Jul 16 23:37:06 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:06 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87f4cad9-73fd-4634-89a0-1eecc0587420 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420.78ab0cbb-05d0-4378-aac0-7fbf765ac5b5 Jul 16 23:37:06 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:06 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-80cd7d66-edf6-4e4d-ab1d-07bba579c620 tempest-ProjectMemberTests-1023405772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33" returned: 0 in 0.443s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-80cd7d66-edf6-4e4d-ab1d-07bba579c620 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:07 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33 Jul 16 23:37:07 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:07 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a50098b3-a303-4486-ae18-bb0434bdc251 tempest-SnapshotDependencyTests-770087735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87f4cad9-73fd-4634-89a0-1eecc0587420 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420.78ab0cbb-05d0-4378-aac0-7fbf765ac5b5" returned: 0 in 0.355s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:07 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-a50098b3-a303-4486-ae18-bb0434bdc251 tempest-SnapshotDependencyTests-770087735 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420.78ab0cbb-05d0-4378-aac0-7fbf765ac5b5 is being set with open permissions: ugo+rw Jul 16 23:37:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a50098b3-a303-4486-ae18-bb0434bdc251 tempest-SnapshotDependencyTests-770087735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420.78ab0cbb-05d0-4378-aac0-7fbf765ac5b5 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:07 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420.78ab0cbb-05d0-4378-aac0-7fbf765ac5b5 Jul 16 23:37:07 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:07 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-80cd7d66-edf6-4e4d-ab1d-07bba579c620 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d5c26d9a-d386-468a-a5d9-62b7b8230d33" returned: 0 in 0.333s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:07 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a50098b3-a303-4486-ae18-bb0434bdc251 tempest-SnapshotDependencyTests-770087735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420.78ab0cbb-05d0-4378-aac0-7fbf765ac5b5" returned: 0 in 0.296s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:07 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-80cd7d66-edf6-4e4d-ab1d-07bba579c620 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-d5c26d9a-d386-468a-a5d9-62b7b8230d33" released by "delete_volume" :: held 0.852s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:37:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a50098b3-a303-4486-ae18-bb0434bdc251 tempest-SnapshotDependencyTests-770087735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:07 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420.info Jul 16 23:37:07 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:07 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-80cd7d66-edf6-4e4d-ab1d-07bba579c620 tempest-ProjectMemberTests-1023405772 None] Created reservations ['2cf9bc1b-44ae-4063-94b2-12ea621d3245', '2f3175e3-7a51-45ec-bb26-f8d3d48b8985', 'b7c9fcfd-706b-48d1-b07a-4cff8de6da5e', '268ddc9b-f083-4125-bd4f-85c8e6bff647'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:37:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-80cd7d66-edf6-4e4d-ab1d-07bba579c620 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:37:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-80cd7d66-edf6-4e4d-ab1d-07bba579c620 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:37:07 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-80cd7d66-edf6-4e4d-ab1d-07bba579c620 tempest-ProjectMemberTests-1023405772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:37:07 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-80cd7d66-edf6-4e4d-ab1d-07bba579c620 tempest-ProjectMemberTests-1023405772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:37:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-80cd7d66-edf6-4e4d-ab1d-07bba579c620 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:37:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-80cd7d66-edf6-4e4d-ab1d-07bba579c620 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:07 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:37:07 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:07 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a50098b3-a303-4486-ae18-bb0434bdc251 tempest-SnapshotDependencyTests-770087735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420.info" returned: 0 in 0.298s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:07 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-a50098b3-a303-4486-ae18-bb0434bdc251 tempest-SnapshotDependencyTests-770087735 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420.info is being set with open permissions: ugo+rw Jul 16 23:37:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a50098b3-a303-4486-ae18-bb0434bdc251 tempest-SnapshotDependencyTests-770087735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:07 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420.info Jul 16 23:37:07 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:07 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-80cd7d66-edf6-4e4d-ab1d-07bba579c620 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.283s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:07 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-80cd7d66-edf6-4e4d-ab1d-07bba579c620 tempest-ProjectMemberTests-1023405772 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:37:07 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-80cd7d66-edf6-4e4d-ab1d-07bba579c620 tempest-ProjectMemberTests-1023405772 None] Deleted volume successfully. Jul 16 23:37:07 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-80cd7d66-edf6-4e4d-ab1d-07bba579c620 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-d5c26d9a-d386-468a-a5d9-62b7b8230d33-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:37:07 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a50098b3-a303-4486-ae18-bb0434bdc251 tempest-SnapshotDependencyTests-770087735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420.info" returned: 0 in 0.277s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a50098b3-a303-4486-ae18-bb0434bdc251 tempest-SnapshotDependencyTests-770087735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.246s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:37:07 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-a50098b3-a303-4486-ae18-bb0434bdc251 tempest-SnapshotDependencyTests-770087735 None] Create snapshot completed successfully Jul 16 23:37:08 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-871406ed-3641-4960-b0e1-afd6226a01f7 tempest-ProjectMemberTests-1023405772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:37:08 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-871406ed-3641-4960-b0e1-afd6226a01f7 tempest-ProjectMemberTests-1023405772 None] Flow 'volume_create_manager' (eceafe6d-bbca-4ea5-8d1b-9bcd7bef0415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:37:08 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-871406ed-3641-4960-b0e1-afd6226a01f7 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3eb8a29-910f-44cf-9b56-c7211b4edd42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:08 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-871406ed-3641-4960-b0e1-afd6226a01f7 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3eb8a29-910f-44cf-9b56-c7211b4edd42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-38458178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21ba77d1-89d9-4e31-94e1-b265946aa7c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b14a0052f8fb4344b121d3a20292b053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:37:08Z,use_quota=True,user_id='faa7527cbba84668895a85e3faa36efb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:08 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-871406ed-3641-4960-b0e1-afd6226a01f7 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5c982d6-416e-4f45-84b5-2d20ed8c2fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:08 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-871406ed-3641-4960-b0e1-afd6226a01f7 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5c982d6-416e-4f45-84b5-2d20ed8c2fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:08 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-871406ed-3641-4960-b0e1-afd6226a01f7 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ef2b837-4f16-43ff-aaa0-21aaa6625b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:08 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-871406ed-3641-4960-b0e1-afd6226a01f7 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ef2b837-4f16-43ff-aaa0-21aaa6625b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21ba77d1-89d9-4e31-94e1-b265946aa7c0', 'volume_name': 'volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:08 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-871406ed-3641-4960-b0e1-afd6226a01f7 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (455fb3ba-00dc-4785-8762-e8b2bd160e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:08 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-871406ed-3641-4960-b0e1-afd6226a01f7 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (455fb3ba-00dc-4785-8762-e8b2bd160e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:08 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-871406ed-3641-4960-b0e1-afd6226a01f7 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (545959b1-89cd-40dd-9d07-e55a2608913c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:08 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-871406ed-3641-4960-b0e1-afd6226a01f7 tempest-ProjectMemberTests-1023405772 None] Volume 21ba77d1-89d9-4e31-94e1-b265946aa7c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0', 'volume_size': 1} Jul 16 23:37:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-871406ed-3641-4960-b0e1-afd6226a01f7 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:37:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-871406ed-3641-4960-b0e1-afd6226a01f7 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:37:08 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-871406ed-3641-4960-b0e1-afd6226a01f7 tempest-ProjectMemberTests-1023405772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-38458178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21ba77d1-89d9-4e31-94e1-b265946aa7c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b14a0052f8fb4344b121d3a20292b053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:37:08Z,use_quota=True,user_id='faa7527cbba84668895a85e3faa36efb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:37:08 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-871406ed-3641-4960-b0e1-afd6226a01f7 tempest-ProjectMemberTests-1023405772 None] Creating volume 21ba77d1-89d9-4e31-94e1-b265946aa7c0 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:37:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-871406ed-3641-4960-b0e1-afd6226a01f7 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:37:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-871406ed-3641-4960-b0e1-afd6226a01f7 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:37:08 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-871406ed-3641-4960-b0e1-afd6226a01f7 tempest-ProjectMemberTests-1023405772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:37:08 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-871406ed-3641-4960-b0e1-afd6226a01f7 tempest-ProjectMemberTests-1023405772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:37:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-871406ed-3641-4960-b0e1-afd6226a01f7 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:37:08 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-871406ed-3641-4960-b0e1-afd6226a01f7 tempest-ProjectMemberTests-1023405772 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:37:08 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-871406ed-3641-4960-b0e1-afd6226a01f7 tempest-ProjectMemberTests-1023405772 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:37:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-871406ed-3641-4960-b0e1-afd6226a01f7 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:08 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0 1073741824 Jul 16 23:37:08 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:08 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-871406ed-3641-4960-b0e1-afd6226a01f7 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0 1073741824" returned: 0 in 0.428s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-871406ed-3641-4960-b0e1-afd6226a01f7 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:08 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0 Jul 16 23:37:08 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:08 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-871406ed-3641-4960-b0e1-afd6226a01f7 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0" returned: 0 in 0.240s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:08 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-871406ed-3641-4960-b0e1-afd6226a01f7 tempest-ProjectMemberTests-1023405772 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:37:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-871406ed-3641-4960-b0e1-afd6226a01f7 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:37:08 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-871406ed-3641-4960-b0e1-afd6226a01f7 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (545959b1-89cd-40dd-9d07-e55a2608913c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:08 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-871406ed-3641-4960-b0e1-afd6226a01f7 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84c7fcf4-c5c3-46b8-8157-e09429e715b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:08 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-871406ed-3641-4960-b0e1-afd6226a01f7 tempest-ProjectMemberTests-1023405772 None] Volume volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0 (21ba77d1-89d9-4e31-94e1-b265946aa7c0): created successfully Jul 16 23:37:08 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-871406ed-3641-4960-b0e1-afd6226a01f7 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84c7fcf4-c5c3-46b8-8157-e09429e715b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:08 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-871406ed-3641-4960-b0e1-afd6226a01f7 tempest-ProjectMemberTests-1023405772 None] Flow 'volume_create_manager' (eceafe6d-bbca-4ea5-8d1b-9bcd7bef0415) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:37:08 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-871406ed-3641-4960-b0e1-afd6226a01f7 tempest-ProjectMemberTests-1023405772 None] Created volume successfully. Jul 16 23:37:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7cfc5fe0-ff48-4f49-bfc1-fa64ef80d68b tempest-ProjectMemberTests-1023405772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:37:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7cfc5fe0-ff48-4f49-bfc1-fa64ef80d68b tempest-ProjectMemberTests-1023405772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:37:09 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-7cfc5fe0-ff48-4f49-bfc1-fa64ef80d68b tempest-ProjectMemberTests-1023405772 None] Creating offline snapshot eabb0d96-4381-4e02-88e5-1a839e8aefdf of volume 21ba77d1-89d9-4e31-94e1-b265946aa7c0 {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:37:09 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[c055f77f-1401-4e9a-8c28-3552235f3b92]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:37:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7cfc5fe0-ff48-4f49-bfc1-fa64ef80d68b tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:09 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0 Jul 16 23:37:09 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:09 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:37:09 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Flow 'volume_create_manager' (2c272bb1-ba06-4846-badc-27ddd4757238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:37:09 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb5c0056-436f-43c9-bc6f-85fd3c4bd0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:09 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb5c0056-436f-43c9-bc6f-85fd3c4bd0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ee0fd70-fa37-4431-8972-16718e589e93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89ed1353613444088ad402cef4b3b8d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=78ab0cbb-05d0-4378-aac0-7fbf765ac5b5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:37:09Z,use_quota=True,user_id='6fbfde75753845eb82bf9b6a22db005a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:09 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36ce89aa-b0b6-4081-b765-a9f2f0e327ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:09 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36ce89aa-b0b6-4081-b765-a9f2f0e327ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:09 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86f06781-fe18-4286-9045-4a673c5940ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:09 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86f06781-fe18-4286-9045-4a673c5940ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3ee0fd70-fa37-4431-8972-16718e589e93', 'volume_name': 'volume-3ee0fd70-fa37-4431-8972-16718e589e93', 'volume_size': 1, 'snapshot_id': '78ab0cbb-05d0-4378-aac0-7fbf765ac5b5'}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:09 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7873a252-b927-4307-88c2-d0eba3308818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:09 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7873a252-b927-4307-88c2-d0eba3308818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:09 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d813ff13-0a4c-4061-8982-c94785682d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:09 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Volume 3ee0fd70-fa37-4431-8972-16718e589e93: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3ee0fd70-fa37-4431-8972-16718e589e93', 'volume_size': 1, 'snapshot_id': '78ab0cbb-05d0-4378-aac0-7fbf765ac5b5'} Jul 16 23:37:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:37:09 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7cfc5fe0-ff48-4f49-bfc1-fa64ef80d68b tempest-ProjectMemberTests-1023405772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0" returned: 0 in 0.372s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7cfc5fe0-ff48-4f49-bfc1-fa64ef80d68b tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0.eabb0d96-4381-4e02-88e5-1a839e8aefdf 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:09 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0.eabb0d96-4381-4e02-88e5-1a839e8aefdf 1G Jul 16 23:37:09 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:10 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7cfc5fe0-ff48-4f49-bfc1-fa64ef80d68b tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0.eabb0d96-4381-4e02-88e5-1a839e8aefdf 1G" returned: 0 in 0.472s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7cfc5fe0-ff48-4f49-bfc1-fa64ef80d68b tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0.eabb0d96-4381-4e02-88e5-1a839e8aefdf {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:10 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0.eabb0d96-4381-4e02-88e5-1a839e8aefdf Jul 16 23:37:10 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:10 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7cfc5fe0-ff48-4f49-bfc1-fa64ef80d68b tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0.eabb0d96-4381-4e02-88e5-1a839e8aefdf" returned: 0 in 0.309s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:10 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-7cfc5fe0-ff48-4f49-bfc1-fa64ef80d68b tempest-ProjectMemberTests-1023405772 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0.eabb0d96-4381-4e02-88e5-1a839e8aefdf is being set with open permissions: ugo+rw Jul 16 23:37:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7cfc5fe0-ff48-4f49-bfc1-fa64ef80d68b tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0.eabb0d96-4381-4e02-88e5-1a839e8aefdf {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:10 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0.eabb0d96-4381-4e02-88e5-1a839e8aefdf Jul 16 23:37:10 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:10 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7cfc5fe0-ff48-4f49-bfc1-fa64ef80d68b tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0.eabb0d96-4381-4e02-88e5-1a839e8aefdf" returned: 0 in 0.256s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7cfc5fe0-ff48-4f49-bfc1-fa64ef80d68b tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:10 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0.info Jul 16 23:37:10 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:11 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7cfc5fe0-ff48-4f49-bfc1-fa64ef80d68b tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0.info" returned: 0 in 0.258s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:11 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-7cfc5fe0-ff48-4f49-bfc1-fa64ef80d68b tempest-ProjectMemberTests-1023405772 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0.info is being set with open permissions: ugo+rw Jul 16 23:37:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7cfc5fe0-ff48-4f49-bfc1-fa64ef80d68b tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:11 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0.info Jul 16 23:37:11 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:11 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7cfc5fe0-ff48-4f49-bfc1-fa64ef80d68b tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0.info" returned: 0 in 0.240s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7cfc5fe0-ff48-4f49-bfc1-fa64ef80d68b tempest-ProjectMemberTests-1023405772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:37:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.682s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:37:11 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Acquiring lock "cinder-quobyte-78ab0cbb-05d0-4378-aac0-7fbf765ac5b5-3ee0fd70-fa37-4431-8972-16718e589e93" by "_create_volume_from_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:37:11 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Lock "cinder-quobyte-78ab0cbb-05d0-4378-aac0-7fbf765ac5b5-3ee0fd70-fa37-4431-8972-16718e589e93" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:37:11 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Creating volume 3ee0fd70-fa37-4431-8972-16718e589e93 from snapshot 78ab0cbb-05d0-4378-aac0-7fbf765ac5b5 {{(pid=87607) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 16 23:37:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:37:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:37:11 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:37:11 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:37:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:37:11 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:37:11 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Acquiring lock "cinder-quobyte-3ee0fd70-fa37-4431-8972-16718e589e93" by "_copy_volume_from_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:37:11 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-7cfc5fe0-ff48-4f49-bfc1-fa64ef80d68b tempest-ProjectMemberTests-1023405772 None] Create snapshot completed successfully Jul 16 23:37:11 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Lock "cinder-quobyte-3ee0fd70-fa37-4431-8972-16718e589e93" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:37:11 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] snapshot: 78ab0cbb-05d0-4378-aac0-7fbf765ac5b5, volume: 3ee0fd70-fa37-4431-8972-16718e589e93, {{(pid=87607) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 16 23:37:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:37:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:37:11 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:37:11 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:37:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:37:11 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fb2bbf-19bf-4bd2-a3cd-ae4edb5c2d87]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:37:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420.78ab0cbb-05d0-4378-aac0-7fbf765ac5b5 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:11 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420.78ab0cbb-05d0-4378-aac0-7fbf765ac5b5 Jul 16 23:37:11 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:11 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420.78ab0cbb-05d0-4378-aac0-7fbf765ac5b5" returned: 0 in 0.363s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:11 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87f4cad9-73fd-4634-89a0-1eecc0587420(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:37:11 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420 {{(pid=87607) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 16 23:37:11 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Creating direct copy from snapshot {{(pid=87607) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 16 23:37:11 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ec6b00-9dc8-404c-ae7a-6ecf304d9abe]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:37:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:11 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420 Jul 16 23:37:11 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:12 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420" returned: 0 in 0.365s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:12 devstack cinder-volume[87607]: DEBUG cinder.utils [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Path /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3ee0fd70-fa37-4431-8972-16718e589e93 not found in is_blk_device check {{(pid=87607) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 16 23:37:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3ee0fd70-fa37-4431-8972-16718e589e93 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:12 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3ee0fd70-fa37-4431-8972-16718e589e93 Jul 16 23:37:12 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:12 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-9e3cb09c-73b3-450e-9ec6-0d5a7bd33f96 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-eabb0d96-4381-4e02-88e5-1a839e8aefdf-delete_snapshot" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:37:12 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-9e3cb09c-73b3-450e-9ec6-0d5a7bd33f96 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-eabb0d96-4381-4e02-88e5-1a839e8aefdf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:37:12 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-9e3cb09c-73b3-450e-9ec6-0d5a7bd33f96 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-quobyte-21ba77d1-89d9-4e31-94e1-b265946aa7c0" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:37:12 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-9e3cb09c-73b3-450e-9ec6-0d5a7bd33f96 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-21ba77d1-89d9-4e31-94e1-b265946aa7c0" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:37:12 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-9e3cb09c-73b3-450e-9ec6-0d5a7bd33f96 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-quobyte-eabb0d96-4381-4e02-88e5-1a839e8aefdf" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:37:12 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-9e3cb09c-73b3-450e-9ec6-0d5a7bd33f96 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-eabb0d96-4381-4e02-88e5-1a839e8aefdf" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:37:12 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-9e3cb09c-73b3-450e-9ec6-0d5a7bd33f96 tempest-ProjectMemberTests-1023405772 None] Deleting offline snapshot eabb0d96-4381-4e02-88e5-1a839e8aefdf of volume 21ba77d1-89d9-4e31-94e1-b265946aa7c0 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:37:12 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-9e3cb09c-73b3-450e-9ec6-0d5a7bd33f96 tempest-ProjectMemberTests-1023405772 None] snapshot_file for this snap is: volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0.eabb0d96-4381-4e02-88e5-1a839e8aefdf {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:37:12 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebf2d7c-f39f-4421-be3c-7e3d80abbb21]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:37:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-9e3cb09c-73b3-450e-9ec6-0d5a7bd33f96 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0.eabb0d96-4381-4e02-88e5-1a839e8aefdf {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:12 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0.eabb0d96-4381-4e02-88e5-1a839e8aefdf Jul 16 23:37:12 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:13 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-9e3cb09c-73b3-450e-9ec6-0d5a7bd33f96 tempest-ProjectMemberTests-1023405772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0.eabb0d96-4381-4e02-88e5-1a839e8aefdf" returned: 0 in 0.742s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:13 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-9e3cb09c-73b3-450e-9ec6-0d5a7bd33f96 tempest-ProjectMemberTests-1023405772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:37:13 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[915ad351-a2a6-40b4-8b01-9afc58cb35a3]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:37:13 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-9e3cb09c-73b3-450e-9ec6-0d5a7bd33f96 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:13 devstack sudo[107352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0 Jul 16 23:37:13 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:14 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-9e3cb09c-73b3-450e-9ec6-0d5a7bd33f96 tempest-ProjectMemberTests-1023405772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0" returned: 0 in 0.825s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:14 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-9e3cb09c-73b3-450e-9ec6-0d5a7bd33f96 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0.eabb0d96-4381-4e02-88e5-1a839e8aefdf {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:14 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0.eabb0d96-4381-4e02-88e5-1a839e8aefdf Jul 16 23:37:14 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:15 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-9e3cb09c-73b3-450e-9ec6-0d5a7bd33f96 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0.eabb0d96-4381-4e02-88e5-1a839e8aefdf" returned: 0 in 0.899s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-9e3cb09c-73b3-450e-9ec6-0d5a7bd33f96 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0.eabb0d96-4381-4e02-88e5-1a839e8aefdf {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:15 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0.eabb0d96-4381-4e02-88e5-1a839e8aefdf Jul 16 23:37:15 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:15 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:15 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-9e3cb09c-73b3-450e-9ec6-0d5a7bd33f96 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0.eabb0d96-4381-4e02-88e5-1a839e8aefdf" returned: 0 in 0.600s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:15 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-9e3cb09c-73b3-450e-9ec6-0d5a7bd33f96 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-eabb0d96-4381-4e02-88e5-1a839e8aefdf" released by "_delete_snapshot" :: held 3.243s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:37:15 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-9e3cb09c-73b3-450e-9ec6-0d5a7bd33f96 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-21ba77d1-89d9-4e31-94e1-b265946aa7c0" released by "delete_snapshot" :: held 3.275s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:37:15 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-9e3cb09c-73b3-450e-9ec6-0d5a7bd33f96 tempest-ProjectMemberTests-1023405772 None] Created reservations ['6d1d45f4-5fc2-4fa9-8c33-51db00989f65', '033c6a77-da7e-4c50-ad15-38f8c9f22f8e', '6bac3ac9-3350-41cb-ab3d-ee1cb0cf1668', '6061a92f-c756-4de7-b039-0001fac2e5a4'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:37:16 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-9e3cb09c-73b3-450e-9ec6-0d5a7bd33f96 tempest-ProjectMemberTests-1023405772 None] Delete snapshot completed successfully. Jul 16 23:37:16 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-9e3cb09c-73b3-450e-9ec6-0d5a7bd33f96 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-eabb0d96-4381-4e02-88e5-1a839e8aefdf-delete_snapshot" released by "delete_snapshot" :: held 3.643s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:37:16 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3ee0fd70-fa37-4431-8972-16718e589e93" returned: 0 in 4.463s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:16 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05f0718-3423-4ccd-b9d5-dcd176b1d61e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:37:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:16 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420 Jul 16 23:37:16 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:16 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-34bbcfb9-6ecc-4732-a81b-cd1d77e68544 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-21ba77d1-89d9-4e31-94e1-b265946aa7c0-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:37:16 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-34bbcfb9-6ecc-4732-a81b-cd1d77e68544 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-21ba77d1-89d9-4e31-94e1-b265946aa7c0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:37:16 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-34bbcfb9-6ecc-4732-a81b-cd1d77e68544 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-quobyte-21ba77d1-89d9-4e31-94e1-b265946aa7c0" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:37:16 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-34bbcfb9-6ecc-4732-a81b-cd1d77e68544 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-21ba77d1-89d9-4e31-94e1-b265946aa7c0" acquired by "delete_volume" :: waited 0.017s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:37:16 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[65dba439-5173-42de-9fa5-31b6062312d6]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:37:16 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-34bbcfb9-6ecc-4732-a81b-cd1d77e68544 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:17 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0 Jul 16 23:37:17 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:17 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:17 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420" returned: 0 in 0.551s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:17 devstack cinder-volume[87607]: DEBUG cinder.image.image_utils [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Image conversion details: src /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420, size 1024.00 MB, duration 4.46 sec, destination /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3ee0fd70-fa37-4431-8972-16718e589e93 {{(pid=87607) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 23:37:17 devstack cinder-volume[87607]: INFO cinder.image.image_utils [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Converted 1024.00 MB image at 229.37 MB/s Jul 16 23:37:17 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3ee0fd70-fa37-4431-8972-16718e589e93 is being set with open permissions: ugo+rw Jul 16 23:37:17 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3ee0fd70-fa37-4431-8972-16718e589e93 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:17 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3ee0fd70-fa37-4431-8972-16718e589e93 Jul 16 23:37:17 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:17 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:17 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-34bbcfb9-6ecc-4732-a81b-cd1d77e68544 tempest-ProjectMemberTests-1023405772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0" returned: 0 in 0.366s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:17 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-34bbcfb9-6ecc-4732-a81b-cd1d77e68544 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:17 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0 Jul 16 23:37:17 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:17 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:17 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3ee0fd70-fa37-4431-8972-16718e589e93" returned: 0 in 0.245s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:17 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Lock "cinder-quobyte-3ee0fd70-fa37-4431-8972-16718e589e93" released by "_copy_volume_from_snapshot" :: held 6.084s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:37:17 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Lock "cinder-quobyte-78ab0cbb-05d0-4378-aac0-7fbf765ac5b5-3ee0fd70-fa37-4431-8972-16718e589e93" released by "_create_volume_from_snapshot" :: held 6.117s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:37:17 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.142s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:37:17 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d813ff13-0a4c-4061-8982-c94785682d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ee0fd70-fa37-4431-8972-16718e589e93', 'volume_size': 1, 'snapshot_id': '78ab0cbb-05d0-4378-aac0-7fbf765ac5b5'}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:17 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2173478-6caf-4c6b-baab-2501f562980b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:17 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Volume volume-3ee0fd70-fa37-4431-8972-16718e589e93 (3ee0fd70-fa37-4431-8972-16718e589e93): created successfully Jul 16 23:37:17 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2173478-6caf-4c6b-baab-2501f562980b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:17 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Flow 'volume_create_manager' (2c272bb1-ba06-4846-badc-27ddd4757238) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:37:17 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-0fc924c8-2992-4444-952a-628f9c58b708 tempest-SnapshotDependencyTests-770087735 None] Created volume successfully. Jul 16 23:37:17 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:17 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-34bbcfb9-6ecc-4732-a81b-cd1d77e68544 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-21ba77d1-89d9-4e31-94e1-b265946aa7c0" returned: 0 in 0.264s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:17 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-34bbcfb9-6ecc-4732-a81b-cd1d77e68544 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-21ba77d1-89d9-4e31-94e1-b265946aa7c0" released by "delete_volume" :: held 0.687s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:37:17 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-34bbcfb9-6ecc-4732-a81b-cd1d77e68544 tempest-ProjectMemberTests-1023405772 None] Created reservations ['183c27c6-04db-4d40-b8e0-aebc4969c900', '7baac14c-ec40-49ed-ac0f-f699eda41747', '302a6480-78a8-4b75-b44a-4e7f86f97431', 'c0291e25-50c3-4e56-ac36-97754992ba2a'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:37:17 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-34bbcfb9-6ecc-4732-a81b-cd1d77e68544 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:37:17 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-34bbcfb9-6ecc-4732-a81b-cd1d77e68544 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:37:17 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-34bbcfb9-6ecc-4732-a81b-cd1d77e68544 tempest-ProjectMemberTests-1023405772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:37:17 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-34bbcfb9-6ecc-4732-a81b-cd1d77e68544 tempest-ProjectMemberTests-1023405772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:37:17 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-34bbcfb9-6ecc-4732-a81b-cd1d77e68544 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:37:17 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-34bbcfb9-6ecc-4732-a81b-cd1d77e68544 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:17 devstack sudo[107381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:37:17 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:17 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:17 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-34bbcfb9-6ecc-4732-a81b-cd1d77e68544 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.253s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:17 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-34bbcfb9-6ecc-4732-a81b-cd1d77e68544 tempest-ProjectMemberTests-1023405772 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:37:17 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-34bbcfb9-6ecc-4732-a81b-cd1d77e68544 tempest-ProjectMemberTests-1023405772 None] Deleted volume successfully. Jul 16 23:37:17 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-34bbcfb9-6ecc-4732-a81b-cd1d77e68544 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-21ba77d1-89d9-4e31-94e1-b265946aa7c0-delete_volume" released by "delete_volume" :: held 1.124s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:37:18 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-7caeb179-53e6-4a68-aa83-ebb4e5dd7bb9 tempest-SnapshotDependencyTests-770087735 None] Acquiring lock "cinder-78ab0cbb-05d0-4378-aac0-7fbf765ac5b5-delete_snapshot" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:37:18 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-7caeb179-53e6-4a68-aa83-ebb4e5dd7bb9 tempest-SnapshotDependencyTests-770087735 None] Lock "cinder-78ab0cbb-05d0-4378-aac0-7fbf765ac5b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:37:18 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-7caeb179-53e6-4a68-aa83-ebb4e5dd7bb9 tempest-SnapshotDependencyTests-770087735 None] Acquiring lock "cinder-quobyte-87f4cad9-73fd-4634-89a0-1eecc0587420" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:37:18 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-7caeb179-53e6-4a68-aa83-ebb4e5dd7bb9 tempest-SnapshotDependencyTests-770087735 None] Lock "cinder-quobyte-87f4cad9-73fd-4634-89a0-1eecc0587420" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:37:18 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-7caeb179-53e6-4a68-aa83-ebb4e5dd7bb9 tempest-SnapshotDependencyTests-770087735 None] Acquiring lock "cinder-quobyte-78ab0cbb-05d0-4378-aac0-7fbf765ac5b5" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:37:18 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-7caeb179-53e6-4a68-aa83-ebb4e5dd7bb9 tempest-SnapshotDependencyTests-770087735 None] Lock "cinder-quobyte-78ab0cbb-05d0-4378-aac0-7fbf765ac5b5" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:37:18 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-7caeb179-53e6-4a68-aa83-ebb4e5dd7bb9 tempest-SnapshotDependencyTests-770087735 None] Deleting offline snapshot 78ab0cbb-05d0-4378-aac0-7fbf765ac5b5 of volume 87f4cad9-73fd-4634-89a0-1eecc0587420 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:37:18 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-7caeb179-53e6-4a68-aa83-ebb4e5dd7bb9 tempest-SnapshotDependencyTests-770087735 None] snapshot_file for this snap is: volume-87f4cad9-73fd-4634-89a0-1eecc0587420.78ab0cbb-05d0-4378-aac0-7fbf765ac5b5 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:37:18 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45c7e73-0013-4505-89cd-cefb92ea9b82]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:37:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7caeb179-53e6-4a68-aa83-ebb4e5dd7bb9 tempest-SnapshotDependencyTests-770087735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420.78ab0cbb-05d0-4378-aac0-7fbf765ac5b5 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:18 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-85fc5c10-3666-423a-beaf-312723ef3ede tempest-ProjectMemberTests-1023405772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:37:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-85fc5c10-3666-423a-beaf-312723ef3ede tempest-ProjectMemberTests-1023405772 None] Flow 'volume_create_manager' (a3143bf1-5be4-4b07-bc13-3f3a03a71b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:37:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-85fc5c10-3666-423a-beaf-312723ef3ede tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3df9ee10-2069-4610-b534-f29cde5997cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-85fc5c10-3666-423a-beaf-312723ef3ede tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3df9ee10-2069-4610-b534-f29cde5997cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:37:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1584009453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7205b64-19cb-4003-8aa5-34e6d18ed299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b14a0052f8fb4344b121d3a20292b053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:37:18Z,use_quota=True,user_id='faa7527cbba84668895a85e3faa36efb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:18 devstack sudo[107384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420.78ab0cbb-05d0-4378-aac0-7fbf765ac5b5 Jul 16 23:37:18 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-85fc5c10-3666-423a-beaf-312723ef3ede tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ffae1ee-6ed1-4d25-950b-e7c3471f2e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-85fc5c10-3666-423a-beaf-312723ef3ede tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ffae1ee-6ed1-4d25-950b-e7c3471f2e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-85fc5c10-3666-423a-beaf-312723ef3ede tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc4651e8-e8d7-4215-89bc-df904bb20d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-85fc5c10-3666-423a-beaf-312723ef3ede tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc4651e8-e8d7-4215-89bc-df904bb20d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7205b64-19cb-4003-8aa5-34e6d18ed299', 'volume_name': 'volume-d7205b64-19cb-4003-8aa5-34e6d18ed299', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-85fc5c10-3666-423a-beaf-312723ef3ede tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40f3cc39-c248-4ab8-90f1-eac89be7dad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-85fc5c10-3666-423a-beaf-312723ef3ede tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40f3cc39-c248-4ab8-90f1-eac89be7dad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:18 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-85fc5c10-3666-423a-beaf-312723ef3ede tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ed8811e-2f47-4779-a208-b4dc3ac1d629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:18 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-85fc5c10-3666-423a-beaf-312723ef3ede tempest-ProjectMemberTests-1023405772 None] Volume d7205b64-19cb-4003-8aa5-34e6d18ed299: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7205b64-19cb-4003-8aa5-34e6d18ed299', 'volume_size': 1} Jul 16 23:37:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-85fc5c10-3666-423a-beaf-312723ef3ede tempest-ProjectMemberTests-1023405772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:37:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-85fc5c10-3666-423a-beaf-312723ef3ede tempest-ProjectMemberTests-1023405772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:37:18 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-85fc5c10-3666-423a-beaf-312723ef3ede tempest-ProjectMemberTests-1023405772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:37:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1584009453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7205b64-19cb-4003-8aa5-34e6d18ed299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b14a0052f8fb4344b121d3a20292b053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:37:18Z,use_quota=True,user_id='faa7527cbba84668895a85e3faa36efb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:37:18 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-85fc5c10-3666-423a-beaf-312723ef3ede tempest-ProjectMemberTests-1023405772 None] Creating volume d7205b64-19cb-4003-8aa5-34e6d18ed299 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:37:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-85fc5c10-3666-423a-beaf-312723ef3ede tempest-ProjectMemberTests-1023405772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:37:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-85fc5c10-3666-423a-beaf-312723ef3ede tempest-ProjectMemberTests-1023405772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:37:18 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-85fc5c10-3666-423a-beaf-312723ef3ede tempest-ProjectMemberTests-1023405772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:37:18 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-85fc5c10-3666-423a-beaf-312723ef3ede tempest-ProjectMemberTests-1023405772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:37:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-85fc5c10-3666-423a-beaf-312723ef3ede tempest-ProjectMemberTests-1023405772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:37:18 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-85fc5c10-3666-423a-beaf-312723ef3ede tempest-ProjectMemberTests-1023405772 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:37:18 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-85fc5c10-3666-423a-beaf-312723ef3ede tempest-ProjectMemberTests-1023405772 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:37:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-85fc5c10-3666-423a-beaf-312723ef3ede tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:18 devstack sudo[107386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299 1073741824 Jul 16 23:37:18 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:18 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7caeb179-53e6-4a68-aa83-ebb4e5dd7bb9 tempest-SnapshotDependencyTests-770087735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420.78ab0cbb-05d0-4378-aac0-7fbf765ac5b5" returned: 0 in 0.362s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:18 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-7caeb179-53e6-4a68-aa83-ebb4e5dd7bb9 tempest-SnapshotDependencyTests-770087735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87f4cad9-73fd-4634-89a0-1eecc0587420(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:37:18 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c48a74-6eaa-4496-b414-7adfbfbe9aed]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:37:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7caeb179-53e6-4a68-aa83-ebb4e5dd7bb9 tempest-SnapshotDependencyTests-770087735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:18 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420 Jul 16 23:37:18 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:18 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-85fc5c10-3666-423a-beaf-312723ef3ede tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299 1073741824" returned: 0 in 0.415s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:18 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-85fc5c10-3666-423a-beaf-312723ef3ede tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:19 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299 Jul 16 23:37:19 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:19 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7caeb179-53e6-4a68-aa83-ebb4e5dd7bb9 tempest-SnapshotDependencyTests-770087735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420" returned: 0 in 0.397s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7caeb179-53e6-4a68-aa83-ebb4e5dd7bb9 tempest-SnapshotDependencyTests-770087735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420.78ab0cbb-05d0-4378-aac0-7fbf765ac5b5 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:19 devstack sudo[107401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420.78ab0cbb-05d0-4378-aac0-7fbf765ac5b5 Jul 16 23:37:19 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:19 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-85fc5c10-3666-423a-beaf-312723ef3ede tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299" returned: 0 in 0.259s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:19 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-85fc5c10-3666-423a-beaf-312723ef3ede tempest-ProjectMemberTests-1023405772 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:37:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-85fc5c10-3666-423a-beaf-312723ef3ede tempest-ProjectMemberTests-1023405772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:37:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-85fc5c10-3666-423a-beaf-312723ef3ede tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ed8811e-2f47-4779-a208-b4dc3ac1d629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7205b64-19cb-4003-8aa5-34e6d18ed299', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-85fc5c10-3666-423a-beaf-312723ef3ede tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68b50b99-059c-4cfb-8d88-11b28864737b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:19 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-85fc5c10-3666-423a-beaf-312723ef3ede tempest-ProjectMemberTests-1023405772 None] Volume volume-d7205b64-19cb-4003-8aa5-34e6d18ed299 (d7205b64-19cb-4003-8aa5-34e6d18ed299): created successfully Jul 16 23:37:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-85fc5c10-3666-423a-beaf-312723ef3ede tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68b50b99-059c-4cfb-8d88-11b28864737b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:19 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-85fc5c10-3666-423a-beaf-312723ef3ede tempest-ProjectMemberTests-1023405772 None] Flow 'volume_create_manager' (a3143bf1-5be4-4b07-bc13-3f3a03a71b9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:37:19 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-85fc5c10-3666-423a-beaf-312723ef3ede tempest-ProjectMemberTests-1023405772 None] Created volume successfully. Jul 16 23:37:19 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7caeb179-53e6-4a68-aa83-ebb4e5dd7bb9 tempest-SnapshotDependencyTests-770087735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420.78ab0cbb-05d0-4378-aac0-7fbf765ac5b5" returned: 0 in 0.374s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7caeb179-53e6-4a68-aa83-ebb4e5dd7bb9 tempest-SnapshotDependencyTests-770087735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420.78ab0cbb-05d0-4378-aac0-7fbf765ac5b5 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:19 devstack sudo[107408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420.78ab0cbb-05d0-4378-aac0-7fbf765ac5b5 Jul 16 23:37:19 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-63d937c3-14d8-423b-9bbe-2afc083c42c1 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:37:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-63d937c3-14d8-423b-9bbe-2afc083c42c1 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:37:19 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-63d937c3-14d8-423b-9bbe-2afc083c42c1 tempest-ProjectMemberTests-1023405772 None] Creating offline snapshot bf94990f-38ab-4d30-aeb4-93f6c4ea73de of volume d7205b64-19cb-4003-8aa5-34e6d18ed299 {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:37:19 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[621ae8dd-32e9-45dd-a2c0-e33f5e70836b]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:37:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-63d937c3-14d8-423b-9bbe-2afc083c42c1 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:19 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299 Jul 16 23:37:19 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:19 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:19 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7caeb179-53e6-4a68-aa83-ebb4e5dd7bb9 tempest-SnapshotDependencyTests-770087735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420.78ab0cbb-05d0-4378-aac0-7fbf765ac5b5" returned: 0 in 0.261s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:19 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-7caeb179-53e6-4a68-aa83-ebb4e5dd7bb9 tempest-SnapshotDependencyTests-770087735 None] Lock "cinder-quobyte-78ab0cbb-05d0-4378-aac0-7fbf765ac5b5" released by "_delete_snapshot" :: held 1.498s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:37:19 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-7caeb179-53e6-4a68-aa83-ebb4e5dd7bb9 tempest-SnapshotDependencyTests-770087735 None] Lock "cinder-quobyte-87f4cad9-73fd-4634-89a0-1eecc0587420" released by "delete_snapshot" :: held 1.519s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:37:19 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-7caeb179-53e6-4a68-aa83-ebb4e5dd7bb9 tempest-SnapshotDependencyTests-770087735 None] Created reservations ['85a2563e-dff1-4ccf-bc5f-263c80f285ea', 'a678e050-2806-4261-8848-d0c5c1f5a286', '4e4bbd1e-520c-4f4c-a4a3-7d3cdec62e85', 'bc362639-c2dc-4d77-adb2-b0d89f1fd15d'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:37:19 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-7caeb179-53e6-4a68-aa83-ebb4e5dd7bb9 tempest-SnapshotDependencyTests-770087735 None] Delete snapshot completed successfully. Jul 16 23:37:19 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-7caeb179-53e6-4a68-aa83-ebb4e5dd7bb9 tempest-SnapshotDependencyTests-770087735 None] Lock "cinder-78ab0cbb-05d0-4378-aac0-7fbf765ac5b5-delete_snapshot" released by "delete_snapshot" :: held 1.661s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:37:19 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-63d937c3-14d8-423b-9bbe-2afc083c42c1 tempest-ProjectMemberTests-1023405772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299" returned: 0 in 0.368s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-63d937c3-14d8-423b-9bbe-2afc083c42c1 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299.bf94990f-38ab-4d30-aeb4-93f6c4ea73de 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:20 devstack sudo[107416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299.bf94990f-38ab-4d30-aeb4-93f6c4ea73de 1G Jul 16 23:37:20 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:20 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-63d937c3-14d8-423b-9bbe-2afc083c42c1 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299.bf94990f-38ab-4d30-aeb4-93f6c4ea73de 1G" returned: 0 in 0.373s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-63d937c3-14d8-423b-9bbe-2afc083c42c1 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7205b64-19cb-4003-8aa5-34e6d18ed299 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299.bf94990f-38ab-4d30-aeb4-93f6c4ea73de {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:20 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7205b64-19cb-4003-8aa5-34e6d18ed299 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299.bf94990f-38ab-4d30-aeb4-93f6c4ea73de Jul 16 23:37:20 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:20 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4676d6b6-9568-463b-85cd-131c48a76093 tempest-SnapshotDependencyTests-770087735 None] Acquiring lock "cinder-87f4cad9-73fd-4634-89a0-1eecc0587420-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:37:20 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4676d6b6-9568-463b-85cd-131c48a76093 tempest-SnapshotDependencyTests-770087735 None] Lock "cinder-87f4cad9-73fd-4634-89a0-1eecc0587420-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:37:20 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4676d6b6-9568-463b-85cd-131c48a76093 tempest-SnapshotDependencyTests-770087735 None] Acquiring lock "cinder-quobyte-87f4cad9-73fd-4634-89a0-1eecc0587420" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:37:20 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4676d6b6-9568-463b-85cd-131c48a76093 tempest-SnapshotDependencyTests-770087735 None] Lock "cinder-quobyte-87f4cad9-73fd-4634-89a0-1eecc0587420" acquired by "delete_volume" :: waited 0.022s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:37:20 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fb4f21-e961-44b4-b53d-aa0508bb97d4]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:37:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4676d6b6-9568-463b-85cd-131c48a76093 tempest-SnapshotDependencyTests-770087735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:20 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420 Jul 16 23:37:20 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:20 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-63d937c3-14d8-423b-9bbe-2afc083c42c1 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7205b64-19cb-4003-8aa5-34e6d18ed299 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299.bf94990f-38ab-4d30-aeb4-93f6c4ea73de" returned: 0 in 0.325s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:20 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-63d937c3-14d8-423b-9bbe-2afc083c42c1 tempest-ProjectMemberTests-1023405772 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299.bf94990f-38ab-4d30-aeb4-93f6c4ea73de is being set with open permissions: ugo+rw Jul 16 23:37:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-63d937c3-14d8-423b-9bbe-2afc083c42c1 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299.bf94990f-38ab-4d30-aeb4-93f6c4ea73de {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:20 devstack sudo[107428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299.bf94990f-38ab-4d30-aeb4-93f6c4ea73de Jul 16 23:37:20 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:20 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4676d6b6-9568-463b-85cd-131c48a76093 tempest-SnapshotDependencyTests-770087735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420" returned: 0 in 0.371s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4676d6b6-9568-463b-85cd-131c48a76093 tempest-SnapshotDependencyTests-770087735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:20 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-63d937c3-14d8-423b-9bbe-2afc083c42c1 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299.bf94990f-38ab-4d30-aeb4-93f6c4ea73de" returned: 0 in 0.244s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:20 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420 Jul 16 23:37:20 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-63d937c3-14d8-423b-9bbe-2afc083c42c1 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:21 devstack sudo[107436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299.info Jul 16 23:37:21 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:21 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4676d6b6-9568-463b-85cd-131c48a76093 tempest-SnapshotDependencyTests-770087735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-87f4cad9-73fd-4634-89a0-1eecc0587420" returned: 0 in 0.246s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4676d6b6-9568-463b-85cd-131c48a76093 tempest-SnapshotDependencyTests-770087735 None] Lock "cinder-quobyte-87f4cad9-73fd-4634-89a0-1eecc0587420" released by "delete_volume" :: held 0.676s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:37:21 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-63d937c3-14d8-423b-9bbe-2afc083c42c1 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299.info" returned: 0 in 0.250s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:21 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-63d937c3-14d8-423b-9bbe-2afc083c42c1 tempest-ProjectMemberTests-1023405772 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299.info is being set with open permissions: ugo+rw Jul 16 23:37:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-63d937c3-14d8-423b-9bbe-2afc083c42c1 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:21 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299.info Jul 16 23:37:21 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:21 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-4676d6b6-9568-463b-85cd-131c48a76093 tempest-SnapshotDependencyTests-770087735 None] Created reservations ['63185481-4c0f-40c9-8128-1d1ed7c593a4', 'e4f0b027-fbfe-467b-b9af-ee692be3a31b', '7a92f7af-a84d-4d9d-afe2-5979e725ca74', 'fa878ffb-e4a3-4599-bfaf-4eecb4cc1024'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:37:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4676d6b6-9568-463b-85cd-131c48a76093 tempest-SnapshotDependencyTests-770087735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:37:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4676d6b6-9568-463b-85cd-131c48a76093 tempest-SnapshotDependencyTests-770087735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:37:21 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4676d6b6-9568-463b-85cd-131c48a76093 tempest-SnapshotDependencyTests-770087735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:37:21 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-4676d6b6-9568-463b-85cd-131c48a76093 tempest-SnapshotDependencyTests-770087735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:37:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-4676d6b6-9568-463b-85cd-131c48a76093 tempest-SnapshotDependencyTests-770087735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:37:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4676d6b6-9568-463b-85cd-131c48a76093 tempest-SnapshotDependencyTests-770087735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:21 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:37:21 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:21 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-63d937c3-14d8-423b-9bbe-2afc083c42c1 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299.info" returned: 0 in 0.243s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-63d937c3-14d8-423b-9bbe-2afc083c42c1 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.894s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:37:21 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-63d937c3-14d8-423b-9bbe-2afc083c42c1 tempest-ProjectMemberTests-1023405772 None] Create snapshot completed successfully Jul 16 23:37:21 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-4676d6b6-9568-463b-85cd-131c48a76093 tempest-SnapshotDependencyTests-770087735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.260s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:21 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-4676d6b6-9568-463b-85cd-131c48a76093 tempest-SnapshotDependencyTests-770087735 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:37:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f7867407-4d17-457b-acab-18c0b5b7597f tempest-SnapshotDependencyTests-770087735 None] Acquiring lock "cinder-3ee0fd70-fa37-4431-8972-16718e589e93-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:37:21 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-4676d6b6-9568-463b-85cd-131c48a76093 tempest-SnapshotDependencyTests-770087735 None] Deleted volume successfully. Jul 16 23:37:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f7867407-4d17-457b-acab-18c0b5b7597f tempest-SnapshotDependencyTests-770087735 None] Lock "cinder-3ee0fd70-fa37-4431-8972-16718e589e93-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:37:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-4676d6b6-9568-463b-85cd-131c48a76093 tempest-SnapshotDependencyTests-770087735 None] Lock "cinder-87f4cad9-73fd-4634-89a0-1eecc0587420-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:37:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f7867407-4d17-457b-acab-18c0b5b7597f tempest-SnapshotDependencyTests-770087735 None] Acquiring lock "cinder-quobyte-3ee0fd70-fa37-4431-8972-16718e589e93" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:37:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f7867407-4d17-457b-acab-18c0b5b7597f tempest-SnapshotDependencyTests-770087735 None] Lock "cinder-quobyte-3ee0fd70-fa37-4431-8972-16718e589e93" acquired by "delete_volume" :: waited 0.017s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:37:21 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a86589-abe9-45c0-8d77-e094c7b0160e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:37:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f7867407-4d17-457b-acab-18c0b5b7597f tempest-SnapshotDependencyTests-770087735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3ee0fd70-fa37-4431-8972-16718e589e93 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e12da894-8803-4812-95e6-605725747bd3 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-bf94990f-38ab-4d30-aeb4-93f6c4ea73de-delete_snapshot" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:37:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e12da894-8803-4812-95e6-605725747bd3 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-bf94990f-38ab-4d30-aeb4-93f6c4ea73de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:37:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e12da894-8803-4812-95e6-605725747bd3 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-quobyte-d7205b64-19cb-4003-8aa5-34e6d18ed299" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:37:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e12da894-8803-4812-95e6-605725747bd3 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-d7205b64-19cb-4003-8aa5-34e6d18ed299" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:37:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e12da894-8803-4812-95e6-605725747bd3 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-quobyte-bf94990f-38ab-4d30-aeb4-93f6c4ea73de" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:37:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e12da894-8803-4812-95e6-605725747bd3 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-bf94990f-38ab-4d30-aeb4-93f6c4ea73de" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:37:21 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-e12da894-8803-4812-95e6-605725747bd3 tempest-ProjectMemberTests-1023405772 None] Deleting offline snapshot bf94990f-38ab-4d30-aeb4-93f6c4ea73de of volume d7205b64-19cb-4003-8aa5-34e6d18ed299 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:37:21 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-e12da894-8803-4812-95e6-605725747bd3 tempest-ProjectMemberTests-1023405772 None] snapshot_file for this snap is: volume-d7205b64-19cb-4003-8aa5-34e6d18ed299.bf94990f-38ab-4d30-aeb4-93f6c4ea73de {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:37:21 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1244cbb-4c2f-434f-a38e-b8c1b615b8ea]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:37:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e12da894-8803-4812-95e6-605725747bd3 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299.bf94990f-38ab-4d30-aeb4-93f6c4ea73de {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:21 devstack sudo[107446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3ee0fd70-fa37-4431-8972-16718e589e93 Jul 16 23:37:21 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:21 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299.bf94990f-38ab-4d30-aeb4-93f6c4ea73de Jul 16 23:37:21 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:22 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f7867407-4d17-457b-acab-18c0b5b7597f tempest-SnapshotDependencyTests-770087735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3ee0fd70-fa37-4431-8972-16718e589e93" returned: 0 in 0.370s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f7867407-4d17-457b-acab-18c0b5b7597f tempest-SnapshotDependencyTests-770087735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3ee0fd70-fa37-4431-8972-16718e589e93 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:22 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3ee0fd70-fa37-4431-8972-16718e589e93 Jul 16 23:37:22 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:22 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e12da894-8803-4812-95e6-605725747bd3 tempest-ProjectMemberTests-1023405772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299.bf94990f-38ab-4d30-aeb4-93f6c4ea73de" returned: 0 in 0.381s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:22 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-e12da894-8803-4812-95e6-605725747bd3 tempest-ProjectMemberTests-1023405772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7205b64-19cb-4003-8aa5-34e6d18ed299(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:37:22 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abb302e-1c29-461d-ae4b-d9ff215be30d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:37:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e12da894-8803-4812-95e6-605725747bd3 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:22 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299 Jul 16 23:37:22 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:22 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f7867407-4d17-457b-acab-18c0b5b7597f tempest-SnapshotDependencyTests-770087735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-3ee0fd70-fa37-4431-8972-16718e589e93" returned: 0 in 0.266s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:22 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f7867407-4d17-457b-acab-18c0b5b7597f tempest-SnapshotDependencyTests-770087735 None] Lock "cinder-quobyte-3ee0fd70-fa37-4431-8972-16718e589e93" released by "delete_volume" :: held 0.674s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:37:22 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-f7867407-4d17-457b-acab-18c0b5b7597f tempest-SnapshotDependencyTests-770087735 None] Created reservations ['c4f090fd-541d-46a4-8e51-664d04801ba9', 'ee92a4ce-8124-41a8-af98-9734d49b0277', '57ec73a4-5ef7-4585-99ec-26d63e9afefd', '1725ff0a-79f7-4e4a-a44e-8102be8048e0'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:37:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f7867407-4d17-457b-acab-18c0b5b7597f tempest-SnapshotDependencyTests-770087735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:37:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f7867407-4d17-457b-acab-18c0b5b7597f tempest-SnapshotDependencyTests-770087735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:37:22 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f7867407-4d17-457b-acab-18c0b5b7597f tempest-SnapshotDependencyTests-770087735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:37:22 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-f7867407-4d17-457b-acab-18c0b5b7597f tempest-SnapshotDependencyTests-770087735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:37:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-f7867407-4d17-457b-acab-18c0b5b7597f tempest-SnapshotDependencyTests-770087735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:37:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f7867407-4d17-457b-acab-18c0b5b7597f tempest-SnapshotDependencyTests-770087735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:22 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:37:22 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:22 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e12da894-8803-4812-95e6-605725747bd3 tempest-ProjectMemberTests-1023405772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299" returned: 0 in 0.371s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e12da894-8803-4812-95e6-605725747bd3 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299.bf94990f-38ab-4d30-aeb4-93f6c4ea73de {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:22 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299.bf94990f-38ab-4d30-aeb4-93f6c4ea73de Jul 16 23:37:22 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:22 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-f7867407-4d17-457b-acab-18c0b5b7597f tempest-SnapshotDependencyTests-770087735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.271s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:22 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-f7867407-4d17-457b-acab-18c0b5b7597f tempest-SnapshotDependencyTests-770087735 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:37:22 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-f7867407-4d17-457b-acab-18c0b5b7597f tempest-SnapshotDependencyTests-770087735 None] Deleted volume successfully. Jul 16 23:37:22 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-f7867407-4d17-457b-acab-18c0b5b7597f tempest-SnapshotDependencyTests-770087735 None] Lock "cinder-3ee0fd70-fa37-4431-8972-16718e589e93-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:37:22 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e12da894-8803-4812-95e6-605725747bd3 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299.bf94990f-38ab-4d30-aeb4-93f6c4ea73de" returned: 0 in 0.364s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e12da894-8803-4812-95e6-605725747bd3 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299.bf94990f-38ab-4d30-aeb4-93f6c4ea73de {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:23 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299.bf94990f-38ab-4d30-aeb4-93f6c4ea73de Jul 16 23:37:23 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:23 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e12da894-8803-4812-95e6-605725747bd3 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299.bf94990f-38ab-4d30-aeb4-93f6c4ea73de" returned: 0 in 0.266s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:23 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e12da894-8803-4812-95e6-605725747bd3 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-bf94990f-38ab-4d30-aeb4-93f6c4ea73de" released by "_delete_snapshot" :: held 1.473s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:37:23 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e12da894-8803-4812-95e6-605725747bd3 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-d7205b64-19cb-4003-8aa5-34e6d18ed299" released by "delete_snapshot" :: held 1.496s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:37:23 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-e12da894-8803-4812-95e6-605725747bd3 tempest-ProjectMemberTests-1023405772 None] Created reservations ['71ef95b4-0892-4b99-9219-942bea7ea111', '50ba89eb-a12e-41ef-b8a0-40dde4cc8434', '752afbd2-a514-4844-9acf-758988d3d3ba', 'a9f30a45-a579-476f-a132-c19fba7f2ca1'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:37:23 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-e12da894-8803-4812-95e6-605725747bd3 tempest-ProjectMemberTests-1023405772 None] Delete snapshot completed successfully. Jul 16 23:37:23 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e12da894-8803-4812-95e6-605725747bd3 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-bf94990f-38ab-4d30-aeb4-93f6c4ea73de-delete_snapshot" released by "delete_snapshot" :: held 1.635s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:37:23 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-15869088-32ea-48ea-b837-a257e2cd91b5 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-d7205b64-19cb-4003-8aa5-34e6d18ed299-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:37:23 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-15869088-32ea-48ea-b837-a257e2cd91b5 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-d7205b64-19cb-4003-8aa5-34e6d18ed299-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:37:23 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-15869088-32ea-48ea-b837-a257e2cd91b5 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-quobyte-d7205b64-19cb-4003-8aa5-34e6d18ed299" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:37:24 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-15869088-32ea-48ea-b837-a257e2cd91b5 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-d7205b64-19cb-4003-8aa5-34e6d18ed299" acquired by "delete_volume" :: waited 0.019s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:37:24 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[89be70b5-be05-4eda-b62f-a397cd729a0e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:37:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-15869088-32ea-48ea-b837-a257e2cd91b5 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:24 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299 Jul 16 23:37:24 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:24 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-15869088-32ea-48ea-b837-a257e2cd91b5 tempest-ProjectMemberTests-1023405772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299" returned: 0 in 0.393s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-15869088-32ea-48ea-b837-a257e2cd91b5 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:24 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299 Jul 16 23:37:24 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:24 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-15869088-32ea-48ea-b837-a257e2cd91b5 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d7205b64-19cb-4003-8aa5-34e6d18ed299" returned: 0 in 0.245s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:24 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-15869088-32ea-48ea-b837-a257e2cd91b5 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-d7205b64-19cb-4003-8aa5-34e6d18ed299" released by "delete_volume" :: held 0.700s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:37:24 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-15869088-32ea-48ea-b837-a257e2cd91b5 tempest-ProjectMemberTests-1023405772 None] Created reservations ['59bc6506-428b-4391-980c-537d73f1edee', 'e823200f-d9d1-4f74-97a1-53a5bccb5d36', 'cba3d9c5-d901-48af-bf05-bb07bf65c8bf', 'fdba2c1d-d208-49c4-bfdf-1bab743554cb'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:37:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-15869088-32ea-48ea-b837-a257e2cd91b5 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:37:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-15869088-32ea-48ea-b837-a257e2cd91b5 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:37:24 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-15869088-32ea-48ea-b837-a257e2cd91b5 tempest-ProjectMemberTests-1023405772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:37:24 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-15869088-32ea-48ea-b837-a257e2cd91b5 tempest-ProjectMemberTests-1023405772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:37:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-15869088-32ea-48ea-b837-a257e2cd91b5 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:37:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-15869088-32ea-48ea-b837-a257e2cd91b5 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:24 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:37:24 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:25 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-15869088-32ea-48ea-b837-a257e2cd91b5 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.292s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:25 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-15869088-32ea-48ea-b837-a257e2cd91b5 tempest-ProjectMemberTests-1023405772 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:37:25 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-15869088-32ea-48ea-b837-a257e2cd91b5 tempest-ProjectMemberTests-1023405772 None] Deleted volume successfully. Jul 16 23:37:25 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-15869088-32ea-48ea-b837-a257e2cd91b5 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-d7205b64-19cb-4003-8aa5-34e6d18ed299-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:37:25 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-e679dd15-0bdc-4272-a6b9-ef3006b84769 tempest-ProjectMemberTests-1023405772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:37:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e679dd15-0bdc-4272-a6b9-ef3006b84769 tempest-ProjectMemberTests-1023405772 None] Flow 'volume_create_manager' (27823d25-ac56-46d7-a9ec-f87dab61d3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:37:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e679dd15-0bdc-4272-a6b9-ef3006b84769 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afd24080-0074-4637-8d20-f8733f7d3668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e679dd15-0bdc-4272-a6b9-ef3006b84769 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afd24080-0074-4637-8d20-f8733f7d3668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1203029906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83420f1c-7a3c-446f-951b-6c944e8f1345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b14a0052f8fb4344b121d3a20292b053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:37:26Z,use_quota=True,user_id='faa7527cbba84668895a85e3faa36efb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e679dd15-0bdc-4272-a6b9-ef3006b84769 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e72329c5-dc9e-4302-b283-03bc265fde38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e679dd15-0bdc-4272-a6b9-ef3006b84769 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e72329c5-dc9e-4302-b283-03bc265fde38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e679dd15-0bdc-4272-a6b9-ef3006b84769 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd6e3815-dafe-448e-9ec6-4974ad133fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e679dd15-0bdc-4272-a6b9-ef3006b84769 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd6e3815-dafe-448e-9ec6-4974ad133fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83420f1c-7a3c-446f-951b-6c944e8f1345', 'volume_name': 'volume-83420f1c-7a3c-446f-951b-6c944e8f1345', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e679dd15-0bdc-4272-a6b9-ef3006b84769 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18166b5e-6660-4993-a82b-1d7844d0b7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e679dd15-0bdc-4272-a6b9-ef3006b84769 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18166b5e-6660-4993-a82b-1d7844d0b7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:25 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e679dd15-0bdc-4272-a6b9-ef3006b84769 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ec6b60-3e94-4c55-a0e5-2667dab8a419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:25 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-e679dd15-0bdc-4272-a6b9-ef3006b84769 tempest-ProjectMemberTests-1023405772 None] Volume 83420f1c-7a3c-446f-951b-6c944e8f1345: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83420f1c-7a3c-446f-951b-6c944e8f1345', 'volume_size': 1} Jul 16 23:37:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e679dd15-0bdc-4272-a6b9-ef3006b84769 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:37:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e679dd15-0bdc-4272-a6b9-ef3006b84769 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:37:25 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e679dd15-0bdc-4272-a6b9-ef3006b84769 tempest-ProjectMemberTests-1023405772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1203029906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83420f1c-7a3c-446f-951b-6c944e8f1345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b14a0052f8fb4344b121d3a20292b053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:37:26Z,use_quota=True,user_id='faa7527cbba84668895a85e3faa36efb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:37:25 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-e679dd15-0bdc-4272-a6b9-ef3006b84769 tempest-ProjectMemberTests-1023405772 None] Creating volume 83420f1c-7a3c-446f-951b-6c944e8f1345 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:37:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e679dd15-0bdc-4272-a6b9-ef3006b84769 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:37:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e679dd15-0bdc-4272-a6b9-ef3006b84769 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:37:25 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e679dd15-0bdc-4272-a6b9-ef3006b84769 tempest-ProjectMemberTests-1023405772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:37:25 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e679dd15-0bdc-4272-a6b9-ef3006b84769 tempest-ProjectMemberTests-1023405772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:37:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e679dd15-0bdc-4272-a6b9-ef3006b84769 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:37:25 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e679dd15-0bdc-4272-a6b9-ef3006b84769 tempest-ProjectMemberTests-1023405772 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:37:25 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-e679dd15-0bdc-4272-a6b9-ef3006b84769 tempest-ProjectMemberTests-1023405772 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:37:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e679dd15-0bdc-4272-a6b9-ef3006b84769 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:25 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345 1073741824 Jul 16 23:37:25 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:26 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e679dd15-0bdc-4272-a6b9-ef3006b84769 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345 1073741824" returned: 0 in 0.471s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e679dd15-0bdc-4272-a6b9-ef3006b84769 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:26 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345 Jul 16 23:37:26 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:26 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e679dd15-0bdc-4272-a6b9-ef3006b84769 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345" returned: 0 in 0.289s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:26 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e679dd15-0bdc-4272-a6b9-ef3006b84769 tempest-ProjectMemberTests-1023405772 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:37:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e679dd15-0bdc-4272-a6b9-ef3006b84769 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:37:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e679dd15-0bdc-4272-a6b9-ef3006b84769 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ec6b60-3e94-4c55-a0e5-2667dab8a419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83420f1c-7a3c-446f-951b-6c944e8f1345', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e679dd15-0bdc-4272-a6b9-ef3006b84769 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55fba6d0-60cf-4866-9071-96c549459765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:26 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-e679dd15-0bdc-4272-a6b9-ef3006b84769 tempest-ProjectMemberTests-1023405772 None] Volume volume-83420f1c-7a3c-446f-951b-6c944e8f1345 (83420f1c-7a3c-446f-951b-6c944e8f1345): created successfully Jul 16 23:37:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e679dd15-0bdc-4272-a6b9-ef3006b84769 tempest-ProjectMemberTests-1023405772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55fba6d0-60cf-4866-9071-96c549459765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-e679dd15-0bdc-4272-a6b9-ef3006b84769 tempest-ProjectMemberTests-1023405772 None] Flow 'volume_create_manager' (27823d25-ac56-46d7-a9ec-f87dab61d3f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:37:26 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-e679dd15-0bdc-4272-a6b9-ef3006b84769 tempest-ProjectMemberTests-1023405772 None] Created volume successfully. Jul 16 23:37:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-13c058df-9af0-4761-934b-0334ae1070ba tempest-ProjectMemberTests-1023405772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:37:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-13c058df-9af0-4761-934b-0334ae1070ba tempest-ProjectMemberTests-1023405772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:37:27 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-13c058df-9af0-4761-934b-0334ae1070ba tempest-ProjectMemberTests-1023405772 None] Creating offline snapshot 653f9c3b-c30f-4745-899f-ec75cb09d4d5 of volume 83420f1c-7a3c-446f-951b-6c944e8f1345 {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:37:27 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[7815ff3b-9dda-48f2-9ada-e0ae9fb4e773]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:37:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-13c058df-9af0-4761-934b-0334ae1070ba tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:28 devstack sudo[107500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345 Jul 16 23:37:28 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:28 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-13c058df-9af0-4761-934b-0334ae1070ba tempest-ProjectMemberTests-1023405772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345" returned: 0 in 0.367s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-13c058df-9af0-4761-934b-0334ae1070ba tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345.653f9c3b-c30f-4745-899f-ec75cb09d4d5 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:28 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345.653f9c3b-c30f-4745-899f-ec75cb09d4d5 1G Jul 16 23:37:28 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:28 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-13c058df-9af0-4761-934b-0334ae1070ba tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345.653f9c3b-c30f-4745-899f-ec75cb09d4d5 1G" returned: 0 in 0.418s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-13c058df-9af0-4761-934b-0334ae1070ba tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83420f1c-7a3c-446f-951b-6c944e8f1345 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345.653f9c3b-c30f-4745-899f-ec75cb09d4d5 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:28 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83420f1c-7a3c-446f-951b-6c944e8f1345 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345.653f9c3b-c30f-4745-899f-ec75cb09d4d5 Jul 16 23:37:28 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:29 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-13c058df-9af0-4761-934b-0334ae1070ba tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83420f1c-7a3c-446f-951b-6c944e8f1345 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345.653f9c3b-c30f-4745-899f-ec75cb09d4d5" returned: 0 in 0.367s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:29 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-13c058df-9af0-4761-934b-0334ae1070ba tempest-ProjectMemberTests-1023405772 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345.653f9c3b-c30f-4745-899f-ec75cb09d4d5 is being set with open permissions: ugo+rw Jul 16 23:37:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-13c058df-9af0-4761-934b-0334ae1070ba tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345.653f9c3b-c30f-4745-899f-ec75cb09d4d5 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:29 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345.653f9c3b-c30f-4745-899f-ec75cb09d4d5 Jul 16 23:37:29 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:29 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-13c058df-9af0-4761-934b-0334ae1070ba tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345.653f9c3b-c30f-4745-899f-ec75cb09d4d5" returned: 0 in 0.255s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-13c058df-9af0-4761-934b-0334ae1070ba tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:29 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345.info Jul 16 23:37:29 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:29 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-13c058df-9af0-4761-934b-0334ae1070ba tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345.info" returned: 0 in 0.265s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:29 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-13c058df-9af0-4761-934b-0334ae1070ba tempest-ProjectMemberTests-1023405772 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345.info is being set with open permissions: ugo+rw Jul 16 23:37:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-13c058df-9af0-4761-934b-0334ae1070ba tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:29 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345.info Jul 16 23:37:29 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:29 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-13c058df-9af0-4761-934b-0334ae1070ba tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345.info" returned: 0 in 0.265s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-13c058df-9af0-4761-934b-0334ae1070ba tempest-ProjectMemberTests-1023405772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.026s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:37:29 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:SELECT=140,cinder:INSERT=58,cinder:UPDATE=182,cinder:DELETE=12 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:37:29 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:SELECT=143,cinder:UPDATE=195,cinder:DELETE=18,cinder:INSERT=42 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:37:29 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-13c058df-9af0-4761-934b-0334ae1070ba tempest-ProjectMemberTests-1023405772 None] Create snapshot completed successfully Jul 16 23:37:31 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ace11236-cd7a-4923-9850-a7a79e3a07b0 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-653f9c3b-c30f-4745-899f-ec75cb09d4d5-delete_snapshot" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:37:31 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ace11236-cd7a-4923-9850-a7a79e3a07b0 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-653f9c3b-c30f-4745-899f-ec75cb09d4d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:37:31 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ace11236-cd7a-4923-9850-a7a79e3a07b0 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-quobyte-83420f1c-7a3c-446f-951b-6c944e8f1345" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:37:31 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ace11236-cd7a-4923-9850-a7a79e3a07b0 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-83420f1c-7a3c-446f-951b-6c944e8f1345" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:37:31 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ace11236-cd7a-4923-9850-a7a79e3a07b0 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-quobyte-653f9c3b-c30f-4745-899f-ec75cb09d4d5" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:37:31 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ace11236-cd7a-4923-9850-a7a79e3a07b0 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-653f9c3b-c30f-4745-899f-ec75cb09d4d5" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:37:31 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-ace11236-cd7a-4923-9850-a7a79e3a07b0 tempest-ProjectMemberTests-1023405772 None] Deleting offline snapshot 653f9c3b-c30f-4745-899f-ec75cb09d4d5 of volume 83420f1c-7a3c-446f-951b-6c944e8f1345 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:37:31 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-ace11236-cd7a-4923-9850-a7a79e3a07b0 tempest-ProjectMemberTests-1023405772 None] snapshot_file for this snap is: volume-83420f1c-7a3c-446f-951b-6c944e8f1345.653f9c3b-c30f-4745-899f-ec75cb09d4d5 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:37:31 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd2a57b-bc45-4868-8e2a-4f5172eaea07]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:37:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ace11236-cd7a-4923-9850-a7a79e3a07b0 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345.653f9c3b-c30f-4745-899f-ec75cb09d4d5 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:31 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345.653f9c3b-c30f-4745-899f-ec75cb09d4d5 Jul 16 23:37:31 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:31 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ace11236-cd7a-4923-9850-a7a79e3a07b0 tempest-ProjectMemberTests-1023405772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345.653f9c3b-c30f-4745-899f-ec75cb09d4d5" returned: 0 in 0.362s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:31 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-ace11236-cd7a-4923-9850-a7a79e3a07b0 tempest-ProjectMemberTests-1023405772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83420f1c-7a3c-446f-951b-6c944e8f1345(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:37:31 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ebe31a-48b0-4141-bb65-ecd52b915a5e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:37:31 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ace11236-cd7a-4923-9850-a7a79e3a07b0 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:31 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345 Jul 16 23:37:31 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:32 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ace11236-cd7a-4923-9850-a7a79e3a07b0 tempest-ProjectMemberTests-1023405772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345" returned: 0 in 0.352s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ace11236-cd7a-4923-9850-a7a79e3a07b0 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345.653f9c3b-c30f-4745-899f-ec75cb09d4d5 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:32 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345.653f9c3b-c30f-4745-899f-ec75cb09d4d5 Jul 16 23:37:32 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:32 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ace11236-cd7a-4923-9850-a7a79e3a07b0 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345.653f9c3b-c30f-4745-899f-ec75cb09d4d5" returned: 0 in 0.310s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ace11236-cd7a-4923-9850-a7a79e3a07b0 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345.653f9c3b-c30f-4745-899f-ec75cb09d4d5 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:32 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345.653f9c3b-c30f-4745-899f-ec75cb09d4d5 Jul 16 23:37:32 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:32 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:32 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ace11236-cd7a-4923-9850-a7a79e3a07b0 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345.653f9c3b-c30f-4745-899f-ec75cb09d4d5" returned: 0 in 0.240s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:32 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ace11236-cd7a-4923-9850-a7a79e3a07b0 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-653f9c3b-c30f-4745-899f-ec75cb09d4d5" released by "_delete_snapshot" :: held 1.363s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:37:32 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ace11236-cd7a-4923-9850-a7a79e3a07b0 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-83420f1c-7a3c-446f-951b-6c944e8f1345" released by "delete_snapshot" :: held 1.388s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:37:32 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-ace11236-cd7a-4923-9850-a7a79e3a07b0 tempest-ProjectMemberTests-1023405772 None] Created reservations ['e62a765b-d803-45dc-a7be-2f5928dd8e4c', 'bd172244-53d6-4895-996c-8c57a9a01cd4', '08755420-533e-4e36-928e-0ec7febcf43a', '6428a47f-96c3-4d48-8755-7182a6d2d606'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:37:32 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-ace11236-cd7a-4923-9850-a7a79e3a07b0 tempest-ProjectMemberTests-1023405772 None] Delete snapshot completed successfully. Jul 16 23:37:32 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ace11236-cd7a-4923-9850-a7a79e3a07b0 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-653f9c3b-c30f-4745-899f-ec75cb09d4d5-delete_snapshot" released by "delete_snapshot" :: held 1.532s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:37:33 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e35f1ebc-a1c7-41e2-9370-781f14c17e10 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-83420f1c-7a3c-446f-951b-6c944e8f1345-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:37:33 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e35f1ebc-a1c7-41e2-9370-781f14c17e10 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-83420f1c-7a3c-446f-951b-6c944e8f1345-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:37:33 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e35f1ebc-a1c7-41e2-9370-781f14c17e10 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "cinder-quobyte-83420f1c-7a3c-446f-951b-6c944e8f1345" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:37:33 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e35f1ebc-a1c7-41e2-9370-781f14c17e10 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-83420f1c-7a3c-446f-951b-6c944e8f1345" acquired by "delete_volume" :: waited 0.014s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:37:33 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f2cf10-422d-4419-8e43-c0132f964064]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:37:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e35f1ebc-a1c7-41e2-9370-781f14c17e10 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:33 devstack sudo[107545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345 Jul 16 23:37:33 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:33 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e35f1ebc-a1c7-41e2-9370-781f14c17e10 tempest-ProjectMemberTests-1023405772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345" returned: 0 in 0.343s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:33 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e35f1ebc-a1c7-41e2-9370-781f14c17e10 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:33 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345 Jul 16 23:37:33 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:34 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:34 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e35f1ebc-a1c7-41e2-9370-781f14c17e10 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-83420f1c-7a3c-446f-951b-6c944e8f1345" returned: 0 in 0.243s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:34 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e35f1ebc-a1c7-41e2-9370-781f14c17e10 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-quobyte-83420f1c-7a3c-446f-951b-6c944e8f1345" released by "delete_volume" :: held 0.639s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:37:34 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-e35f1ebc-a1c7-41e2-9370-781f14c17e10 tempest-ProjectMemberTests-1023405772 None] Created reservations ['fae508c7-a16f-47d1-bcbf-51120c75257d', 'e73526a0-2a4e-46cf-86a2-4662989fb689', '1151c1e4-b86f-41de-949f-c61c68049481', 'd9d4d8ff-2c23-4a31-a76c-c5df07af48ba'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:37:34 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e35f1ebc-a1c7-41e2-9370-781f14c17e10 tempest-ProjectMemberTests-1023405772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:37:34 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e35f1ebc-a1c7-41e2-9370-781f14c17e10 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:37:34 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e35f1ebc-a1c7-41e2-9370-781f14c17e10 tempest-ProjectMemberTests-1023405772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:37:34 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-e35f1ebc-a1c7-41e2-9370-781f14c17e10 tempest-ProjectMemberTests-1023405772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:37:34 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e35f1ebc-a1c7-41e2-9370-781f14c17e10 tempest-ProjectMemberTests-1023405772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:37:34 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e35f1ebc-a1c7-41e2-9370-781f14c17e10 tempest-ProjectMemberTests-1023405772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:34 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:37:34 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:34 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:34 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e35f1ebc-a1c7-41e2-9370-781f14c17e10 tempest-ProjectMemberTests-1023405772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.247s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:34 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-e35f1ebc-a1c7-41e2-9370-781f14c17e10 tempest-ProjectMemberTests-1023405772 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:37:34 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-e35f1ebc-a1c7-41e2-9370-781f14c17e10 tempest-ProjectMemberTests-1023405772 None] Deleted volume successfully. Jul 16 23:37:34 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-e35f1ebc-a1c7-41e2-9370-781f14c17e10 tempest-ProjectMemberTests-1023405772 None] Lock "cinder-83420f1c-7a3c-446f-951b-6c944e8f1345-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:37:38 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b493f02-e54b-468a-bfe3-291fb4de342d tempest-ProjectReaderTests-1691574152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:37:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7b493f02-e54b-468a-bfe3-291fb4de342d tempest-ProjectReaderTests-1691574152 None] Flow 'volume_create_manager' (dea5d282-1cfd-4f17-b4aa-d9d09085ff0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:37:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7b493f02-e54b-468a-bfe3-291fb4de342d tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e6d979-982a-4912-9e41-9972a74dbf1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7b493f02-e54b-468a-bfe3-291fb4de342d tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e6d979-982a-4912-9e41-9972a74dbf1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-206646884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=820bb6a8-422f-4c01-b1b2-916fdb2c8956,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a04787a3c0924d698aa7e02fe7cb6772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:37:38Z,use_quota=True,user_id='77dc3beecc7d47488316b871ff7318e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7b493f02-e54b-468a-bfe3-291fb4de342d tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2aef496-cea5-44a4-b266-b368de3c069d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7b493f02-e54b-468a-bfe3-291fb4de342d tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2aef496-cea5-44a4-b266-b368de3c069d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7b493f02-e54b-468a-bfe3-291fb4de342d tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d4703cb-15a8-41e3-9be8-61b398390b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7b493f02-e54b-468a-bfe3-291fb4de342d tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d4703cb-15a8-41e3-9be8-61b398390b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '820bb6a8-422f-4c01-b1b2-916fdb2c8956', 'volume_name': 'volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7b493f02-e54b-468a-bfe3-291fb4de342d tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e896ac51-83c8-462b-a9c6-c03988db99c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7b493f02-e54b-468a-bfe3-291fb4de342d tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e896ac51-83c8-462b-a9c6-c03988db99c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7b493f02-e54b-468a-bfe3-291fb4de342d tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d47bad73-05f5-4826-be73-5038eb55bb7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:38 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-7b493f02-e54b-468a-bfe3-291fb4de342d tempest-ProjectReaderTests-1691574152 None] Volume 820bb6a8-422f-4c01-b1b2-916fdb2c8956: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956', 'volume_size': 1} Jul 16 23:37:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7b493f02-e54b-468a-bfe3-291fb4de342d tempest-ProjectReaderTests-1691574152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:37:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7b493f02-e54b-468a-bfe3-291fb4de342d tempest-ProjectReaderTests-1691574152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:37:38 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-7b493f02-e54b-468a-bfe3-291fb4de342d tempest-ProjectReaderTests-1691574152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-206646884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=820bb6a8-422f-4c01-b1b2-916fdb2c8956,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a04787a3c0924d698aa7e02fe7cb6772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:37:38Z,use_quota=True,user_id='77dc3beecc7d47488316b871ff7318e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:37:38 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-7b493f02-e54b-468a-bfe3-291fb4de342d tempest-ProjectReaderTests-1691574152 None] Creating volume 820bb6a8-422f-4c01-b1b2-916fdb2c8956 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:37:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7b493f02-e54b-468a-bfe3-291fb4de342d tempest-ProjectReaderTests-1691574152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:37:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7b493f02-e54b-468a-bfe3-291fb4de342d tempest-ProjectReaderTests-1691574152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:37:38 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-7b493f02-e54b-468a-bfe3-291fb4de342d tempest-ProjectReaderTests-1691574152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:37:38 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-7b493f02-e54b-468a-bfe3-291fb4de342d tempest-ProjectReaderTests-1691574152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:37:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7b493f02-e54b-468a-bfe3-291fb4de342d tempest-ProjectReaderTests-1691574152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:37:38 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-7b493f02-e54b-468a-bfe3-291fb4de342d tempest-ProjectReaderTests-1691574152 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:37:38 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-7b493f02-e54b-468a-bfe3-291fb4de342d tempest-ProjectReaderTests-1691574152 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:37:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7b493f02-e54b-468a-bfe3-291fb4de342d tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:38 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956 1073741824 Jul 16 23:37:38 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:38 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7b493f02-e54b-468a-bfe3-291fb4de342d tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956 1073741824" returned: 0 in 0.409s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7b493f02-e54b-468a-bfe3-291fb4de342d tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:38 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956 Jul 16 23:37:38 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:38 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7b493f02-e54b-468a-bfe3-291fb4de342d tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956" returned: 0 in 0.251s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:38 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-7b493f02-e54b-468a-bfe3-291fb4de342d tempest-ProjectReaderTests-1691574152 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:37:38 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7b493f02-e54b-468a-bfe3-291fb4de342d tempest-ProjectReaderTests-1691574152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:37:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7b493f02-e54b-468a-bfe3-291fb4de342d tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d47bad73-05f5-4826-be73-5038eb55bb7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7b493f02-e54b-468a-bfe3-291fb4de342d tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96a9bf40-a5a4-4a52-b50c-1c4e1fa757d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:38 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-7b493f02-e54b-468a-bfe3-291fb4de342d tempest-ProjectReaderTests-1691574152 None] Volume volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956 (820bb6a8-422f-4c01-b1b2-916fdb2c8956): created successfully Jul 16 23:37:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7b493f02-e54b-468a-bfe3-291fb4de342d tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96a9bf40-a5a4-4a52-b50c-1c4e1fa757d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:38 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-7b493f02-e54b-468a-bfe3-291fb4de342d tempest-ProjectReaderTests-1691574152 None] Flow 'volume_create_manager' (dea5d282-1cfd-4f17-b4aa-d9d09085ff0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:37:38 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-7b493f02-e54b-468a-bfe3-291fb4de342d tempest-ProjectReaderTests-1691574152 None] Created volume successfully. Jul 16 23:37:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-2688bddc-fffd-44e9-93f5-ed3a78ab4afe tempest-ProjectReaderTests-1691574152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:37:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-2688bddc-fffd-44e9-93f5-ed3a78ab4afe tempest-ProjectReaderTests-1691574152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:37:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-2688bddc-fffd-44e9-93f5-ed3a78ab4afe tempest-ProjectReaderTests-1691574152 None] Creating offline snapshot b3f560b3-b7be-42b2-9a7b-82198e128a5d of volume 820bb6a8-422f-4c01-b1b2-916fdb2c8956 {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:37:39 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[e850d1d2-e463-4907-b4b6-fe6a1448670c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:37:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2688bddc-fffd-44e9-93f5-ed3a78ab4afe tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:39 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956 Jul 16 23:37:39 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:39 devstack cinder-volume[87607]: DEBUG oslo_service.periodic_task [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:37:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:37:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:37:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:37:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:37:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:37:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:39 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:37:39 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:39 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2688bddc-fffd-44e9-93f5-ed3a78ab4afe tempest-ProjectReaderTests-1691574152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956" returned: 0 in 0.351s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2688bddc-fffd-44e9-93f5-ed3a78ab4afe tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956.b3f560b3-b7be-42b2-9a7b-82198e128a5d 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:39 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956.b3f560b3-b7be-42b2-9a7b-82198e128a5d 1G Jul 16 23:37:39 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:39 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.254s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:39 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:37:39 devstack cinder-volume[87607]: DEBUG oslo_service.periodic_task [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running periodic task VolumeManager._thread_info {{(pid=87607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:37:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] thread count: 28 {{(pid=87607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 23:37:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] thread info: [<_MainThread(MainThread, started 139090403627136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 23:37:40 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2688bddc-fffd-44e9-93f5-ed3a78ab4afe tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956.b3f560b3-b7be-42b2-9a7b-82198e128a5d 1G" returned: 0 in 0.382s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2688bddc-fffd-44e9-93f5-ed3a78ab4afe tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956.b3f560b3-b7be-42b2-9a7b-82198e128a5d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:40 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956.b3f560b3-b7be-42b2-9a7b-82198e128a5d Jul 16 23:37:40 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:40 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2688bddc-fffd-44e9-93f5-ed3a78ab4afe tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956.b3f560b3-b7be-42b2-9a7b-82198e128a5d" returned: 0 in 0.291s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:40 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-2688bddc-fffd-44e9-93f5-ed3a78ab4afe tempest-ProjectReaderTests-1691574152 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956.b3f560b3-b7be-42b2-9a7b-82198e128a5d is being set with open permissions: ugo+rw Jul 16 23:37:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2688bddc-fffd-44e9-93f5-ed3a78ab4afe tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956.b3f560b3-b7be-42b2-9a7b-82198e128a5d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:40 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956.b3f560b3-b7be-42b2-9a7b-82198e128a5d Jul 16 23:37:40 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:40 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2688bddc-fffd-44e9-93f5-ed3a78ab4afe tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956.b3f560b3-b7be-42b2-9a7b-82198e128a5d" returned: 0 in 0.244s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2688bddc-fffd-44e9-93f5-ed3a78ab4afe tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:40 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956.info Jul 16 23:37:40 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:40 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2688bddc-fffd-44e9-93f5-ed3a78ab4afe tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956.info" returned: 0 in 0.242s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:40 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-2688bddc-fffd-44e9-93f5-ed3a78ab4afe tempest-ProjectReaderTests-1691574152 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956.info is being set with open permissions: ugo+rw Jul 16 23:37:40 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2688bddc-fffd-44e9-93f5-ed3a78ab4afe tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:40 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956.info Jul 16 23:37:40 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:41 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-2688bddc-fffd-44e9-93f5-ed3a78ab4afe tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956.info" returned: 0 in 0.240s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-2688bddc-fffd-44e9-93f5-ed3a78ab4afe tempest-ProjectReaderTests-1691574152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.827s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:37:41 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-2688bddc-fffd-44e9-93f5-ed3a78ab4afe tempest-ProjectReaderTests-1691574152 None] Create snapshot completed successfully Jul 16 23:37:41 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fefd9957-3f61-40f9-b63b-7c46f5f6011b tempest-ProjectReaderTests-1691574152 None] Acquiring lock "cinder-b3f560b3-b7be-42b2-9a7b-82198e128a5d-delete_snapshot" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:37:41 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fefd9957-3f61-40f9-b63b-7c46f5f6011b tempest-ProjectReaderTests-1691574152 None] Lock "cinder-b3f560b3-b7be-42b2-9a7b-82198e128a5d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:37:41 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fefd9957-3f61-40f9-b63b-7c46f5f6011b tempest-ProjectReaderTests-1691574152 None] Acquiring lock "cinder-quobyte-820bb6a8-422f-4c01-b1b2-916fdb2c8956" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:37:41 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fefd9957-3f61-40f9-b63b-7c46f5f6011b tempest-ProjectReaderTests-1691574152 None] Lock "cinder-quobyte-820bb6a8-422f-4c01-b1b2-916fdb2c8956" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:37:41 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fefd9957-3f61-40f9-b63b-7c46f5f6011b tempest-ProjectReaderTests-1691574152 None] Acquiring lock "cinder-quobyte-b3f560b3-b7be-42b2-9a7b-82198e128a5d" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:37:41 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fefd9957-3f61-40f9-b63b-7c46f5f6011b tempest-ProjectReaderTests-1691574152 None] Lock "cinder-quobyte-b3f560b3-b7be-42b2-9a7b-82198e128a5d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:37:41 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-fefd9957-3f61-40f9-b63b-7c46f5f6011b tempest-ProjectReaderTests-1691574152 None] Deleting offline snapshot b3f560b3-b7be-42b2-9a7b-82198e128a5d of volume 820bb6a8-422f-4c01-b1b2-916fdb2c8956 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:37:41 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-fefd9957-3f61-40f9-b63b-7c46f5f6011b tempest-ProjectReaderTests-1691574152 None] snapshot_file for this snap is: volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956.b3f560b3-b7be-42b2-9a7b-82198e128a5d {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:37:41 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[58889f84-6b25-45e0-a675-b552b8b7d785]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:37:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fefd9957-3f61-40f9-b63b-7c46f5f6011b tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956.b3f560b3-b7be-42b2-9a7b-82198e128a5d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:41 devstack sudo[107593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956.b3f560b3-b7be-42b2-9a7b-82198e128a5d Jul 16 23:37:41 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:41 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fefd9957-3f61-40f9-b63b-7c46f5f6011b tempest-ProjectReaderTests-1691574152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956.b3f560b3-b7be-42b2-9a7b-82198e128a5d" returned: 0 in 0.363s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:41 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-fefd9957-3f61-40f9-b63b-7c46f5f6011b tempest-ProjectReaderTests-1691574152 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:37:41 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[00542406-737a-4d52-a8b5-e5b4ac7db082]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:37:41 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fefd9957-3f61-40f9-b63b-7c46f5f6011b tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:42 devstack sudo[107598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956 Jul 16 23:37:42 devstack sudo[107598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:42 devstack sudo[107598]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fefd9957-3f61-40f9-b63b-7c46f5f6011b tempest-ProjectReaderTests-1691574152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956" returned: 0 in 0.372s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fefd9957-3f61-40f9-b63b-7c46f5f6011b tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956.b3f560b3-b7be-42b2-9a7b-82198e128a5d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:42 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956.b3f560b3-b7be-42b2-9a7b-82198e128a5d Jul 16 23:37:42 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:42 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fefd9957-3f61-40f9-b63b-7c46f5f6011b tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956.b3f560b3-b7be-42b2-9a7b-82198e128a5d" returned: 0 in 0.335s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fefd9957-3f61-40f9-b63b-7c46f5f6011b tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956.b3f560b3-b7be-42b2-9a7b-82198e128a5d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:42 devstack sudo[107644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956.b3f560b3-b7be-42b2-9a7b-82198e128a5d Jul 16 23:37:42 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:42 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:42 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-fefd9957-3f61-40f9-b63b-7c46f5f6011b tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956.b3f560b3-b7be-42b2-9a7b-82198e128a5d" returned: 0 in 0.243s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:42 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fefd9957-3f61-40f9-b63b-7c46f5f6011b tempest-ProjectReaderTests-1691574152 None] Lock "cinder-quobyte-b3f560b3-b7be-42b2-9a7b-82198e128a5d" released by "_delete_snapshot" :: held 1.403s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:37:42 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fefd9957-3f61-40f9-b63b-7c46f5f6011b tempest-ProjectReaderTests-1691574152 None] Lock "cinder-quobyte-820bb6a8-422f-4c01-b1b2-916fdb2c8956" released by "delete_snapshot" :: held 1.427s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:37:43 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-fefd9957-3f61-40f9-b63b-7c46f5f6011b tempest-ProjectReaderTests-1691574152 None] Created reservations ['0a34b03b-0b74-473e-84d0-c9adf3ef2a28', '4d0e230b-6a45-4723-8e85-80f81b2c6d0a', '2094764d-a7c4-4d0a-99e2-45eaf55adb8e', '54663574-78c7-4edf-82da-9c7cbe922266'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:37:43 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-fefd9957-3f61-40f9-b63b-7c46f5f6011b tempest-ProjectReaderTests-1691574152 None] Delete snapshot completed successfully. Jul 16 23:37:43 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-fefd9957-3f61-40f9-b63b-7c46f5f6011b tempest-ProjectReaderTests-1691574152 None] Lock "cinder-b3f560b3-b7be-42b2-9a7b-82198e128a5d-delete_snapshot" released by "delete_snapshot" :: held 1.567s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:37:43 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c5a5f088-b069-42a8-ac18-7052a8e71303 tempest-ProjectReaderTests-1691574152 None] Acquiring lock "cinder-820bb6a8-422f-4c01-b1b2-916fdb2c8956-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:37:43 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c5a5f088-b069-42a8-ac18-7052a8e71303 tempest-ProjectReaderTests-1691574152 None] Lock "cinder-820bb6a8-422f-4c01-b1b2-916fdb2c8956-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:37:43 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c5a5f088-b069-42a8-ac18-7052a8e71303 tempest-ProjectReaderTests-1691574152 None] Acquiring lock "cinder-quobyte-820bb6a8-422f-4c01-b1b2-916fdb2c8956" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:37:43 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c5a5f088-b069-42a8-ac18-7052a8e71303 tempest-ProjectReaderTests-1691574152 None] Lock "cinder-quobyte-820bb6a8-422f-4c01-b1b2-916fdb2c8956" acquired by "delete_volume" :: waited 0.014s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:37:43 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d646f3-582b-4d13-8218-25dcb600c348]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:37:43 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c5a5f088-b069-42a8-ac18-7052a8e71303 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:43 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956 Jul 16 23:37:43 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:44 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c5a5f088-b069-42a8-ac18-7052a8e71303 tempest-ProjectReaderTests-1691574152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956" returned: 0 in 0.349s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c5a5f088-b069-42a8-ac18-7052a8e71303 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:44 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956 Jul 16 23:37:44 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:44 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c5a5f088-b069-42a8-ac18-7052a8e71303 tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-820bb6a8-422f-4c01-b1b2-916fdb2c8956" returned: 0 in 0.236s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:44 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c5a5f088-b069-42a8-ac18-7052a8e71303 tempest-ProjectReaderTests-1691574152 None] Lock "cinder-quobyte-820bb6a8-422f-4c01-b1b2-916fdb2c8956" released by "delete_volume" :: held 0.640s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:37:44 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-c5a5f088-b069-42a8-ac18-7052a8e71303 tempest-ProjectReaderTests-1691574152 None] Created reservations ['d8f818a3-adee-42f7-9000-a60902d51960', '45c42f19-b8f6-45db-b3ec-b891e978e394', 'cde43826-c422-4ea4-92bb-7b6b1d2b6018', '615b8906-ce86-4d7c-a7cd-8b87407e1517'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:37:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c5a5f088-b069-42a8-ac18-7052a8e71303 tempest-ProjectReaderTests-1691574152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:37:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c5a5f088-b069-42a8-ac18-7052a8e71303 tempest-ProjectReaderTests-1691574152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:37:44 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-c5a5f088-b069-42a8-ac18-7052a8e71303 tempest-ProjectReaderTests-1691574152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:37:44 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-c5a5f088-b069-42a8-ac18-7052a8e71303 tempest-ProjectReaderTests-1691574152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:37:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-c5a5f088-b069-42a8-ac18-7052a8e71303 tempest-ProjectReaderTests-1691574152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:37:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c5a5f088-b069-42a8-ac18-7052a8e71303 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:44 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:37:44 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:44 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:44 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c5a5f088-b069-42a8-ac18-7052a8e71303 tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.251s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:44 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-c5a5f088-b069-42a8-ac18-7052a8e71303 tempest-ProjectReaderTests-1691574152 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:37:44 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-c5a5f088-b069-42a8-ac18-7052a8e71303 tempest-ProjectReaderTests-1691574152 None] Deleted volume successfully. Jul 16 23:37:44 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c5a5f088-b069-42a8-ac18-7052a8e71303 tempest-ProjectReaderTests-1691574152 None] Lock "cinder-820bb6a8-422f-4c01-b1b2-916fdb2c8956-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:37:45 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-45b84dff-c840-4e4a-ad62-91dfa66fafb2 tempest-ProjectReaderTests-1691574152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:37:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-45b84dff-c840-4e4a-ad62-91dfa66fafb2 tempest-ProjectReaderTests-1691574152 None] Flow 'volume_create_manager' (5d0f0943-0e65-437f-bd1e-170679190241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:37:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-45b84dff-c840-4e4a-ad62-91dfa66fafb2 tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea9620c7-042a-4112-8eea-47d7fa83f7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-45b84dff-c840-4e4a-ad62-91dfa66fafb2 tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea9620c7-042a-4112-8eea-47d7fa83f7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-718943218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=965c1294-4e82-465e-b48e-a86f3ff75f24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a04787a3c0924d698aa7e02fe7cb6772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:37:45Z,use_quota=True,user_id='77dc3beecc7d47488316b871ff7318e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-45b84dff-c840-4e4a-ad62-91dfa66fafb2 tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2149444c-1827-4a64-bf26-d79b57d99c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-45b84dff-c840-4e4a-ad62-91dfa66fafb2 tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2149444c-1827-4a64-bf26-d79b57d99c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-45b84dff-c840-4e4a-ad62-91dfa66fafb2 tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (030c7fb1-07e2-4805-bba4-9deb47437cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-45b84dff-c840-4e4a-ad62-91dfa66fafb2 tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (030c7fb1-07e2-4805-bba4-9deb47437cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '965c1294-4e82-465e-b48e-a86f3ff75f24', 'volume_name': 'volume-965c1294-4e82-465e-b48e-a86f3ff75f24', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-45b84dff-c840-4e4a-ad62-91dfa66fafb2 tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05c6a00f-e011-49b2-88c6-105033685ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-45b84dff-c840-4e4a-ad62-91dfa66fafb2 tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05c6a00f-e011-49b2-88c6-105033685ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:45 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-45b84dff-c840-4e4a-ad62-91dfa66fafb2 tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58d8b21f-1758-4241-a77d-1e8080fb6f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:45 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-45b84dff-c840-4e4a-ad62-91dfa66fafb2 tempest-ProjectReaderTests-1691574152 None] Volume 965c1294-4e82-465e-b48e-a86f3ff75f24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-965c1294-4e82-465e-b48e-a86f3ff75f24', 'volume_size': 1} Jul 16 23:37:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-45b84dff-c840-4e4a-ad62-91dfa66fafb2 tempest-ProjectReaderTests-1691574152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:37:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-45b84dff-c840-4e4a-ad62-91dfa66fafb2 tempest-ProjectReaderTests-1691574152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:37:45 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-45b84dff-c840-4e4a-ad62-91dfa66fafb2 tempest-ProjectReaderTests-1691574152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-718943218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=965c1294-4e82-465e-b48e-a86f3ff75f24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a04787a3c0924d698aa7e02fe7cb6772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:37:45Z,use_quota=True,user_id='77dc3beecc7d47488316b871ff7318e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:37:45 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-45b84dff-c840-4e4a-ad62-91dfa66fafb2 tempest-ProjectReaderTests-1691574152 None] Creating volume 965c1294-4e82-465e-b48e-a86f3ff75f24 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:37:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-45b84dff-c840-4e4a-ad62-91dfa66fafb2 tempest-ProjectReaderTests-1691574152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:37:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-45b84dff-c840-4e4a-ad62-91dfa66fafb2 tempest-ProjectReaderTests-1691574152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:37:45 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-45b84dff-c840-4e4a-ad62-91dfa66fafb2 tempest-ProjectReaderTests-1691574152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:37:45 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-45b84dff-c840-4e4a-ad62-91dfa66fafb2 tempest-ProjectReaderTests-1691574152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:37:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-45b84dff-c840-4e4a-ad62-91dfa66fafb2 tempest-ProjectReaderTests-1691574152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:37:45 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-45b84dff-c840-4e4a-ad62-91dfa66fafb2 tempest-ProjectReaderTests-1691574152 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:37:45 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-45b84dff-c840-4e4a-ad62-91dfa66fafb2 tempest-ProjectReaderTests-1691574152 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:37:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-45b84dff-c840-4e4a-ad62-91dfa66fafb2 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:45 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24 1073741824 Jul 16 23:37:45 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:45 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-45b84dff-c840-4e4a-ad62-91dfa66fafb2 tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24 1073741824" returned: 0 in 0.392s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-45b84dff-c840-4e4a-ad62-91dfa66fafb2 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:45 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24 Jul 16 23:37:45 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:45 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-45b84dff-c840-4e4a-ad62-91dfa66fafb2 tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24" returned: 0 in 0.237s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:45 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-45b84dff-c840-4e4a-ad62-91dfa66fafb2 tempest-ProjectReaderTests-1691574152 None] <== create_volume: return (668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:37:45 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-45b84dff-c840-4e4a-ad62-91dfa66fafb2 tempest-ProjectReaderTests-1691574152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.671s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:37:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-45b84dff-c840-4e4a-ad62-91dfa66fafb2 tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58d8b21f-1758-4241-a77d-1e8080fb6f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-965c1294-4e82-465e-b48e-a86f3ff75f24', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-45b84dff-c840-4e4a-ad62-91dfa66fafb2 tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10885399-9197-4063-8fc2-e1ccfe416ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:46 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-45b84dff-c840-4e4a-ad62-91dfa66fafb2 tempest-ProjectReaderTests-1691574152 None] Volume volume-965c1294-4e82-465e-b48e-a86f3ff75f24 (965c1294-4e82-465e-b48e-a86f3ff75f24): created successfully Jul 16 23:37:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-45b84dff-c840-4e4a-ad62-91dfa66fafb2 tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10885399-9197-4063-8fc2-e1ccfe416ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:46 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-45b84dff-c840-4e4a-ad62-91dfa66fafb2 tempest-ProjectReaderTests-1691574152 None] Flow 'volume_create_manager' (5d0f0943-0e65-437f-bd1e-170679190241) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:37:46 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-45b84dff-c840-4e4a-ad62-91dfa66fafb2 tempest-ProjectReaderTests-1691574152 None] Created volume successfully. Jul 16 23:37:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7c8edc94-2ccc-4585-a062-b0f085fbb60a tempest-ProjectReaderTests-1691574152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:37:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7c8edc94-2ccc-4585-a062-b0f085fbb60a tempest-ProjectReaderTests-1691574152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:37:46 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-7c8edc94-2ccc-4585-a062-b0f085fbb60a tempest-ProjectReaderTests-1691574152 None] Creating offline snapshot a95f8007-00c4-4492-845f-7059b046e984 of volume 965c1294-4e82-465e-b48e-a86f3ff75f24 {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:37:46 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[837b8756-7b8b-413d-9f76-327acf88b9cd]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:37:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7c8edc94-2ccc-4585-a062-b0f085fbb60a tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:46 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24 Jul 16 23:37:46 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:46 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7c8edc94-2ccc-4585-a062-b0f085fbb60a tempest-ProjectReaderTests-1691574152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24" returned: 0 in 0.343s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:46 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7c8edc94-2ccc-4585-a062-b0f085fbb60a tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24.a95f8007-00c4-4492-845f-7059b046e984 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:46 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24.a95f8007-00c4-4492-845f-7059b046e984 1G Jul 16 23:37:46 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:47 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7c8edc94-2ccc-4585-a062-b0f085fbb60a tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24.a95f8007-00c4-4492-845f-7059b046e984 1G" returned: 0 in 0.376s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7c8edc94-2ccc-4585-a062-b0f085fbb60a tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-965c1294-4e82-465e-b48e-a86f3ff75f24 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24.a95f8007-00c4-4492-845f-7059b046e984 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:47 devstack sudo[107680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-965c1294-4e82-465e-b48e-a86f3ff75f24 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24.a95f8007-00c4-4492-845f-7059b046e984 Jul 16 23:37:47 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:47 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7c8edc94-2ccc-4585-a062-b0f085fbb60a tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-965c1294-4e82-465e-b48e-a86f3ff75f24 -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24.a95f8007-00c4-4492-845f-7059b046e984" returned: 0 in 0.275s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:47 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-7c8edc94-2ccc-4585-a062-b0f085fbb60a tempest-ProjectReaderTests-1691574152 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24.a95f8007-00c4-4492-845f-7059b046e984 is being set with open permissions: ugo+rw Jul 16 23:37:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7c8edc94-2ccc-4585-a062-b0f085fbb60a tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24.a95f8007-00c4-4492-845f-7059b046e984 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:47 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24.a95f8007-00c4-4492-845f-7059b046e984 Jul 16 23:37:47 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:47 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7c8edc94-2ccc-4585-a062-b0f085fbb60a tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24.a95f8007-00c4-4492-845f-7059b046e984" returned: 0 in 0.237s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7c8edc94-2ccc-4585-a062-b0f085fbb60a tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:47 devstack sudo[107689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24.info Jul 16 23:37:47 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:47 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7c8edc94-2ccc-4585-a062-b0f085fbb60a tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24.info" returned: 0 in 0.241s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:47 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-7c8edc94-2ccc-4585-a062-b0f085fbb60a tempest-ProjectReaderTests-1691574152 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24.info is being set with open permissions: ugo+rw Jul 16 23:37:47 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7c8edc94-2ccc-4585-a062-b0f085fbb60a tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:47 devstack sudo[107692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24.info Jul 16 23:37:47 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:48 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7c8edc94-2ccc-4585-a062-b0f085fbb60a tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24.info" returned: 0 in 0.238s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7c8edc94-2ccc-4585-a062-b0f085fbb60a tempest-ProjectReaderTests-1691574152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.782s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:37:48 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-7c8edc94-2ccc-4585-a062-b0f085fbb60a tempest-ProjectReaderTests-1691574152 None] Create snapshot completed successfully Jul 16 23:37:48 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-62c85d7a-1b85-4a2e-9aaf-dd4086205c9f tempest-ProjectReaderTests-1691574152 None] Acquiring lock "cinder-a95f8007-00c4-4492-845f-7059b046e984-delete_snapshot" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:37:48 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-62c85d7a-1b85-4a2e-9aaf-dd4086205c9f tempest-ProjectReaderTests-1691574152 None] Lock "cinder-a95f8007-00c4-4492-845f-7059b046e984-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:37:48 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-62c85d7a-1b85-4a2e-9aaf-dd4086205c9f tempest-ProjectReaderTests-1691574152 None] Acquiring lock "cinder-quobyte-965c1294-4e82-465e-b48e-a86f3ff75f24" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:37:48 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-62c85d7a-1b85-4a2e-9aaf-dd4086205c9f tempest-ProjectReaderTests-1691574152 None] Lock "cinder-quobyte-965c1294-4e82-465e-b48e-a86f3ff75f24" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:37:48 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-62c85d7a-1b85-4a2e-9aaf-dd4086205c9f tempest-ProjectReaderTests-1691574152 None] Acquiring lock "cinder-quobyte-a95f8007-00c4-4492-845f-7059b046e984" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:37:48 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-62c85d7a-1b85-4a2e-9aaf-dd4086205c9f tempest-ProjectReaderTests-1691574152 None] Lock "cinder-quobyte-a95f8007-00c4-4492-845f-7059b046e984" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:37:48 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-62c85d7a-1b85-4a2e-9aaf-dd4086205c9f tempest-ProjectReaderTests-1691574152 None] Deleting offline snapshot a95f8007-00c4-4492-845f-7059b046e984 of volume 965c1294-4e82-465e-b48e-a86f3ff75f24 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:37:48 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-62c85d7a-1b85-4a2e-9aaf-dd4086205c9f tempest-ProjectReaderTests-1691574152 None] snapshot_file for this snap is: volume-965c1294-4e82-465e-b48e-a86f3ff75f24.a95f8007-00c4-4492-845f-7059b046e984 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:37:48 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff30dfa2-14ce-4c58-8072-e7124894ed56]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:37:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-62c85d7a-1b85-4a2e-9aaf-dd4086205c9f tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24.a95f8007-00c4-4492-845f-7059b046e984 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:48 devstack sudo[107695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24.a95f8007-00c4-4492-845f-7059b046e984 Jul 16 23:37:48 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:48 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-62c85d7a-1b85-4a2e-9aaf-dd4086205c9f tempest-ProjectReaderTests-1691574152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24.a95f8007-00c4-4492-845f-7059b046e984" returned: 0 in 0.339s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:48 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-62c85d7a-1b85-4a2e-9aaf-dd4086205c9f tempest-ProjectReaderTests-1691574152 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-965c1294-4e82-465e-b48e-a86f3ff75f24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:37:48 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[45612686-8af6-42fa-a1ea-566acfd72971]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:37:48 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-62c85d7a-1b85-4a2e-9aaf-dd4086205c9f tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:49 devstack sudo[107700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24 Jul 16 23:37:49 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:49 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-62c85d7a-1b85-4a2e-9aaf-dd4086205c9f tempest-ProjectReaderTests-1691574152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24" returned: 0 in 0.341s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-62c85d7a-1b85-4a2e-9aaf-dd4086205c9f tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24.a95f8007-00c4-4492-845f-7059b046e984 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:49 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24.a95f8007-00c4-4492-845f-7059b046e984 Jul 16 23:37:49 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:49 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-62c85d7a-1b85-4a2e-9aaf-dd4086205c9f tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24.a95f8007-00c4-4492-845f-7059b046e984" returned: 0 in 0.315s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-62c85d7a-1b85-4a2e-9aaf-dd4086205c9f tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24.a95f8007-00c4-4492-845f-7059b046e984 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:49 devstack sudo[107711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24.a95f8007-00c4-4492-845f-7059b046e984 Jul 16 23:37:49 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:49 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:49 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-62c85d7a-1b85-4a2e-9aaf-dd4086205c9f tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24.a95f8007-00c4-4492-845f-7059b046e984" returned: 0 in 0.239s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:49 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-62c85d7a-1b85-4a2e-9aaf-dd4086205c9f tempest-ProjectReaderTests-1691574152 None] Lock "cinder-quobyte-a95f8007-00c4-4492-845f-7059b046e984" released by "_delete_snapshot" :: held 1.313s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:37:49 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-62c85d7a-1b85-4a2e-9aaf-dd4086205c9f tempest-ProjectReaderTests-1691574152 None] Lock "cinder-quobyte-965c1294-4e82-465e-b48e-a86f3ff75f24" released by "delete_snapshot" :: held 1.334s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:37:49 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-62c85d7a-1b85-4a2e-9aaf-dd4086205c9f tempest-ProjectReaderTests-1691574152 None] Created reservations ['6977f545-c90a-40c5-932f-5e9b7a265636', '4c448192-560b-4843-be98-cdb5bd286304', '3b284dcb-22b3-48f2-831b-b7751fa90bd9', '2b83240f-59a1-4954-8915-fee76dd294ea'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:37:49 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-62c85d7a-1b85-4a2e-9aaf-dd4086205c9f tempest-ProjectReaderTests-1691574152 None] Delete snapshot completed successfully. Jul 16 23:37:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-62c85d7a-1b85-4a2e-9aaf-dd4086205c9f tempest-ProjectReaderTests-1691574152 None] Lock "cinder-a95f8007-00c4-4492-845f-7059b046e984-delete_snapshot" released by "delete_snapshot" :: held 1.463s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:37:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b6d2392f-2c96-493a-84c3-47104bc8dbc2 tempest-ProjectReaderTests-1691574152 None] Acquiring lock "cinder-965c1294-4e82-465e-b48e-a86f3ff75f24-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:37:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b6d2392f-2c96-493a-84c3-47104bc8dbc2 tempest-ProjectReaderTests-1691574152 None] Lock "cinder-965c1294-4e82-465e-b48e-a86f3ff75f24-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:37:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b6d2392f-2c96-493a-84c3-47104bc8dbc2 tempest-ProjectReaderTests-1691574152 None] Acquiring lock "cinder-quobyte-965c1294-4e82-465e-b48e-a86f3ff75f24" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:37:50 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b6d2392f-2c96-493a-84c3-47104bc8dbc2 tempest-ProjectReaderTests-1691574152 None] Lock "cinder-quobyte-965c1294-4e82-465e-b48e-a86f3ff75f24" acquired by "delete_volume" :: waited 0.014s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:37:50 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[74563b0f-113d-4118-a0f6-a64ffb74afd6]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:37:50 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b6d2392f-2c96-493a-84c3-47104bc8dbc2 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:50 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24 Jul 16 23:37:50 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:51 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b6d2392f-2c96-493a-84c3-47104bc8dbc2 tempest-ProjectReaderTests-1691574152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24" returned: 0 in 0.357s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b6d2392f-2c96-493a-84c3-47104bc8dbc2 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:51 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24 Jul 16 23:37:51 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:51 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b6d2392f-2c96-493a-84c3-47104bc8dbc2 tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-965c1294-4e82-465e-b48e-a86f3ff75f24" returned: 0 in 0.240s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:51 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b6d2392f-2c96-493a-84c3-47104bc8dbc2 tempest-ProjectReaderTests-1691574152 None] Lock "cinder-quobyte-965c1294-4e82-465e-b48e-a86f3ff75f24" released by "delete_volume" :: held 0.647s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:37:51 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-b6d2392f-2c96-493a-84c3-47104bc8dbc2 tempest-ProjectReaderTests-1691574152 None] Created reservations ['8bcdb032-9b5b-4a89-a49e-e5cc579194f8', 'a09c4780-db3e-482a-a803-aaf0b0944df9', '018ebaaf-edec-448f-808e-3ea73e33e3da', 'f848d6e4-8e2b-45be-808b-009c416b12ad'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:37:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b6d2392f-2c96-493a-84c3-47104bc8dbc2 tempest-ProjectReaderTests-1691574152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:37:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b6d2392f-2c96-493a-84c3-47104bc8dbc2 tempest-ProjectReaderTests-1691574152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:37:51 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-b6d2392f-2c96-493a-84c3-47104bc8dbc2 tempest-ProjectReaderTests-1691574152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:37:51 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-b6d2392f-2c96-493a-84c3-47104bc8dbc2 tempest-ProjectReaderTests-1691574152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:37:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b6d2392f-2c96-493a-84c3-47104bc8dbc2 tempest-ProjectReaderTests-1691574152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:37:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b6d2392f-2c96-493a-84c3-47104bc8dbc2 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:51 devstack sudo[107728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:37:51 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:51 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:51 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b6d2392f-2c96-493a-84c3-47104bc8dbc2 tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.239s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:51 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-b6d2392f-2c96-493a-84c3-47104bc8dbc2 tempest-ProjectReaderTests-1691574152 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:37:51 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-b6d2392f-2c96-493a-84c3-47104bc8dbc2 tempest-ProjectReaderTests-1691574152 None] Deleted volume successfully. Jul 16 23:37:51 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-b6d2392f-2c96-493a-84c3-47104bc8dbc2 tempest-ProjectReaderTests-1691574152 None] Lock "cinder-965c1294-4e82-465e-b48e-a86f3ff75f24-delete_volume" released by "delete_volume" :: held 1.080s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:37:52 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f27587a-2236-4651-80c4-ac6e65085dae tempest-ProjectReaderTests-1691574152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:37:52 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6f27587a-2236-4651-80c4-ac6e65085dae tempest-ProjectReaderTests-1691574152 None] Flow 'volume_create_manager' (7dfb5c99-1823-4c67-9473-b8946d954956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:37:52 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6f27587a-2236-4651-80c4-ac6e65085dae tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1293396c-47c0-4332-bc60-ec96174892f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:52 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6f27587a-2236-4651-80c4-ac6e65085dae tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1293396c-47c0-4332-bc60-ec96174892f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-960452576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fc65c5b-3419-43f6-92bd-7a8a7219cb6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a04787a3c0924d698aa7e02fe7cb6772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:37:52Z,use_quota=True,user_id='77dc3beecc7d47488316b871ff7318e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:52 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6f27587a-2236-4651-80c4-ac6e65085dae tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85b8a4cf-d2a7-48e8-b02e-52d4b8bd8390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:52 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6f27587a-2236-4651-80c4-ac6e65085dae tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85b8a4cf-d2a7-48e8-b02e-52d4b8bd8390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:52 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6f27587a-2236-4651-80c4-ac6e65085dae tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be6f0332-19c4-4c18-bd8d-96929208737e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:52 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6f27587a-2236-4651-80c4-ac6e65085dae tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be6f0332-19c4-4c18-bd8d-96929208737e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fc65c5b-3419-43f6-92bd-7a8a7219cb6b', 'volume_name': 'volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:52 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6f27587a-2236-4651-80c4-ac6e65085dae tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58f2a022-5f78-4fd9-9e27-ee85f4f88b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:52 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6f27587a-2236-4651-80c4-ac6e65085dae tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58f2a022-5f78-4fd9-9e27-ee85f4f88b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:52 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6f27587a-2236-4651-80c4-ac6e65085dae tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc359a5a-6706-4e99-9f98-7af139c68d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:52 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-6f27587a-2236-4651-80c4-ac6e65085dae tempest-ProjectReaderTests-1691574152 None] Volume 2fc65c5b-3419-43f6-92bd-7a8a7219cb6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b', 'volume_size': 1} Jul 16 23:37:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6f27587a-2236-4651-80c4-ac6e65085dae tempest-ProjectReaderTests-1691574152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:37:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6f27587a-2236-4651-80c4-ac6e65085dae tempest-ProjectReaderTests-1691574152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:37:52 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-6f27587a-2236-4651-80c4-ac6e65085dae tempest-ProjectReaderTests-1691574152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-960452576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fc65c5b-3419-43f6-92bd-7a8a7219cb6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a04787a3c0924d698aa7e02fe7cb6772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:37:52Z,use_quota=True,user_id='77dc3beecc7d47488316b871ff7318e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:37:52 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-6f27587a-2236-4651-80c4-ac6e65085dae tempest-ProjectReaderTests-1691574152 None] Creating volume 2fc65c5b-3419-43f6-92bd-7a8a7219cb6b {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:37:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6f27587a-2236-4651-80c4-ac6e65085dae tempest-ProjectReaderTests-1691574152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:37:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6f27587a-2236-4651-80c4-ac6e65085dae tempest-ProjectReaderTests-1691574152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:37:52 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-6f27587a-2236-4651-80c4-ac6e65085dae tempest-ProjectReaderTests-1691574152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:37:52 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-6f27587a-2236-4651-80c4-ac6e65085dae tempest-ProjectReaderTests-1691574152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:37:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6f27587a-2236-4651-80c4-ac6e65085dae tempest-ProjectReaderTests-1691574152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:37:52 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-6f27587a-2236-4651-80c4-ac6e65085dae tempest-ProjectReaderTests-1691574152 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:37:52 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-6f27587a-2236-4651-80c4-ac6e65085dae tempest-ProjectReaderTests-1691574152 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:37:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6f27587a-2236-4651-80c4-ac6e65085dae tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:52 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b 1073741824 Jul 16 23:37:52 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:52 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6f27587a-2236-4651-80c4-ac6e65085dae tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b 1073741824" returned: 0 in 0.395s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:52 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6f27587a-2236-4651-80c4-ac6e65085dae tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:52 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b Jul 16 23:37:52 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:53 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-6f27587a-2236-4651-80c4-ac6e65085dae tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b" returned: 0 in 0.245s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:53 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-6f27587a-2236-4651-80c4-ac6e65085dae tempest-ProjectReaderTests-1691574152 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:37:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-6f27587a-2236-4651-80c4-ac6e65085dae tempest-ProjectReaderTests-1691574152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:37:53 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6f27587a-2236-4651-80c4-ac6e65085dae tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc359a5a-6706-4e99-9f98-7af139c68d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:53 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6f27587a-2236-4651-80c4-ac6e65085dae tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b01681f-a486-4f13-88ff-11c22ac8ac8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:53 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-6f27587a-2236-4651-80c4-ac6e65085dae tempest-ProjectReaderTests-1691574152 None] Volume volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b (2fc65c5b-3419-43f6-92bd-7a8a7219cb6b): created successfully Jul 16 23:37:53 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6f27587a-2236-4651-80c4-ac6e65085dae tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b01681f-a486-4f13-88ff-11c22ac8ac8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:53 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-6f27587a-2236-4651-80c4-ac6e65085dae tempest-ProjectReaderTests-1691574152 None] Flow 'volume_create_manager' (7dfb5c99-1823-4c67-9473-b8946d954956) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:37:53 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-6f27587a-2236-4651-80c4-ac6e65085dae tempest-ProjectReaderTests-1691574152 None] Created volume successfully. Jul 16 23:37:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a30ae6e7-df05-472b-bccc-81e4f6c61835 tempest-ProjectReaderTests-1691574152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:37:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a30ae6e7-df05-472b-bccc-81e4f6c61835 tempest-ProjectReaderTests-1691574152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:37:53 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-a30ae6e7-df05-472b-bccc-81e4f6c61835 tempest-ProjectReaderTests-1691574152 None] Creating offline snapshot 656cda1b-117d-47d6-8cb6-09a363356e81 of volume 2fc65c5b-3419-43f6-92bd-7a8a7219cb6b {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:37:53 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[f273cb81-464c-4925-821d-08b4b78b5760]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:37:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a30ae6e7-df05-472b-bccc-81e4f6c61835 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:53 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b Jul 16 23:37:53 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:53 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a30ae6e7-df05-472b-bccc-81e4f6c61835 tempest-ProjectReaderTests-1691574152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b" returned: 0 in 0.352s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:53 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a30ae6e7-df05-472b-bccc-81e4f6c61835 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b.656cda1b-117d-47d6-8cb6-09a363356e81 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:53 devstack sudo[107745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b.656cda1b-117d-47d6-8cb6-09a363356e81 1G Jul 16 23:37:53 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:54 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a30ae6e7-df05-472b-bccc-81e4f6c61835 tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b.656cda1b-117d-47d6-8cb6-09a363356e81 1G" returned: 0 in 0.372s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a30ae6e7-df05-472b-bccc-81e4f6c61835 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b.656cda1b-117d-47d6-8cb6-09a363356e81 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:54 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b.656cda1b-117d-47d6-8cb6-09a363356e81 Jul 16 23:37:54 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:54 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a30ae6e7-df05-472b-bccc-81e4f6c61835 tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b.656cda1b-117d-47d6-8cb6-09a363356e81" returned: 0 in 0.286s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:54 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-a30ae6e7-df05-472b-bccc-81e4f6c61835 tempest-ProjectReaderTests-1691574152 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b.656cda1b-117d-47d6-8cb6-09a363356e81 is being set with open permissions: ugo+rw Jul 16 23:37:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a30ae6e7-df05-472b-bccc-81e4f6c61835 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b.656cda1b-117d-47d6-8cb6-09a363356e81 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:54 devstack sudo[107756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b.656cda1b-117d-47d6-8cb6-09a363356e81 Jul 16 23:37:54 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:54 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a30ae6e7-df05-472b-bccc-81e4f6c61835 tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b.656cda1b-117d-47d6-8cb6-09a363356e81" returned: 0 in 0.244s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a30ae6e7-df05-472b-bccc-81e4f6c61835 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:54 devstack sudo[107761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b.info Jul 16 23:37:54 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:54 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a30ae6e7-df05-472b-bccc-81e4f6c61835 tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b.info" returned: 0 in 0.264s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:54 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-a30ae6e7-df05-472b-bccc-81e4f6c61835 tempest-ProjectReaderTests-1691574152 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b.info is being set with open permissions: ugo+rw Jul 16 23:37:54 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a30ae6e7-df05-472b-bccc-81e4f6c61835 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:55 devstack sudo[107764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b.info Jul 16 23:37:55 devstack sudo[107764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:55 devstack sudo[107764]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a30ae6e7-df05-472b-bccc-81e4f6c61835 tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b.info" returned: 0 in 0.250s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a30ae6e7-df05-472b-bccc-81e4f6c61835 tempest-ProjectReaderTests-1691574152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.846s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:37:55 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-a30ae6e7-df05-472b-bccc-81e4f6c61835 tempest-ProjectReaderTests-1691574152 None] Create snapshot completed successfully Jul 16 23:37:55 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c6d861d1-dde7-4add-88ff-3708c2cf5a9d tempest-ProjectReaderTests-1691574152 None] Acquiring lock "cinder-656cda1b-117d-47d6-8cb6-09a363356e81-delete_snapshot" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:37:55 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c6d861d1-dde7-4add-88ff-3708c2cf5a9d tempest-ProjectReaderTests-1691574152 None] Lock "cinder-656cda1b-117d-47d6-8cb6-09a363356e81-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:37:55 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c6d861d1-dde7-4add-88ff-3708c2cf5a9d tempest-ProjectReaderTests-1691574152 None] Acquiring lock "cinder-quobyte-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:37:55 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c6d861d1-dde7-4add-88ff-3708c2cf5a9d tempest-ProjectReaderTests-1691574152 None] Lock "cinder-quobyte-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:37:55 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c6d861d1-dde7-4add-88ff-3708c2cf5a9d tempest-ProjectReaderTests-1691574152 None] Acquiring lock "cinder-quobyte-656cda1b-117d-47d6-8cb6-09a363356e81" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:37:55 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c6d861d1-dde7-4add-88ff-3708c2cf5a9d tempest-ProjectReaderTests-1691574152 None] Lock "cinder-quobyte-656cda1b-117d-47d6-8cb6-09a363356e81" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:37:55 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-c6d861d1-dde7-4add-88ff-3708c2cf5a9d tempest-ProjectReaderTests-1691574152 None] Deleting offline snapshot 656cda1b-117d-47d6-8cb6-09a363356e81 of volume 2fc65c5b-3419-43f6-92bd-7a8a7219cb6b {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:37:55 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-c6d861d1-dde7-4add-88ff-3708c2cf5a9d tempest-ProjectReaderTests-1691574152 None] snapshot_file for this snap is: volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b.656cda1b-117d-47d6-8cb6-09a363356e81 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:37:55 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee93b7d-f5d0-4567-9082-c90c02e867f3]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:37:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c6d861d1-dde7-4add-88ff-3708c2cf5a9d tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b.656cda1b-117d-47d6-8cb6-09a363356e81 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:55 devstack sudo[107767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b.656cda1b-117d-47d6-8cb6-09a363356e81 Jul 16 23:37:55 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:55 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:55 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c6d861d1-dde7-4add-88ff-3708c2cf5a9d tempest-ProjectReaderTests-1691574152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b.656cda1b-117d-47d6-8cb6-09a363356e81" returned: 0 in 0.356s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:55 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-c6d861d1-dde7-4add-88ff-3708c2cf5a9d tempest-ProjectReaderTests-1691574152 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:37:56 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd33633f-6cc6-4d71-8869-07e397f8b380]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:37:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c6d861d1-dde7-4add-88ff-3708c2cf5a9d tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:56 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b Jul 16 23:37:56 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:56 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c6d861d1-dde7-4add-88ff-3708c2cf5a9d tempest-ProjectReaderTests-1691574152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b" returned: 0 in 0.346s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c6d861d1-dde7-4add-88ff-3708c2cf5a9d tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b.656cda1b-117d-47d6-8cb6-09a363356e81 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:56 devstack sudo[107777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b.656cda1b-117d-47d6-8cb6-09a363356e81 Jul 16 23:37:56 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:56 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c6d861d1-dde7-4add-88ff-3708c2cf5a9d tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b.656cda1b-117d-47d6-8cb6-09a363356e81" returned: 0 in 0.330s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c6d861d1-dde7-4add-88ff-3708c2cf5a9d tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b.656cda1b-117d-47d6-8cb6-09a363356e81 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:56 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b.656cda1b-117d-47d6-8cb6-09a363356e81 Jul 16 23:37:56 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:56 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:56 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-c6d861d1-dde7-4add-88ff-3708c2cf5a9d tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b.656cda1b-117d-47d6-8cb6-09a363356e81" returned: 0 in 0.239s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:56 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c6d861d1-dde7-4add-88ff-3708c2cf5a9d tempest-ProjectReaderTests-1691574152 None] Lock "cinder-quobyte-656cda1b-117d-47d6-8cb6-09a363356e81" released by "_delete_snapshot" :: held 1.355s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:37:56 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c6d861d1-dde7-4add-88ff-3708c2cf5a9d tempest-ProjectReaderTests-1691574152 None] Lock "cinder-quobyte-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b" released by "delete_snapshot" :: held 1.377s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:37:57 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-c6d861d1-dde7-4add-88ff-3708c2cf5a9d tempest-ProjectReaderTests-1691574152 None] Created reservations ['11ec03d2-e421-4d2f-9647-c5ea9d257857', 'c487faef-1b4a-42f9-b991-c9dd9acc5006', '16e95b18-7db2-4b2f-a359-518f5e6997e5', '2ef040be-da49-484e-9893-ad8ee5463894'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:37:57 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-c6d861d1-dde7-4add-88ff-3708c2cf5a9d tempest-ProjectReaderTests-1691574152 None] Delete snapshot completed successfully. Jul 16 23:37:57 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-c6d861d1-dde7-4add-88ff-3708c2cf5a9d tempest-ProjectReaderTests-1691574152 None] Lock "cinder-656cda1b-117d-47d6-8cb6-09a363356e81-delete_snapshot" released by "delete_snapshot" :: held 1.518s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:37:57 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-022679e2-9cd1-4a95-b297-ef195c7b5ae8 tempest-ProjectReaderTests-1691574152 None] Acquiring lock "cinder-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:37:57 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-022679e2-9cd1-4a95-b297-ef195c7b5ae8 tempest-ProjectReaderTests-1691574152 None] Lock "cinder-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:37:57 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-022679e2-9cd1-4a95-b297-ef195c7b5ae8 tempest-ProjectReaderTests-1691574152 None] Acquiring lock "cinder-quobyte-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:37:57 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-022679e2-9cd1-4a95-b297-ef195c7b5ae8 tempest-ProjectReaderTests-1691574152 None] Lock "cinder-quobyte-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b" acquired by "delete_volume" :: waited 0.015s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:37:57 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a93adf-87d3-4a92-b527-95c43007e4bf]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:37:57 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-022679e2-9cd1-4a95-b297-ef195c7b5ae8 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:57 devstack sudo[107786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b Jul 16 23:37:57 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:58 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-022679e2-9cd1-4a95-b297-ef195c7b5ae8 tempest-ProjectReaderTests-1691574152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b" returned: 0 in 0.348s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-022679e2-9cd1-4a95-b297-ef195c7b5ae8 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:58 devstack sudo[107791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b Jul 16 23:37:58 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:58 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-022679e2-9cd1-4a95-b297-ef195c7b5ae8 tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b" returned: 0 in 0.235s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:58 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-022679e2-9cd1-4a95-b297-ef195c7b5ae8 tempest-ProjectReaderTests-1691574152 None] Lock "cinder-quobyte-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b" released by "delete_volume" :: held 0.640s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:37:58 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-022679e2-9cd1-4a95-b297-ef195c7b5ae8 tempest-ProjectReaderTests-1691574152 None] Created reservations ['f4dac3fa-e3a4-40de-a3fd-5ea2417b323b', 'e1903553-9dca-4c31-80f2-155a000f0a7b', 'dde9ed18-2100-4df4-8036-773278bf45c0', '3754b5b2-e1c6-4851-9bfb-fbfffdb231b0'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:37:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-022679e2-9cd1-4a95-b297-ef195c7b5ae8 tempest-ProjectReaderTests-1691574152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:37:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-022679e2-9cd1-4a95-b297-ef195c7b5ae8 tempest-ProjectReaderTests-1691574152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:37:58 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-022679e2-9cd1-4a95-b297-ef195c7b5ae8 tempest-ProjectReaderTests-1691574152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:37:58 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-022679e2-9cd1-4a95-b297-ef195c7b5ae8 tempest-ProjectReaderTests-1691574152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:37:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-022679e2-9cd1-4a95-b297-ef195c7b5ae8 tempest-ProjectReaderTests-1691574152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:37:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-022679e2-9cd1-4a95-b297-ef195c7b5ae8 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:58 devstack sudo[107794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:37:58 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:58 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:58 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-022679e2-9cd1-4a95-b297-ef195c7b5ae8 tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.239s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:58 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-022679e2-9cd1-4a95-b297-ef195c7b5ae8 tempest-ProjectReaderTests-1691574152 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:37:58 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-022679e2-9cd1-4a95-b297-ef195c7b5ae8 tempest-ProjectReaderTests-1691574152 None] Deleted volume successfully. Jul 16 23:37:58 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-022679e2-9cd1-4a95-b297-ef195c7b5ae8 tempest-ProjectReaderTests-1691574152 None] Lock "cinder-2fc65c5b-3419-43f6-92bd-7a8a7219cb6b-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:37:59 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ddb29b1-a6ee-4eb1-9ab0-0fa00c26b7f8 tempest-ProjectReaderTests-1691574152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:37:59 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3ddb29b1-a6ee-4eb1-9ab0-0fa00c26b7f8 tempest-ProjectReaderTests-1691574152 None] Flow 'volume_create_manager' (90d69b90-7448-4c72-bf10-2324008d878f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:37:59 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3ddb29b1-a6ee-4eb1-9ab0-0fa00c26b7f8 tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81cc2866-7598-4744-adcc-da9ca37b361a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:59 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3ddb29b1-a6ee-4eb1-9ab0-0fa00c26b7f8 tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81cc2866-7598-4744-adcc-da9ca37b361a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1847257039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af1972b3-3a31-4740-b7e6-cdd0ab543e8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a04787a3c0924d698aa7e02fe7cb6772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:37:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:37:59Z,use_quota=True,user_id='77dc3beecc7d47488316b871ff7318e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:59 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3ddb29b1-a6ee-4eb1-9ab0-0fa00c26b7f8 tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6258f1d-c219-4ab2-99a7-cdcf679b8567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:59 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3ddb29b1-a6ee-4eb1-9ab0-0fa00c26b7f8 tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6258f1d-c219-4ab2-99a7-cdcf679b8567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:59 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3ddb29b1-a6ee-4eb1-9ab0-0fa00c26b7f8 tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28f37d97-8a86-4a99-8e22-3270d7140a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:59 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3ddb29b1-a6ee-4eb1-9ab0-0fa00c26b7f8 tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28f37d97-8a86-4a99-8e22-3270d7140a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af1972b3-3a31-4740-b7e6-cdd0ab543e8c', 'volume_name': 'volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:59 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3ddb29b1-a6ee-4eb1-9ab0-0fa00c26b7f8 tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b434cf92-f95e-4595-8c20-19945d362e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:59 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3ddb29b1-a6ee-4eb1-9ab0-0fa00c26b7f8 tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b434cf92-f95e-4595-8c20-19945d362e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:37:59 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3ddb29b1-a6ee-4eb1-9ab0-0fa00c26b7f8 tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7768bd9-6d82-4fed-aae6-d2d7673e87ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:37:59 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-3ddb29b1-a6ee-4eb1-9ab0-0fa00c26b7f8 tempest-ProjectReaderTests-1691574152 None] Volume af1972b3-3a31-4740-b7e6-cdd0ab543e8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c', 'volume_size': 1} Jul 16 23:37:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3ddb29b1-a6ee-4eb1-9ab0-0fa00c26b7f8 tempest-ProjectReaderTests-1691574152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:37:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3ddb29b1-a6ee-4eb1-9ab0-0fa00c26b7f8 tempest-ProjectReaderTests-1691574152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:37:59 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3ddb29b1-a6ee-4eb1-9ab0-0fa00c26b7f8 tempest-ProjectReaderTests-1691574152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1847257039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af1972b3-3a31-4740-b7e6-cdd0ab543e8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a04787a3c0924d698aa7e02fe7cb6772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:37:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:37:59Z,use_quota=True,user_id='77dc3beecc7d47488316b871ff7318e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:37:59 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-3ddb29b1-a6ee-4eb1-9ab0-0fa00c26b7f8 tempest-ProjectReaderTests-1691574152 None] Creating volume af1972b3-3a31-4740-b7e6-cdd0ab543e8c {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:37:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3ddb29b1-a6ee-4eb1-9ab0-0fa00c26b7f8 tempest-ProjectReaderTests-1691574152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:37:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3ddb29b1-a6ee-4eb1-9ab0-0fa00c26b7f8 tempest-ProjectReaderTests-1691574152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:37:59 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3ddb29b1-a6ee-4eb1-9ab0-0fa00c26b7f8 tempest-ProjectReaderTests-1691574152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:37:59 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3ddb29b1-a6ee-4eb1-9ab0-0fa00c26b7f8 tempest-ProjectReaderTests-1691574152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:37:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3ddb29b1-a6ee-4eb1-9ab0-0fa00c26b7f8 tempest-ProjectReaderTests-1691574152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:37:59 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3ddb29b1-a6ee-4eb1-9ab0-0fa00c26b7f8 tempest-ProjectReaderTests-1691574152 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:37:59 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-3ddb29b1-a6ee-4eb1-9ab0-0fa00c26b7f8 tempest-ProjectReaderTests-1691574152 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:37:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3ddb29b1-a6ee-4eb1-9ab0-0fa00c26b7f8 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:59 devstack sudo[107797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c 1073741824 Jul 16 23:37:59 devstack sudo[107797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:37:59 devstack sudo[107797]: pam_unix(sudo:session): session closed for user root Jul 16 23:37:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3ddb29b1-a6ee-4eb1-9ab0-0fa00c26b7f8 tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c 1073741824" returned: 0 in 0.384s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:37:59 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3ddb29b1-a6ee-4eb1-9ab0-0fa00c26b7f8 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:37:59 devstack sudo[107804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c Jul 16 23:37:59 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:00 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-3ddb29b1-a6ee-4eb1-9ab0-0fa00c26b7f8 tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c" returned: 0 in 0.240s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:00 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-3ddb29b1-a6ee-4eb1-9ab0-0fa00c26b7f8 tempest-ProjectReaderTests-1691574152 None] <== create_volume: return (665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:38:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-3ddb29b1-a6ee-4eb1-9ab0-0fa00c26b7f8 tempest-ProjectReaderTests-1691574152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.668s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:38:00 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3ddb29b1-a6ee-4eb1-9ab0-0fa00c26b7f8 tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7768bd9-6d82-4fed-aae6-d2d7673e87ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:38:00 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3ddb29b1-a6ee-4eb1-9ab0-0fa00c26b7f8 tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01776736-47e2-426d-a054-a5626a294a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:38:00 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-3ddb29b1-a6ee-4eb1-9ab0-0fa00c26b7f8 tempest-ProjectReaderTests-1691574152 None] Volume volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c (af1972b3-3a31-4740-b7e6-cdd0ab543e8c): created successfully Jul 16 23:38:00 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3ddb29b1-a6ee-4eb1-9ab0-0fa00c26b7f8 tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01776736-47e2-426d-a054-a5626a294a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:38:00 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-3ddb29b1-a6ee-4eb1-9ab0-0fa00c26b7f8 tempest-ProjectReaderTests-1691574152 None] Flow 'volume_create_manager' (90d69b90-7448-4c72-bf10-2324008d878f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:38:00 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-3ddb29b1-a6ee-4eb1-9ab0-0fa00c26b7f8 tempest-ProjectReaderTests-1691574152 None] Created volume successfully. Jul 16 23:38:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e8594787-7908-48a2-a66e-aa0837029b97 tempest-ProjectReaderTests-1691574152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:38:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e8594787-7908-48a2-a66e-aa0837029b97 tempest-ProjectReaderTests-1691574152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:38:00 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-e8594787-7908-48a2-a66e-aa0837029b97 tempest-ProjectReaderTests-1691574152 None] Creating offline snapshot e7766dec-6a27-4230-9992-8224841f7071 of volume af1972b3-3a31-4740-b7e6-cdd0ab543e8c {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:38:00 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f13b57-9e0f-43e2-a7eb-0406e2a86d03]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:38:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e8594787-7908-48a2-a66e-aa0837029b97 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:00 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c Jul 16 23:38:00 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:00 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e8594787-7908-48a2-a66e-aa0837029b97 tempest-ProjectReaderTests-1691574152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c" returned: 0 in 0.343s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:00 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e8594787-7908-48a2-a66e-aa0837029b97 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c.e7766dec-6a27-4230-9992-8224841f7071 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:00 devstack sudo[107812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c.e7766dec-6a27-4230-9992-8224841f7071 1G Jul 16 23:38:00 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:01 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e8594787-7908-48a2-a66e-aa0837029b97 tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c.e7766dec-6a27-4230-9992-8224841f7071 1G" returned: 0 in 0.385s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e8594787-7908-48a2-a66e-aa0837029b97 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c.e7766dec-6a27-4230-9992-8224841f7071 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:01 devstack sudo[107818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c.e7766dec-6a27-4230-9992-8224841f7071 Jul 16 23:38:01 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:01 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e8594787-7908-48a2-a66e-aa0837029b97 tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c.e7766dec-6a27-4230-9992-8224841f7071" returned: 0 in 0.279s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:01 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-e8594787-7908-48a2-a66e-aa0837029b97 tempest-ProjectReaderTests-1691574152 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c.e7766dec-6a27-4230-9992-8224841f7071 is being set with open permissions: ugo+rw Jul 16 23:38:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e8594787-7908-48a2-a66e-aa0837029b97 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c.e7766dec-6a27-4230-9992-8224841f7071 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:01 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c.e7766dec-6a27-4230-9992-8224841f7071 Jul 16 23:38:01 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:01 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e8594787-7908-48a2-a66e-aa0837029b97 tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c.e7766dec-6a27-4230-9992-8224841f7071" returned: 0 in 0.246s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e8594787-7908-48a2-a66e-aa0837029b97 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:01 devstack sudo[107827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c.info Jul 16 23:38:01 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:01 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e8594787-7908-48a2-a66e-aa0837029b97 tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c.info" returned: 0 in 0.240s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:01 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-e8594787-7908-48a2-a66e-aa0837029b97 tempest-ProjectReaderTests-1691574152 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c.info is being set with open permissions: ugo+rw Jul 16 23:38:01 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e8594787-7908-48a2-a66e-aa0837029b97 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:01 devstack sudo[107830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c.info Jul 16 23:38:01 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:02 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-e8594787-7908-48a2-a66e-aa0837029b97 tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c.info" returned: 0 in 0.237s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-e8594787-7908-48a2-a66e-aa0837029b97 tempest-ProjectReaderTests-1691574152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.808s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:38:02 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-e8594787-7908-48a2-a66e-aa0837029b97 tempest-ProjectReaderTests-1691574152 None] Create snapshot completed successfully Jul 16 23:38:02 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-8a9c0ee1-378e-4535-a4f0-9e9a96016a04 tempest-ProjectReaderTests-1691574152 None] Acquiring lock "cinder-e7766dec-6a27-4230-9992-8224841f7071-delete_snapshot" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:38:02 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-8a9c0ee1-378e-4535-a4f0-9e9a96016a04 tempest-ProjectReaderTests-1691574152 None] Lock "cinder-e7766dec-6a27-4230-9992-8224841f7071-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:38:02 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-8a9c0ee1-378e-4535-a4f0-9e9a96016a04 tempest-ProjectReaderTests-1691574152 None] Acquiring lock "cinder-quobyte-af1972b3-3a31-4740-b7e6-cdd0ab543e8c" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:38:02 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-8a9c0ee1-378e-4535-a4f0-9e9a96016a04 tempest-ProjectReaderTests-1691574152 None] Lock "cinder-quobyte-af1972b3-3a31-4740-b7e6-cdd0ab543e8c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:38:02 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-8a9c0ee1-378e-4535-a4f0-9e9a96016a04 tempest-ProjectReaderTests-1691574152 None] Acquiring lock "cinder-quobyte-e7766dec-6a27-4230-9992-8224841f7071" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:38:02 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-8a9c0ee1-378e-4535-a4f0-9e9a96016a04 tempest-ProjectReaderTests-1691574152 None] Lock "cinder-quobyte-e7766dec-6a27-4230-9992-8224841f7071" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:38:02 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-8a9c0ee1-378e-4535-a4f0-9e9a96016a04 tempest-ProjectReaderTests-1691574152 None] Deleting offline snapshot e7766dec-6a27-4230-9992-8224841f7071 of volume af1972b3-3a31-4740-b7e6-cdd0ab543e8c {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:38:02 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-8a9c0ee1-378e-4535-a4f0-9e9a96016a04 tempest-ProjectReaderTests-1691574152 None] snapshot_file for this snap is: volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c.e7766dec-6a27-4230-9992-8224841f7071 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:38:02 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b3402d-32bb-4123-971b-673136bc0f67]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:38:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8a9c0ee1-378e-4535-a4f0-9e9a96016a04 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c.e7766dec-6a27-4230-9992-8224841f7071 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:02 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c.e7766dec-6a27-4230-9992-8224841f7071 Jul 16 23:38:02 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:02 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8a9c0ee1-378e-4535-a4f0-9e9a96016a04 tempest-ProjectReaderTests-1691574152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c.e7766dec-6a27-4230-9992-8224841f7071" returned: 0 in 0.347s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:02 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-8a9c0ee1-378e-4535-a4f0-9e9a96016a04 tempest-ProjectReaderTests-1691574152 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:38:02 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef5d1b1-8c56-4c9d-9ffc-21f31611527e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:38:02 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8a9c0ee1-378e-4535-a4f0-9e9a96016a04 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:03 devstack sudo[107838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c Jul 16 23:38:03 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:03 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8a9c0ee1-378e-4535-a4f0-9e9a96016a04 tempest-ProjectReaderTests-1691574152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c" returned: 0 in 0.343s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8a9c0ee1-378e-4535-a4f0-9e9a96016a04 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c.e7766dec-6a27-4230-9992-8224841f7071 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:03 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c.e7766dec-6a27-4230-9992-8224841f7071 Jul 16 23:38:03 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:03 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8a9c0ee1-378e-4535-a4f0-9e9a96016a04 tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c.e7766dec-6a27-4230-9992-8224841f7071" returned: 0 in 0.324s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8a9c0ee1-378e-4535-a4f0-9e9a96016a04 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c.e7766dec-6a27-4230-9992-8224841f7071 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:03 devstack sudo[107849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c.e7766dec-6a27-4230-9992-8224841f7071 Jul 16 23:38:03 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:03 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:03 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8a9c0ee1-378e-4535-a4f0-9e9a96016a04 tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c.e7766dec-6a27-4230-9992-8224841f7071" returned: 0 in 0.238s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:03 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-8a9c0ee1-378e-4535-a4f0-9e9a96016a04 tempest-ProjectReaderTests-1691574152 None] Lock "cinder-quobyte-e7766dec-6a27-4230-9992-8224841f7071" released by "_delete_snapshot" :: held 1.335s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:38:03 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-8a9c0ee1-378e-4535-a4f0-9e9a96016a04 tempest-ProjectReaderTests-1691574152 None] Lock "cinder-quobyte-af1972b3-3a31-4740-b7e6-cdd0ab543e8c" released by "delete_snapshot" :: held 1.358s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:38:03 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-8a9c0ee1-378e-4535-a4f0-9e9a96016a04 tempest-ProjectReaderTests-1691574152 None] Created reservations ['9e2595bf-dbdf-4879-b1a8-b52745d864a3', '6a25247e-8467-4c00-8a89-3eff10102bd0', '4e1fd998-907a-4ee1-903a-7282da474b81', 'e4ae60db-6a01-4d87-a652-dd6cc85e330d'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:38:04 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-8a9c0ee1-378e-4535-a4f0-9e9a96016a04 tempest-ProjectReaderTests-1691574152 None] Delete snapshot completed successfully. Jul 16 23:38:04 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-8a9c0ee1-378e-4535-a4f0-9e9a96016a04 tempest-ProjectReaderTests-1691574152 None] Lock "cinder-e7766dec-6a27-4230-9992-8224841f7071-delete_snapshot" released by "delete_snapshot" :: held 1.489s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:38:04 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-7fec02cc-8278-4fca-8466-e68d69921757 tempest-ProjectReaderTests-1691574152 None] Acquiring lock "cinder-af1972b3-3a31-4740-b7e6-cdd0ab543e8c-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:38:04 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-7fec02cc-8278-4fca-8466-e68d69921757 tempest-ProjectReaderTests-1691574152 None] Lock "cinder-af1972b3-3a31-4740-b7e6-cdd0ab543e8c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:38:04 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-7fec02cc-8278-4fca-8466-e68d69921757 tempest-ProjectReaderTests-1691574152 None] Acquiring lock "cinder-quobyte-af1972b3-3a31-4740-b7e6-cdd0ab543e8c" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:38:04 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-7fec02cc-8278-4fca-8466-e68d69921757 tempest-ProjectReaderTests-1691574152 None] Lock "cinder-quobyte-af1972b3-3a31-4740-b7e6-cdd0ab543e8c" acquired by "delete_volume" :: waited 0.016s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:38:04 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aacdd56-1d4b-4d87-855a-71a6142d33da]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:38:04 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7fec02cc-8278-4fca-8466-e68d69921757 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:04 devstack sudo[107853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c Jul 16 23:38:04 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:05 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7fec02cc-8278-4fca-8466-e68d69921757 tempest-ProjectReaderTests-1691574152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c" returned: 0 in 0.356s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7fec02cc-8278-4fca-8466-e68d69921757 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:05 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c Jul 16 23:38:05 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:05 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7fec02cc-8278-4fca-8466-e68d69921757 tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-af1972b3-3a31-4740-b7e6-cdd0ab543e8c" returned: 0 in 0.239s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:05 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-7fec02cc-8278-4fca-8466-e68d69921757 tempest-ProjectReaderTests-1691574152 None] Lock "cinder-quobyte-af1972b3-3a31-4740-b7e6-cdd0ab543e8c" released by "delete_volume" :: held 0.651s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:38:05 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-7fec02cc-8278-4fca-8466-e68d69921757 tempest-ProjectReaderTests-1691574152 None] Created reservations ['b40ee902-071d-4f8e-8463-b6bc332aa4b4', '64091eff-5507-4cf2-bc75-9b5f85642a32', 'eab187e9-403b-4572-b49b-3ed62c51b180', 'd95d52ca-b338-4a1a-a293-c36b79261b6b'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:38:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7fec02cc-8278-4fca-8466-e68d69921757 tempest-ProjectReaderTests-1691574152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:38:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7fec02cc-8278-4fca-8466-e68d69921757 tempest-ProjectReaderTests-1691574152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:38:05 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-7fec02cc-8278-4fca-8466-e68d69921757 tempest-ProjectReaderTests-1691574152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:38:05 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-7fec02cc-8278-4fca-8466-e68d69921757 tempest-ProjectReaderTests-1691574152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:38:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-7fec02cc-8278-4fca-8466-e68d69921757 tempest-ProjectReaderTests-1691574152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:38:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7fec02cc-8278-4fca-8466-e68d69921757 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:05 devstack sudo[107861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:38:05 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:05 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:05 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-7fec02cc-8278-4fca-8466-e68d69921757 tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.236s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:05 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-7fec02cc-8278-4fca-8466-e68d69921757 tempest-ProjectReaderTests-1691574152 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:38:05 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-7fec02cc-8278-4fca-8466-e68d69921757 tempest-ProjectReaderTests-1691574152 None] Deleted volume successfully. Jul 16 23:38:05 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-7fec02cc-8278-4fca-8466-e68d69921757 tempest-ProjectReaderTests-1691574152 None] Lock "cinder-af1972b3-3a31-4740-b7e6-cdd0ab543e8c-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:38:06 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-22192220-96b9-4990-b65e-529b4ffb22c8 tempest-ProjectReaderTests-1691574152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:38:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-22192220-96b9-4990-b65e-529b4ffb22c8 tempest-ProjectReaderTests-1691574152 None] Flow 'volume_create_manager' (1035a200-76dc-4082-aba9-b15ef18b7a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:38:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-22192220-96b9-4990-b65e-529b4ffb22c8 tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f7ddc3-ed28-4517-9c9d-2d915b36a20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:38:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-22192220-96b9-4990-b65e-529b4ffb22c8 tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f7ddc3-ed28-4517-9c9d-2d915b36a20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1928176417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7475d55c-274b-40ba-a3ba-ade37aca121b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a04787a3c0924d698aa7e02fe7cb6772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:38:06Z,use_quota=True,user_id='77dc3beecc7d47488316b871ff7318e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:38:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-22192220-96b9-4990-b65e-529b4ffb22c8 tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab194875-fe01-43ff-8111-3b032003c643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:38:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-22192220-96b9-4990-b65e-529b4ffb22c8 tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab194875-fe01-43ff-8111-3b032003c643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:38:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-22192220-96b9-4990-b65e-529b4ffb22c8 tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f38638f9-bf6b-4170-9f1d-49322adf8810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:38:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-22192220-96b9-4990-b65e-529b4ffb22c8 tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f38638f9-bf6b-4170-9f1d-49322adf8810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7475d55c-274b-40ba-a3ba-ade37aca121b', 'volume_name': 'volume-7475d55c-274b-40ba-a3ba-ade37aca121b', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:38:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-22192220-96b9-4990-b65e-529b4ffb22c8 tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbceaa09-8953-4eb3-88db-647c4d45b0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:38:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-22192220-96b9-4990-b65e-529b4ffb22c8 tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbceaa09-8953-4eb3-88db-647c4d45b0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:38:06 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-22192220-96b9-4990-b65e-529b4ffb22c8 tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fc9ef90-21b5-49d4-b3d7-5d19291b3f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:38:06 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-22192220-96b9-4990-b65e-529b4ffb22c8 tempest-ProjectReaderTests-1691574152 None] Volume 7475d55c-274b-40ba-a3ba-ade37aca121b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7475d55c-274b-40ba-a3ba-ade37aca121b', 'volume_size': 1} Jul 16 23:38:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-22192220-96b9-4990-b65e-529b4ffb22c8 tempest-ProjectReaderTests-1691574152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:38:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-22192220-96b9-4990-b65e-529b4ffb22c8 tempest-ProjectReaderTests-1691574152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:38:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-22192220-96b9-4990-b65e-529b4ffb22c8 tempest-ProjectReaderTests-1691574152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1928176417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7475d55c-274b-40ba-a3ba-ade37aca121b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a04787a3c0924d698aa7e02fe7cb6772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:38:06Z,use_quota=True,user_id='77dc3beecc7d47488316b871ff7318e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:38:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-22192220-96b9-4990-b65e-529b4ffb22c8 tempest-ProjectReaderTests-1691574152 None] Creating volume 7475d55c-274b-40ba-a3ba-ade37aca121b {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:38:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-22192220-96b9-4990-b65e-529b4ffb22c8 tempest-ProjectReaderTests-1691574152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:38:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-22192220-96b9-4990-b65e-529b4ffb22c8 tempest-ProjectReaderTests-1691574152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:38:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-22192220-96b9-4990-b65e-529b4ffb22c8 tempest-ProjectReaderTests-1691574152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:38:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-22192220-96b9-4990-b65e-529b4ffb22c8 tempest-ProjectReaderTests-1691574152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:38:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-22192220-96b9-4990-b65e-529b4ffb22c8 tempest-ProjectReaderTests-1691574152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:38:06 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-22192220-96b9-4990-b65e-529b4ffb22c8 tempest-ProjectReaderTests-1691574152 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:38:06 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-22192220-96b9-4990-b65e-529b4ffb22c8 tempest-ProjectReaderTests-1691574152 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:38:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-22192220-96b9-4990-b65e-529b4ffb22c8 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:06 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b 1073741824 Jul 16 23:38:06 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:06 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-22192220-96b9-4990-b65e-529b4ffb22c8 tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b 1073741824" returned: 0 in 0.386s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:06 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-22192220-96b9-4990-b65e-529b4ffb22c8 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:06 devstack sudo[107870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b Jul 16 23:38:06 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:06 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-22192220-96b9-4990-b65e-529b4ffb22c8 tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b" returned: 0 in 0.241s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:07 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-22192220-96b9-4990-b65e-529b4ffb22c8 tempest-ProjectReaderTests-1691574152 None] <== create_volume: return (664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:38:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-22192220-96b9-4990-b65e-529b4ffb22c8 tempest-ProjectReaderTests-1691574152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.667s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:38:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-22192220-96b9-4990-b65e-529b4ffb22c8 tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fc9ef90-21b5-49d4-b3d7-5d19291b3f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7475d55c-274b-40ba-a3ba-ade37aca121b', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:38:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-22192220-96b9-4990-b65e-529b4ffb22c8 tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c1bbf1-7909-46bd-8ca7-56899b0dedde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:38:07 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-22192220-96b9-4990-b65e-529b4ffb22c8 tempest-ProjectReaderTests-1691574152 None] Volume volume-7475d55c-274b-40ba-a3ba-ade37aca121b (7475d55c-274b-40ba-a3ba-ade37aca121b): created successfully Jul 16 23:38:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-22192220-96b9-4990-b65e-529b4ffb22c8 tempest-ProjectReaderTests-1691574152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c1bbf1-7909-46bd-8ca7-56899b0dedde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:38:07 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-22192220-96b9-4990-b65e-529b4ffb22c8 tempest-ProjectReaderTests-1691574152 None] Flow 'volume_create_manager' (1035a200-76dc-4082-aba9-b15ef18b7a14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:38:07 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-22192220-96b9-4990-b65e-529b4ffb22c8 tempest-ProjectReaderTests-1691574152 None] Created volume successfully. Jul 16 23:38:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b8a70c31-6df7-445f-9d7b-a88f64777b68 tempest-ProjectReaderTests-1691574152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:38:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b8a70c31-6df7-445f-9d7b-a88f64777b68 tempest-ProjectReaderTests-1691574152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:38:07 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-b8a70c31-6df7-445f-9d7b-a88f64777b68 tempest-ProjectReaderTests-1691574152 None] Creating offline snapshot 7cf2ffe7-abd8-4fa6-ba9c-9d5f24e390c7 of volume 7475d55c-274b-40ba-a3ba-ade37aca121b {{(pid=87607) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 23:38:07 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85b41ca-206d-4762-9d9f-8bd92801d58c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:38:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b8a70c31-6df7-445f-9d7b-a88f64777b68 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:07 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b Jul 16 23:38:07 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:07 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b8a70c31-6df7-445f-9d7b-a88f64777b68 tempest-ProjectReaderTests-1691574152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b" returned: 0 in 0.341s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:07 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b8a70c31-6df7-445f-9d7b-a88f64777b68 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b.7cf2ffe7-abd8-4fa6-ba9c-9d5f24e390c7 1G {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:07 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b.7cf2ffe7-abd8-4fa6-ba9c-9d5f24e390c7 1G Jul 16 23:38:07 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:08 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b8a70c31-6df7-445f-9d7b-a88f64777b68 tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b.7cf2ffe7-abd8-4fa6-ba9c-9d5f24e390c7 1G" returned: 0 in 0.379s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b8a70c31-6df7-445f-9d7b-a88f64777b68 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7475d55c-274b-40ba-a3ba-ade37aca121b -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b.7cf2ffe7-abd8-4fa6-ba9c-9d5f24e390c7 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:08 devstack sudo[107885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7475d55c-274b-40ba-a3ba-ade37aca121b -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b.7cf2ffe7-abd8-4fa6-ba9c-9d5f24e390c7 Jul 16 23:38:08 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:08 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b8a70c31-6df7-445f-9d7b-a88f64777b68 tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7475d55c-274b-40ba-a3ba-ade37aca121b -F qcow2 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b.7cf2ffe7-abd8-4fa6-ba9c-9d5f24e390c7" returned: 0 in 0.276s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:08 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-b8a70c31-6df7-445f-9d7b-a88f64777b68 tempest-ProjectReaderTests-1691574152 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b.7cf2ffe7-abd8-4fa6-ba9c-9d5f24e390c7 is being set with open permissions: ugo+rw Jul 16 23:38:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b8a70c31-6df7-445f-9d7b-a88f64777b68 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b.7cf2ffe7-abd8-4fa6-ba9c-9d5f24e390c7 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:08 devstack sudo[107890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b.7cf2ffe7-abd8-4fa6-ba9c-9d5f24e390c7 Jul 16 23:38:08 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:08 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b8a70c31-6df7-445f-9d7b-a88f64777b68 tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b.7cf2ffe7-abd8-4fa6-ba9c-9d5f24e390c7" returned: 0 in 0.239s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b8a70c31-6df7-445f-9d7b-a88f64777b68 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:08 devstack sudo[107893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b.info Jul 16 23:38:08 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:08 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b8a70c31-6df7-445f-9d7b-a88f64777b68 tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b.info" returned: 0 in 0.240s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:08 devstack cinder-volume[87607]: WARNING cinder.volume.drivers.remotefs [None req-b8a70c31-6df7-445f-9d7b-a88f64777b68 tempest-ProjectReaderTests-1691574152 None] /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b.info is being set with open permissions: ugo+rw Jul 16 23:38:08 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b8a70c31-6df7-445f-9d7b-a88f64777b68 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b.info {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:08 devstack sudo[107896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b.info Jul 16 23:38:08 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:09 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-b8a70c31-6df7-445f-9d7b-a88f64777b68 tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b.info" returned: 0 in 0.236s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-b8a70c31-6df7-445f-9d7b-a88f64777b68 tempest-ProjectReaderTests-1691574152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.784s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:38:09 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-b8a70c31-6df7-445f-9d7b-a88f64777b68 tempest-ProjectReaderTests-1691574152 None] Create snapshot completed successfully Jul 16 23:38:09 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-33e0f63a-c976-4beb-99d3-30cb503cf5f7 tempest-ProjectReaderTests-1691574152 None] Acquiring lock "cinder-7cf2ffe7-abd8-4fa6-ba9c-9d5f24e390c7-delete_snapshot" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:38:09 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-33e0f63a-c976-4beb-99d3-30cb503cf5f7 tempest-ProjectReaderTests-1691574152 None] Lock "cinder-7cf2ffe7-abd8-4fa6-ba9c-9d5f24e390c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:38:09 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-33e0f63a-c976-4beb-99d3-30cb503cf5f7 tempest-ProjectReaderTests-1691574152 None] Acquiring lock "cinder-quobyte-7475d55c-274b-40ba-a3ba-ade37aca121b" by "delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:38:09 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-33e0f63a-c976-4beb-99d3-30cb503cf5f7 tempest-ProjectReaderTests-1691574152 None] Lock "cinder-quobyte-7475d55c-274b-40ba-a3ba-ade37aca121b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:38:09 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-33e0f63a-c976-4beb-99d3-30cb503cf5f7 tempest-ProjectReaderTests-1691574152 None] Acquiring lock "cinder-quobyte-7cf2ffe7-abd8-4fa6-ba9c-9d5f24e390c7" by "_delete_snapshot" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:38:09 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-33e0f63a-c976-4beb-99d3-30cb503cf5f7 tempest-ProjectReaderTests-1691574152 None] Lock "cinder-quobyte-7cf2ffe7-abd8-4fa6-ba9c-9d5f24e390c7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:38:09 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-33e0f63a-c976-4beb-99d3-30cb503cf5f7 tempest-ProjectReaderTests-1691574152 None] Deleting offline snapshot 7cf2ffe7-abd8-4fa6-ba9c-9d5f24e390c7 of volume 7475d55c-274b-40ba-a3ba-ade37aca121b {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 23:38:09 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-33e0f63a-c976-4beb-99d3-30cb503cf5f7 tempest-ProjectReaderTests-1691574152 None] snapshot_file for this snap is: volume-7475d55c-274b-40ba-a3ba-ade37aca121b.7cf2ffe7-abd8-4fa6-ba9c-9d5f24e390c7 {{(pid=87607) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 23:38:09 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3bceea-623e-4a1a-95f6-7bc46cba88c7]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:38:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-33e0f63a-c976-4beb-99d3-30cb503cf5f7 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b.7cf2ffe7-abd8-4fa6-ba9c-9d5f24e390c7 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:09 devstack sudo[107900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b.7cf2ffe7-abd8-4fa6-ba9c-9d5f24e390c7 Jul 16 23:38:09 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:09 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-33e0f63a-c976-4beb-99d3-30cb503cf5f7 tempest-ProjectReaderTests-1691574152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b.7cf2ffe7-abd8-4fa6-ba9c-9d5f24e390c7" returned: 0 in 0.337s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:09 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-33e0f63a-c976-4beb-99d3-30cb503cf5f7 tempest-ProjectReaderTests-1691574152 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7475d55c-274b-40ba-a3ba-ade37aca121b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87607) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 23:38:09 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9779692-681a-4f8d-b1bf-65a6833bd141]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:38:09 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-33e0f63a-c976-4beb-99d3-30cb503cf5f7 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:10 devstack sudo[107905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b Jul 16 23:38:10 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:10 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-33e0f63a-c976-4beb-99d3-30cb503cf5f7 tempest-ProjectReaderTests-1691574152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b" returned: 0 in 0.343s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-33e0f63a-c976-4beb-99d3-30cb503cf5f7 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b.7cf2ffe7-abd8-4fa6-ba9c-9d5f24e390c7 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:10 devstack sudo[107910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b.7cf2ffe7-abd8-4fa6-ba9c-9d5f24e390c7 Jul 16 23:38:10 devstack sudo[107910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:10 devstack sudo[107910]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-33e0f63a-c976-4beb-99d3-30cb503cf5f7 tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b.7cf2ffe7-abd8-4fa6-ba9c-9d5f24e390c7" returned: 0 in 0.321s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-33e0f63a-c976-4beb-99d3-30cb503cf5f7 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b.7cf2ffe7-abd8-4fa6-ba9c-9d5f24e390c7 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:10 devstack sudo[107915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b.7cf2ffe7-abd8-4fa6-ba9c-9d5f24e390c7 Jul 16 23:38:10 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:10 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:10 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-33e0f63a-c976-4beb-99d3-30cb503cf5f7 tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b.7cf2ffe7-abd8-4fa6-ba9c-9d5f24e390c7" returned: 0 in 0.263s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:10 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-33e0f63a-c976-4beb-99d3-30cb503cf5f7 tempest-ProjectReaderTests-1691574152 None] Lock "cinder-quobyte-7cf2ffe7-abd8-4fa6-ba9c-9d5f24e390c7" released by "_delete_snapshot" :: held 1.344s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:38:10 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-33e0f63a-c976-4beb-99d3-30cb503cf5f7 tempest-ProjectReaderTests-1691574152 None] Lock "cinder-quobyte-7475d55c-274b-40ba-a3ba-ade37aca121b" released by "delete_snapshot" :: held 1.365s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:38:10 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-33e0f63a-c976-4beb-99d3-30cb503cf5f7 tempest-ProjectReaderTests-1691574152 None] Created reservations ['36f5a541-8a26-4bdc-9ab6-11c83b12aa85', '109515a0-bffe-4bcf-bff6-b34d3183b2dc', 'e583aadf-137c-447b-a73e-cdca450104a9', '55dfa0eb-7f91-4cfb-9e53-913c62249af4'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:38:11 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-33e0f63a-c976-4beb-99d3-30cb503cf5f7 tempest-ProjectReaderTests-1691574152 None] Delete snapshot completed successfully. Jul 16 23:38:11 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-33e0f63a-c976-4beb-99d3-30cb503cf5f7 tempest-ProjectReaderTests-1691574152 None] Lock "cinder-7cf2ffe7-abd8-4fa6-ba9c-9d5f24e390c7-delete_snapshot" released by "delete_snapshot" :: held 1.506s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:38:11 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-bf57b7ab-3d5f-49fb-9774-7d84be79c255 tempest-ProjectReaderTests-1691574152 None] Acquiring lock "cinder-7475d55c-274b-40ba-a3ba-ade37aca121b-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:38:11 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-bf57b7ab-3d5f-49fb-9774-7d84be79c255 tempest-ProjectReaderTests-1691574152 None] Lock "cinder-7475d55c-274b-40ba-a3ba-ade37aca121b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:38:11 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-bf57b7ab-3d5f-49fb-9774-7d84be79c255 tempest-ProjectReaderTests-1691574152 None] Acquiring lock "cinder-quobyte-7475d55c-274b-40ba-a3ba-ade37aca121b" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:38:11 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-bf57b7ab-3d5f-49fb-9774-7d84be79c255 tempest-ProjectReaderTests-1691574152 None] Lock "cinder-quobyte-7475d55c-274b-40ba-a3ba-ade37aca121b" acquired by "delete_volume" :: waited 0.013s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:38:11 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2296ec-ca81-459b-9f23-4e78793a1a76]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:38:11 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bf57b7ab-3d5f-49fb-9774-7d84be79c255 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:11 devstack sudo[107918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b Jul 16 23:38:11 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:12 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bf57b7ab-3d5f-49fb-9774-7d84be79c255 tempest-ProjectReaderTests-1691574152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b" returned: 0 in 0.351s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bf57b7ab-3d5f-49fb-9774-7d84be79c255 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:12 devstack sudo[107923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b Jul 16 23:38:12 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:12 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bf57b7ab-3d5f-49fb-9774-7d84be79c255 tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-7475d55c-274b-40ba-a3ba-ade37aca121b" returned: 0 in 0.257s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:12 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-bf57b7ab-3d5f-49fb-9774-7d84be79c255 tempest-ProjectReaderTests-1691574152 None] Lock "cinder-quobyte-7475d55c-274b-40ba-a3ba-ade37aca121b" released by "delete_volume" :: held 0.662s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:38:12 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-bf57b7ab-3d5f-49fb-9774-7d84be79c255 tempest-ProjectReaderTests-1691574152 None] Created reservations ['4a5d5d50-cd0c-455d-ab76-c0918b66528e', '32de6fe7-160e-4594-bf93-9612a25fc8b7', 'ae297095-7e6e-46e4-9392-936dfd3b852e', '04792ab8-9406-40d5-b548-ae22175ca00c'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:38:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bf57b7ab-3d5f-49fb-9774-7d84be79c255 tempest-ProjectReaderTests-1691574152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:38:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bf57b7ab-3d5f-49fb-9774-7d84be79c255 tempest-ProjectReaderTests-1691574152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:38:12 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-bf57b7ab-3d5f-49fb-9774-7d84be79c255 tempest-ProjectReaderTests-1691574152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:38:12 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-bf57b7ab-3d5f-49fb-9774-7d84be79c255 tempest-ProjectReaderTests-1691574152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:38:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-bf57b7ab-3d5f-49fb-9774-7d84be79c255 tempest-ProjectReaderTests-1691574152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:38:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bf57b7ab-3d5f-49fb-9774-7d84be79c255 tempest-ProjectReaderTests-1691574152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:12 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:38:12 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:12 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:12 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-bf57b7ab-3d5f-49fb-9774-7d84be79c255 tempest-ProjectReaderTests-1691574152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.250s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:12 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-bf57b7ab-3d5f-49fb-9774-7d84be79c255 tempest-ProjectReaderTests-1691574152 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:38:12 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-bf57b7ab-3d5f-49fb-9774-7d84be79c255 tempest-ProjectReaderTests-1691574152 None] Deleted volume successfully. Jul 16 23:38:13 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-bf57b7ab-3d5f-49fb-9774-7d84be79c255 tempest-ProjectReaderTests-1691574152 None] Lock "cinder-7475d55c-274b-40ba-a3ba-ade37aca121b-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:38:20 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fadc9f0-45d6-4794-87b7-a5dec77e6fbf tempest-ProjectReaderTests-2093354218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:38:20 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0fadc9f0-45d6-4794-87b7-a5dec77e6fbf tempest-ProjectReaderTests-2093354218 None] Flow 'volume_create_manager' (7a19e9ce-9629-41c4-9218-5ef1622dafc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:38:20 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0fadc9f0-45d6-4794-87b7-a5dec77e6fbf tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c0f122f-3e15-4e70-bab5-b680e58a0a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:38:20 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0fadc9f0-45d6-4794-87b7-a5dec77e6fbf tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c0f122f-3e15-4e70-bab5-b680e58a0a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:38:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1797259605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f1f81a5-e894-45bd-9bf7-138160b96fb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3197b703d45b4369ad811f8034e6bc83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:38:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:38:21Z,use_quota=True,user_id='154942d9fe634b4aa5b73da15b066fa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:38:20 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0fadc9f0-45d6-4794-87b7-a5dec77e6fbf tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4a13b09-2437-48dd-b8ea-b5cffcc4cf04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:38:20 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0fadc9f0-45d6-4794-87b7-a5dec77e6fbf tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4a13b09-2437-48dd-b8ea-b5cffcc4cf04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:38:20 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0fadc9f0-45d6-4794-87b7-a5dec77e6fbf tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e440e3ac-d222-49f1-894d-6b67814679c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:38:20 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0fadc9f0-45d6-4794-87b7-a5dec77e6fbf tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e440e3ac-d222-49f1-894d-6b67814679c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f1f81a5-e894-45bd-9bf7-138160b96fb5', 'volume_name': 'volume-5f1f81a5-e894-45bd-9bf7-138160b96fb5', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:38:20 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0fadc9f0-45d6-4794-87b7-a5dec77e6fbf tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c95398a-bf62-490b-9367-34046d44f5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:38:20 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0fadc9f0-45d6-4794-87b7-a5dec77e6fbf tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c95398a-bf62-490b-9367-34046d44f5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:38:20 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0fadc9f0-45d6-4794-87b7-a5dec77e6fbf tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dafc10f-5429-4f10-abb9-0cbf386c06b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:38:20 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-0fadc9f0-45d6-4794-87b7-a5dec77e6fbf tempest-ProjectReaderTests-2093354218 None] Volume 5f1f81a5-e894-45bd-9bf7-138160b96fb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f1f81a5-e894-45bd-9bf7-138160b96fb5', 'volume_size': 1} Jul 16 23:38:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0fadc9f0-45d6-4794-87b7-a5dec77e6fbf tempest-ProjectReaderTests-2093354218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:38:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0fadc9f0-45d6-4794-87b7-a5dec77e6fbf tempest-ProjectReaderTests-2093354218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:38:20 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0fadc9f0-45d6-4794-87b7-a5dec77e6fbf tempest-ProjectReaderTests-2093354218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:38:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1797259605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f1f81a5-e894-45bd-9bf7-138160b96fb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3197b703d45b4369ad811f8034e6bc83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:38:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:38:21Z,use_quota=True,user_id='154942d9fe634b4aa5b73da15b066fa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:38:20 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-0fadc9f0-45d6-4794-87b7-a5dec77e6fbf tempest-ProjectReaderTests-2093354218 None] Creating volume 5f1f81a5-e894-45bd-9bf7-138160b96fb5 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:38:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0fadc9f0-45d6-4794-87b7-a5dec77e6fbf tempest-ProjectReaderTests-2093354218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:38:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0fadc9f0-45d6-4794-87b7-a5dec77e6fbf tempest-ProjectReaderTests-2093354218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:38:20 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0fadc9f0-45d6-4794-87b7-a5dec77e6fbf tempest-ProjectReaderTests-2093354218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:38:20 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0fadc9f0-45d6-4794-87b7-a5dec77e6fbf tempest-ProjectReaderTests-2093354218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:38:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0fadc9f0-45d6-4794-87b7-a5dec77e6fbf tempest-ProjectReaderTests-2093354218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:38:20 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0fadc9f0-45d6-4794-87b7-a5dec77e6fbf tempest-ProjectReaderTests-2093354218 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:38:20 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-0fadc9f0-45d6-4794-87b7-a5dec77e6fbf tempest-ProjectReaderTests-2093354218 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:38:20 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0fadc9f0-45d6-4794-87b7-a5dec77e6fbf tempest-ProjectReaderTests-2093354218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5f1f81a5-e894-45bd-9bf7-138160b96fb5 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:20 devstack sudo[107930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5f1f81a5-e894-45bd-9bf7-138160b96fb5 1073741824 Jul 16 23:38:20 devstack sudo[107930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:21 devstack sudo[107930]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0fadc9f0-45d6-4794-87b7-a5dec77e6fbf tempest-ProjectReaderTests-2093354218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5f1f81a5-e894-45bd-9bf7-138160b96fb5 1073741824" returned: 0 in 0.415s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0fadc9f0-45d6-4794-87b7-a5dec77e6fbf tempest-ProjectReaderTests-2093354218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5f1f81a5-e894-45bd-9bf7-138160b96fb5 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:21 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5f1f81a5-e894-45bd-9bf7-138160b96fb5 Jul 16 23:38:21 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:21 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-0fadc9f0-45d6-4794-87b7-a5dec77e6fbf tempest-ProjectReaderTests-2093354218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5f1f81a5-e894-45bd-9bf7-138160b96fb5" returned: 0 in 0.238s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:21 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-0fadc9f0-45d6-4794-87b7-a5dec77e6fbf tempest-ProjectReaderTests-2093354218 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:38:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-0fadc9f0-45d6-4794-87b7-a5dec77e6fbf tempest-ProjectReaderTests-2093354218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:38:21 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0fadc9f0-45d6-4794-87b7-a5dec77e6fbf tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dafc10f-5429-4f10-abb9-0cbf386c06b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f1f81a5-e894-45bd-9bf7-138160b96fb5', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:38:21 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0fadc9f0-45d6-4794-87b7-a5dec77e6fbf tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (989876ff-7f86-4ae2-9b23-987a1cdd0289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:38:21 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-0fadc9f0-45d6-4794-87b7-a5dec77e6fbf tempest-ProjectReaderTests-2093354218 None] Volume volume-5f1f81a5-e894-45bd-9bf7-138160b96fb5 (5f1f81a5-e894-45bd-9bf7-138160b96fb5): created successfully Jul 16 23:38:21 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0fadc9f0-45d6-4794-87b7-a5dec77e6fbf tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (989876ff-7f86-4ae2-9b23-987a1cdd0289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:38:21 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-0fadc9f0-45d6-4794-87b7-a5dec77e6fbf tempest-ProjectReaderTests-2093354218 None] Flow 'volume_create_manager' (7a19e9ce-9629-41c4-9218-5ef1622dafc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:38:21 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-0fadc9f0-45d6-4794-87b7-a5dec77e6fbf tempest-ProjectReaderTests-2093354218 None] Created volume successfully. Jul 16 23:38:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-11ece3c3-7969-43ce-8a47-28e3e90105af tempest-ProjectReaderTests-2093354218 None] Acquiring lock "cinder-5f1f81a5-e894-45bd-9bf7-138160b96fb5-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:38:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-11ece3c3-7969-43ce-8a47-28e3e90105af tempest-ProjectReaderTests-2093354218 None] Lock "cinder-5f1f81a5-e894-45bd-9bf7-138160b96fb5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:38:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-11ece3c3-7969-43ce-8a47-28e3e90105af tempest-ProjectReaderTests-2093354218 None] Acquiring lock "cinder-quobyte-5f1f81a5-e894-45bd-9bf7-138160b96fb5" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:38:21 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-11ece3c3-7969-43ce-8a47-28e3e90105af tempest-ProjectReaderTests-2093354218 None] Lock "cinder-quobyte-5f1f81a5-e894-45bd-9bf7-138160b96fb5" acquired by "delete_volume" :: waited 0.016s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:38:21 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[2436d9d7-324e-4ec2-827f-789357e99a4d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:38:21 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-11ece3c3-7969-43ce-8a47-28e3e90105af tempest-ProjectReaderTests-2093354218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5f1f81a5-e894-45bd-9bf7-138160b96fb5 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:22 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5f1f81a5-e894-45bd-9bf7-138160b96fb5 Jul 16 23:38:22 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:22 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-11ece3c3-7969-43ce-8a47-28e3e90105af tempest-ProjectReaderTests-2093354218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5f1f81a5-e894-45bd-9bf7-138160b96fb5" returned: 0 in 0.341s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-11ece3c3-7969-43ce-8a47-28e3e90105af tempest-ProjectReaderTests-2093354218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5f1f81a5-e894-45bd-9bf7-138160b96fb5 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:22 devstack sudo[107943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5f1f81a5-e894-45bd-9bf7-138160b96fb5 Jul 16 23:38:22 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:22 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-11ece3c3-7969-43ce-8a47-28e3e90105af tempest-ProjectReaderTests-2093354218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-5f1f81a5-e894-45bd-9bf7-138160b96fb5" returned: 0 in 0.236s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:22 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-11ece3c3-7969-43ce-8a47-28e3e90105af tempest-ProjectReaderTests-2093354218 None] Lock "cinder-quobyte-5f1f81a5-e894-45bd-9bf7-138160b96fb5" released by "delete_volume" :: held 0.615s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:38:22 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-11ece3c3-7969-43ce-8a47-28e3e90105af tempest-ProjectReaderTests-2093354218 None] Created reservations ['c2ad8d37-ac14-4aad-9f72-b2da2d9b2a4d', '9ab81106-bdbe-4a46-8bd4-33ed4275ef0b', '153a7355-5092-4dbe-a775-3bed896c9506', '00985b72-72c0-4af4-b243-35bac19e48d2'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:38:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-11ece3c3-7969-43ce-8a47-28e3e90105af tempest-ProjectReaderTests-2093354218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:38:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-11ece3c3-7969-43ce-8a47-28e3e90105af tempest-ProjectReaderTests-2093354218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:38:22 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-11ece3c3-7969-43ce-8a47-28e3e90105af tempest-ProjectReaderTests-2093354218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:38:22 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-11ece3c3-7969-43ce-8a47-28e3e90105af tempest-ProjectReaderTests-2093354218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:38:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-11ece3c3-7969-43ce-8a47-28e3e90105af tempest-ProjectReaderTests-2093354218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:38:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-11ece3c3-7969-43ce-8a47-28e3e90105af tempest-ProjectReaderTests-2093354218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:22 devstack sudo[107946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:38:22 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:22 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:22 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-11ece3c3-7969-43ce-8a47-28e3e90105af tempest-ProjectReaderTests-2093354218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.249s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:22 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-11ece3c3-7969-43ce-8a47-28e3e90105af tempest-ProjectReaderTests-2093354218 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:38:22 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-11ece3c3-7969-43ce-8a47-28e3e90105af tempest-ProjectReaderTests-2093354218 None] Deleted volume successfully. Jul 16 23:38:22 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-11ece3c3-7969-43ce-8a47-28e3e90105af tempest-ProjectReaderTests-2093354218 None] Lock "cinder-5f1f81a5-e894-45bd-9bf7-138160b96fb5-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:38:23 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-cee21770-ef57-4987-8fda-589ac4784f16 tempest-ProjectReaderTests-2093354218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:38:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-cee21770-ef57-4987-8fda-589ac4784f16 tempest-ProjectReaderTests-2093354218 None] Flow 'volume_create_manager' (455ff65d-4fb0-401b-9438-5a7f3e817450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:38:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-cee21770-ef57-4987-8fda-589ac4784f16 tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dc0ac34-db0b-4be1-a092-5aa773abf437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:38:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-cee21770-ef57-4987-8fda-589ac4784f16 tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dc0ac34-db0b-4be1-a092-5aa773abf437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-545944883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52dc0045-d665-404e-8985-5800b8952733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3197b703d45b4369ad811f8034e6bc83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:38:23Z,use_quota=True,user_id='154942d9fe634b4aa5b73da15b066fa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:38:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-cee21770-ef57-4987-8fda-589ac4784f16 tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42d8baa8-f449-4428-b52c-9961ba9421e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:38:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-cee21770-ef57-4987-8fda-589ac4784f16 tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42d8baa8-f449-4428-b52c-9961ba9421e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:38:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-cee21770-ef57-4987-8fda-589ac4784f16 tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95dc9f1e-cfe8-4bd0-ad5d-7c23837a4dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:38:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-cee21770-ef57-4987-8fda-589ac4784f16 tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95dc9f1e-cfe8-4bd0-ad5d-7c23837a4dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52dc0045-d665-404e-8985-5800b8952733', 'volume_name': 'volume-52dc0045-d665-404e-8985-5800b8952733', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:38:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-cee21770-ef57-4987-8fda-589ac4784f16 tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ab49f1e-3f0d-4b46-9697-e569725835ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:38:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-cee21770-ef57-4987-8fda-589ac4784f16 tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ab49f1e-3f0d-4b46-9697-e569725835ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:38:23 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-cee21770-ef57-4987-8fda-589ac4784f16 tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (464dd2d6-3210-47c0-abd1-2a86647e8055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:38:23 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-cee21770-ef57-4987-8fda-589ac4784f16 tempest-ProjectReaderTests-2093354218 None] Volume 52dc0045-d665-404e-8985-5800b8952733: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52dc0045-d665-404e-8985-5800b8952733', 'volume_size': 1} Jul 16 23:38:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-cee21770-ef57-4987-8fda-589ac4784f16 tempest-ProjectReaderTests-2093354218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:38:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-cee21770-ef57-4987-8fda-589ac4784f16 tempest-ProjectReaderTests-2093354218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:38:23 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-cee21770-ef57-4987-8fda-589ac4784f16 tempest-ProjectReaderTests-2093354218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-545944883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52dc0045-d665-404e-8985-5800b8952733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3197b703d45b4369ad811f8034e6bc83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:38:23Z,use_quota=True,user_id='154942d9fe634b4aa5b73da15b066fa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:38:23 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-cee21770-ef57-4987-8fda-589ac4784f16 tempest-ProjectReaderTests-2093354218 None] Creating volume 52dc0045-d665-404e-8985-5800b8952733 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:38:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-cee21770-ef57-4987-8fda-589ac4784f16 tempest-ProjectReaderTests-2093354218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:38:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-cee21770-ef57-4987-8fda-589ac4784f16 tempest-ProjectReaderTests-2093354218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:38:23 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-cee21770-ef57-4987-8fda-589ac4784f16 tempest-ProjectReaderTests-2093354218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:38:23 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-cee21770-ef57-4987-8fda-589ac4784f16 tempest-ProjectReaderTests-2093354218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:38:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-cee21770-ef57-4987-8fda-589ac4784f16 tempest-ProjectReaderTests-2093354218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:38:23 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-cee21770-ef57-4987-8fda-589ac4784f16 tempest-ProjectReaderTests-2093354218 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:38:23 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-cee21770-ef57-4987-8fda-589ac4784f16 tempest-ProjectReaderTests-2093354218 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:38:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cee21770-ef57-4987-8fda-589ac4784f16 tempest-ProjectReaderTests-2093354218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-52dc0045-d665-404e-8985-5800b8952733 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:23 devstack sudo[107949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-52dc0045-d665-404e-8985-5800b8952733 1073741824 Jul 16 23:38:23 devstack sudo[107949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:23 devstack sudo[107949]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:23 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cee21770-ef57-4987-8fda-589ac4784f16 tempest-ProjectReaderTests-2093354218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-52dc0045-d665-404e-8985-5800b8952733 1073741824" returned: 0 in 0.408s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cee21770-ef57-4987-8fda-589ac4784f16 tempest-ProjectReaderTests-2093354218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-52dc0045-d665-404e-8985-5800b8952733 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:24 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-52dc0045-d665-404e-8985-5800b8952733 Jul 16 23:38:24 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:24 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-cee21770-ef57-4987-8fda-589ac4784f16 tempest-ProjectReaderTests-2093354218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-52dc0045-d665-404e-8985-5800b8952733" returned: 0 in 0.260s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:24 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-cee21770-ef57-4987-8fda-589ac4784f16 tempest-ProjectReaderTests-2093354218 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:38:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-cee21770-ef57-4987-8fda-589ac4784f16 tempest-ProjectReaderTests-2093354218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:38:24 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-cee21770-ef57-4987-8fda-589ac4784f16 tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (464dd2d6-3210-47c0-abd1-2a86647e8055) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52dc0045-d665-404e-8985-5800b8952733', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:38:24 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-cee21770-ef57-4987-8fda-589ac4784f16 tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22ac6e1c-1f20-4097-9f27-605300f682b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:38:24 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-cee21770-ef57-4987-8fda-589ac4784f16 tempest-ProjectReaderTests-2093354218 None] Volume volume-52dc0045-d665-404e-8985-5800b8952733 (52dc0045-d665-404e-8985-5800b8952733): created successfully Jul 16 23:38:24 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-cee21770-ef57-4987-8fda-589ac4784f16 tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22ac6e1c-1f20-4097-9f27-605300f682b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:38:24 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-cee21770-ef57-4987-8fda-589ac4784f16 tempest-ProjectReaderTests-2093354218 None] Flow 'volume_create_manager' (455ff65d-4fb0-401b-9438-5a7f3e817450) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:38:24 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-cee21770-ef57-4987-8fda-589ac4784f16 tempest-ProjectReaderTests-2093354218 None] Created volume successfully. Jul 16 23:38:24 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1fa08131-be71-4386-8e62-e0adc371eb8c tempest-ProjectReaderTests-2093354218 None] Acquiring lock "cinder-52dc0045-d665-404e-8985-5800b8952733-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:38:24 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1fa08131-be71-4386-8e62-e0adc371eb8c tempest-ProjectReaderTests-2093354218 None] Lock "cinder-52dc0045-d665-404e-8985-5800b8952733-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:38:24 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1fa08131-be71-4386-8e62-e0adc371eb8c tempest-ProjectReaderTests-2093354218 None] Acquiring lock "cinder-quobyte-52dc0045-d665-404e-8985-5800b8952733" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:38:24 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1fa08131-be71-4386-8e62-e0adc371eb8c tempest-ProjectReaderTests-2093354218 None] Lock "cinder-quobyte-52dc0045-d665-404e-8985-5800b8952733" acquired by "delete_volume" :: waited 0.017s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:38:24 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e09b43f-8093-43a3-be6c-4e4d27311a25]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:38:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1fa08131-be71-4386-8e62-e0adc371eb8c tempest-ProjectReaderTests-2093354218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-52dc0045-d665-404e-8985-5800b8952733 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:24 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-52dc0045-d665-404e-8985-5800b8952733 Jul 16 23:38:24 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:24 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1fa08131-be71-4386-8e62-e0adc371eb8c tempest-ProjectReaderTests-2093354218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-52dc0045-d665-404e-8985-5800b8952733" returned: 0 in 0.355s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:24 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1fa08131-be71-4386-8e62-e0adc371eb8c tempest-ProjectReaderTests-2093354218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-52dc0045-d665-404e-8985-5800b8952733 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:25 devstack sudo[107963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-52dc0045-d665-404e-8985-5800b8952733 Jul 16 23:38:25 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:25 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1fa08131-be71-4386-8e62-e0adc371eb8c tempest-ProjectReaderTests-2093354218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-52dc0045-d665-404e-8985-5800b8952733" returned: 0 in 0.271s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:25 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1fa08131-be71-4386-8e62-e0adc371eb8c tempest-ProjectReaderTests-2093354218 None] Lock "cinder-quobyte-52dc0045-d665-404e-8985-5800b8952733" released by "delete_volume" :: held 0.662s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:38:25 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-1fa08131-be71-4386-8e62-e0adc371eb8c tempest-ProjectReaderTests-2093354218 None] Created reservations ['0270aed0-ccaa-4fec-927a-7ddc15dfdcf5', 'ffb63f16-5c96-41cb-8280-2fa925ab7b8f', '1d9adc9d-4db1-437e-b7af-f4e5be522386', '05897e9c-acb9-4b21-a540-34b17f18bdd6'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:38:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1fa08131-be71-4386-8e62-e0adc371eb8c tempest-ProjectReaderTests-2093354218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:38:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1fa08131-be71-4386-8e62-e0adc371eb8c tempest-ProjectReaderTests-2093354218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:38:25 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1fa08131-be71-4386-8e62-e0adc371eb8c tempest-ProjectReaderTests-2093354218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:38:25 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-1fa08131-be71-4386-8e62-e0adc371eb8c tempest-ProjectReaderTests-2093354218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:38:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-1fa08131-be71-4386-8e62-e0adc371eb8c tempest-ProjectReaderTests-2093354218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:38:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1fa08131-be71-4386-8e62-e0adc371eb8c tempest-ProjectReaderTests-2093354218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:25 devstack sudo[107966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:38:25 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:25 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:25 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-1fa08131-be71-4386-8e62-e0adc371eb8c tempest-ProjectReaderTests-2093354218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.236s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:25 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-1fa08131-be71-4386-8e62-e0adc371eb8c tempest-ProjectReaderTests-2093354218 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:38:25 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-1fa08131-be71-4386-8e62-e0adc371eb8c tempest-ProjectReaderTests-2093354218 None] Deleted volume successfully. Jul 16 23:38:25 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-1fa08131-be71-4386-8e62-e0adc371eb8c tempest-ProjectReaderTests-2093354218 None] Lock "cinder-52dc0045-d665-404e-8985-5800b8952733-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:38:26 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-a65eda23-2e84-43b2-9e64-3c49fdc825c4 tempest-ProjectReaderTests-2093354218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:38:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a65eda23-2e84-43b2-9e64-3c49fdc825c4 tempest-ProjectReaderTests-2093354218 None] Flow 'volume_create_manager' (f6526bc8-40bb-4bb9-9f14-76af1c96c2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:38:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a65eda23-2e84-43b2-9e64-3c49fdc825c4 tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20609240-eca7-48fc-9e07-0d2fdcf76a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:38:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a65eda23-2e84-43b2-9e64-3c49fdc825c4 tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20609240-eca7-48fc-9e07-0d2fdcf76a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-441260434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d380d28c-40fc-413f-a648-46cb181ac2a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3197b703d45b4369ad811f8034e6bc83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:38:26Z,use_quota=True,user_id='154942d9fe634b4aa5b73da15b066fa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:38:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a65eda23-2e84-43b2-9e64-3c49fdc825c4 tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f382076f-9feb-411e-90cd-39873c8006a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:38:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a65eda23-2e84-43b2-9e64-3c49fdc825c4 tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f382076f-9feb-411e-90cd-39873c8006a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:38:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a65eda23-2e84-43b2-9e64-3c49fdc825c4 tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a39e4a37-a006-4c64-8834-ebad36377277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:38:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a65eda23-2e84-43b2-9e64-3c49fdc825c4 tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a39e4a37-a006-4c64-8834-ebad36377277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd380d28c-40fc-413f-a648-46cb181ac2a8', 'volume_name': 'volume-d380d28c-40fc-413f-a648-46cb181ac2a8', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:38:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a65eda23-2e84-43b2-9e64-3c49fdc825c4 tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b41b8b27-56d1-4c52-90e4-7f45aa690c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:38:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a65eda23-2e84-43b2-9e64-3c49fdc825c4 tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b41b8b27-56d1-4c52-90e4-7f45aa690c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:38:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a65eda23-2e84-43b2-9e64-3c49fdc825c4 tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f354fe8b-30c6-4912-83fa-e6a814109a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:38:26 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-a65eda23-2e84-43b2-9e64-3c49fdc825c4 tempest-ProjectReaderTests-2093354218 None] Volume d380d28c-40fc-413f-a648-46cb181ac2a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d380d28c-40fc-413f-a648-46cb181ac2a8', 'volume_size': 1} Jul 16 23:38:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a65eda23-2e84-43b2-9e64-3c49fdc825c4 tempest-ProjectReaderTests-2093354218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:38:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a65eda23-2e84-43b2-9e64-3c49fdc825c4 tempest-ProjectReaderTests-2093354218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:38:26 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a65eda23-2e84-43b2-9e64-3c49fdc825c4 tempest-ProjectReaderTests-2093354218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-441260434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d380d28c-40fc-413f-a648-46cb181ac2a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3197b703d45b4369ad811f8034e6bc83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:38:26Z,use_quota=True,user_id='154942d9fe634b4aa5b73da15b066fa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:38:26 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-a65eda23-2e84-43b2-9e64-3c49fdc825c4 tempest-ProjectReaderTests-2093354218 None] Creating volume d380d28c-40fc-413f-a648-46cb181ac2a8 {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:38:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a65eda23-2e84-43b2-9e64-3c49fdc825c4 tempest-ProjectReaderTests-2093354218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:38:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a65eda23-2e84-43b2-9e64-3c49fdc825c4 tempest-ProjectReaderTests-2093354218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:38:26 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a65eda23-2e84-43b2-9e64-3c49fdc825c4 tempest-ProjectReaderTests-2093354218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:38:26 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a65eda23-2e84-43b2-9e64-3c49fdc825c4 tempest-ProjectReaderTests-2093354218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:38:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a65eda23-2e84-43b2-9e64-3c49fdc825c4 tempest-ProjectReaderTests-2093354218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:38:26 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a65eda23-2e84-43b2-9e64-3c49fdc825c4 tempest-ProjectReaderTests-2093354218 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:38:26 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-a65eda23-2e84-43b2-9e64-3c49fdc825c4 tempest-ProjectReaderTests-2093354218 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:38:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a65eda23-2e84-43b2-9e64-3c49fdc825c4 tempest-ProjectReaderTests-2093354218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d380d28c-40fc-413f-a648-46cb181ac2a8 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:26 devstack sudo[107969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d380d28c-40fc-413f-a648-46cb181ac2a8 1073741824 Jul 16 23:38:26 devstack sudo[107969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:26 devstack sudo[107969]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a65eda23-2e84-43b2-9e64-3c49fdc825c4 tempest-ProjectReaderTests-2093354218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d380d28c-40fc-413f-a648-46cb181ac2a8 1073741824" returned: 0 in 0.411s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a65eda23-2e84-43b2-9e64-3c49fdc825c4 tempest-ProjectReaderTests-2093354218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d380d28c-40fc-413f-a648-46cb181ac2a8 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:26 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d380d28c-40fc-413f-a648-46cb181ac2a8 Jul 16 23:38:26 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:26 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-a65eda23-2e84-43b2-9e64-3c49fdc825c4 tempest-ProjectReaderTests-2093354218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d380d28c-40fc-413f-a648-46cb181ac2a8" returned: 0 in 0.233s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:26 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-a65eda23-2e84-43b2-9e64-3c49fdc825c4 tempest-ProjectReaderTests-2093354218 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:38:26 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-a65eda23-2e84-43b2-9e64-3c49fdc825c4 tempest-ProjectReaderTests-2093354218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:38:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a65eda23-2e84-43b2-9e64-3c49fdc825c4 tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f354fe8b-30c6-4912-83fa-e6a814109a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d380d28c-40fc-413f-a648-46cb181ac2a8', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:38:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a65eda23-2e84-43b2-9e64-3c49fdc825c4 tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (228ecc81-4987-43e0-a671-5f5ceb9b77ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:38:26 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-a65eda23-2e84-43b2-9e64-3c49fdc825c4 tempest-ProjectReaderTests-2093354218 None] Volume volume-d380d28c-40fc-413f-a648-46cb181ac2a8 (d380d28c-40fc-413f-a648-46cb181ac2a8): created successfully Jul 16 23:38:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a65eda23-2e84-43b2-9e64-3c49fdc825c4 tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (228ecc81-4987-43e0-a671-5f5ceb9b77ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:38:26 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-a65eda23-2e84-43b2-9e64-3c49fdc825c4 tempest-ProjectReaderTests-2093354218 None] Flow 'volume_create_manager' (f6526bc8-40bb-4bb9-9f14-76af1c96c2ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:38:26 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-a65eda23-2e84-43b2-9e64-3c49fdc825c4 tempest-ProjectReaderTests-2093354218 None] Created volume successfully. Jul 16 23:38:27 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ccbbf72c-d65b-4458-bb16-15f2b8f882e5 tempest-ProjectReaderTests-2093354218 None] Acquiring lock "cinder-d380d28c-40fc-413f-a648-46cb181ac2a8-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:38:27 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ccbbf72c-d65b-4458-bb16-15f2b8f882e5 tempest-ProjectReaderTests-2093354218 None] Lock "cinder-d380d28c-40fc-413f-a648-46cb181ac2a8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:38:27 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ccbbf72c-d65b-4458-bb16-15f2b8f882e5 tempest-ProjectReaderTests-2093354218 None] Acquiring lock "cinder-quobyte-d380d28c-40fc-413f-a648-46cb181ac2a8" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:38:27 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ccbbf72c-d65b-4458-bb16-15f2b8f882e5 tempest-ProjectReaderTests-2093354218 None] Lock "cinder-quobyte-d380d28c-40fc-413f-a648-46cb181ac2a8" acquired by "delete_volume" :: waited 0.013s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:38:27 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c8578f-d6bd-40c4-b1c1-275dd386ac18]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:38:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ccbbf72c-d65b-4458-bb16-15f2b8f882e5 tempest-ProjectReaderTests-2093354218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d380d28c-40fc-413f-a648-46cb181ac2a8 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:27 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d380d28c-40fc-413f-a648-46cb181ac2a8 Jul 16 23:38:27 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:27 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ccbbf72c-d65b-4458-bb16-15f2b8f882e5 tempest-ProjectReaderTests-2093354218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d380d28c-40fc-413f-a648-46cb181ac2a8" returned: 0 in 0.341s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ccbbf72c-d65b-4458-bb16-15f2b8f882e5 tempest-ProjectReaderTests-2093354218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d380d28c-40fc-413f-a648-46cb181ac2a8 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:27 devstack sudo[107984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d380d28c-40fc-413f-a648-46cb181ac2a8 Jul 16 23:38:27 devstack sudo[107984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:27 devstack sudo[107984]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:27 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ccbbf72c-d65b-4458-bb16-15f2b8f882e5 tempest-ProjectReaderTests-2093354218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-d380d28c-40fc-413f-a648-46cb181ac2a8" returned: 0 in 0.236s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:27 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ccbbf72c-d65b-4458-bb16-15f2b8f882e5 tempest-ProjectReaderTests-2093354218 None] Lock "cinder-quobyte-d380d28c-40fc-413f-a648-46cb181ac2a8" released by "delete_volume" :: held 0.616s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:38:27 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-ccbbf72c-d65b-4458-bb16-15f2b8f882e5 tempest-ProjectReaderTests-2093354218 None] Created reservations ['f1b9db0b-e119-4479-ad5b-0e559bc6f31e', '34125f60-59fc-4f5d-850f-9bc84500e2ea', '6af6bd5e-6521-4ec4-a5e4-9291c9e48c29', 'b9f89525-a88d-43cc-a3b4-188b85366c67'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:38:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ccbbf72c-d65b-4458-bb16-15f2b8f882e5 tempest-ProjectReaderTests-2093354218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:38:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ccbbf72c-d65b-4458-bb16-15f2b8f882e5 tempest-ProjectReaderTests-2093354218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:38:28 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ccbbf72c-d65b-4458-bb16-15f2b8f882e5 tempest-ProjectReaderTests-2093354218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:38:28 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ccbbf72c-d65b-4458-bb16-15f2b8f882e5 tempest-ProjectReaderTests-2093354218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:38:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ccbbf72c-d65b-4458-bb16-15f2b8f882e5 tempest-ProjectReaderTests-2093354218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:38:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ccbbf72c-d65b-4458-bb16-15f2b8f882e5 tempest-ProjectReaderTests-2093354218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:28 devstack sudo[107987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:38:28 devstack sudo[107987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:28 devstack sudo[107987]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ccbbf72c-d65b-4458-bb16-15f2b8f882e5 tempest-ProjectReaderTests-2093354218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.249s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:28 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-ccbbf72c-d65b-4458-bb16-15f2b8f882e5 tempest-ProjectReaderTests-2093354218 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:38:28 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-ccbbf72c-d65b-4458-bb16-15f2b8f882e5 tempest-ProjectReaderTests-2093354218 None] Deleted volume successfully. Jul 16 23:38:28 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-ccbbf72c-d65b-4458-bb16-15f2b8f882e5 tempest-ProjectReaderTests-2093354218 None] Lock "cinder-d380d28c-40fc-413f-a648-46cb181ac2a8-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:38:28 devstack cinder-volume[87607]: DEBUG cinder.volume.flows.manager.create_volume [None req-97747377-ab45-459b-8869-b8bf695b8c07 tempest-ProjectReaderTests-2093354218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87607) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 23:38:28 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-97747377-ab45-459b-8869-b8bf695b8c07 tempest-ProjectReaderTests-2093354218 None] Flow 'volume_create_manager' (50a6e3da-dd76-4b07-b6eb-3d07457767df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:38:28 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-97747377-ab45-459b-8869-b8bf695b8c07 tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e31511e0-a37e-4875-97e5-19a384995b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:38:28 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-97747377-ab45-459b-8869-b8bf695b8c07 tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e31511e0-a37e-4875-97e5-19a384995b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-23720478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71b02195-00a5-4c0a-944c-6c4acc15b44d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3197b703d45b4369ad811f8034e6bc83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:38:29Z,use_quota=True,user_id='154942d9fe634b4aa5b73da15b066fa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:38:28 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-97747377-ab45-459b-8869-b8bf695b8c07 tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6773f04a-8e4d-4323-aa6f-68c37db0fb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:38:28 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-97747377-ab45-459b-8869-b8bf695b8c07 tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6773f04a-8e4d-4323-aa6f-68c37db0fb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:38:28 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-97747377-ab45-459b-8869-b8bf695b8c07 tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82f45d1c-0f15-4e46-8dc9-728e1e8e6372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:38:28 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-97747377-ab45-459b-8869-b8bf695b8c07 tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82f45d1c-0f15-4e46-8dc9-728e1e8e6372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71b02195-00a5-4c0a-944c-6c4acc15b44d', 'volume_name': 'volume-71b02195-00a5-4c0a-944c-6c4acc15b44d', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:38:28 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-97747377-ab45-459b-8869-b8bf695b8c07 tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd11d91f-75c2-415f-a3a8-a3e56c029fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:38:28 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-97747377-ab45-459b-8869-b8bf695b8c07 tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd11d91f-75c2-415f-a3a8-a3e56c029fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:38:28 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-97747377-ab45-459b-8869-b8bf695b8c07 tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71e30c64-9f20-40fc-8297-b8766df23284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:38:28 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-97747377-ab45-459b-8869-b8bf695b8c07 tempest-ProjectReaderTests-2093354218 None] Volume 71b02195-00a5-4c0a-944c-6c4acc15b44d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71b02195-00a5-4c0a-944c-6c4acc15b44d', 'volume_size': 1} Jul 16 23:38:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-97747377-ab45-459b-8869-b8bf695b8c07 tempest-ProjectReaderTests-2093354218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:38:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-97747377-ab45-459b-8869-b8bf695b8c07 tempest-ProjectReaderTests-2093354218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:38:28 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-97747377-ab45-459b-8869-b8bf695b8c07 tempest-ProjectReaderTests-2093354218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T21:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-23720478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71b02195-00a5-4c0a-944c-6c4acc15b44d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3197b703d45b4369ad811f8034e6bc83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T21:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T21:38:29Z,use_quota=True,user_id='154942d9fe634b4aa5b73da15b066fa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41810ae1-cae1-4fbe-b986-863e5147f1d5),volume_type_id=41810ae1-cae1-4fbe-b986-863e5147f1d5)}" {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 23:38:28 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.remotefs [None req-97747377-ab45-459b-8869-b8bf695b8c07 tempest-ProjectReaderTests-2093354218 None] Creating volume 71b02195-00a5-4c0a-944c-6c4acc15b44d {{(pid=87607) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 23:38:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-97747377-ab45-459b-8869-b8bf695b8c07 tempest-ProjectReaderTests-2093354218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:38:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-97747377-ab45-459b-8869-b8bf695b8c07 tempest-ProjectReaderTests-2093354218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:38:28 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-97747377-ab45-459b-8869-b8bf695b8c07 tempest-ProjectReaderTests-2093354218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:38:28 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-97747377-ab45-459b-8869-b8bf695b8c07 tempest-ProjectReaderTests-2093354218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:38:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-97747377-ab45-459b-8869-b8bf695b8c07 tempest-ProjectReaderTests-2093354218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:38:28 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-97747377-ab45-459b-8869-b8bf695b8c07 tempest-ProjectReaderTests-2093354218 None] Selected osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 as target Quobyte volume. {{(pid=87607) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 23:38:28 devstack cinder-volume[87607]: INFO cinder.volume.drivers.remotefs [None req-97747377-ab45-459b-8869-b8bf695b8c07 tempest-ProjectReaderTests-2093354218 None] casted to osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72 Jul 16 23:38:28 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-97747377-ab45-459b-8869-b8bf695b8c07 tempest-ProjectReaderTests-2093354218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-71b02195-00a5-4c0a-944c-6c4acc15b44d 1073741824 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:28 devstack sudo[107990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-71b02195-00a5-4c0a-944c-6c4acc15b44d 1073741824 Jul 16 23:38:28 devstack sudo[107990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:29 devstack sudo[107990]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-97747377-ab45-459b-8869-b8bf695b8c07 tempest-ProjectReaderTests-2093354218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-71b02195-00a5-4c0a-944c-6c4acc15b44d 1073741824" returned: 0 in 0.402s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-97747377-ab45-459b-8869-b8bf695b8c07 tempest-ProjectReaderTests-2093354218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-71b02195-00a5-4c0a-944c-6c4acc15b44d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:29 devstack sudo[107995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-71b02195-00a5-4c0a-944c-6c4acc15b44d Jul 16 23:38:29 devstack sudo[107995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:29 devstack sudo[107995]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-97747377-ab45-459b-8869-b8bf695b8c07 tempest-ProjectReaderTests-2093354218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-71b02195-00a5-4c0a-944c-6c4acc15b44d" returned: 0 in 0.245s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:29 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-97747377-ab45-459b-8869-b8bf695b8c07 tempest-ProjectReaderTests-2093354218 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'} {{(pid=87607) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 23:38:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-97747377-ab45-459b-8869-b8bf695b8c07 tempest-ProjectReaderTests-2093354218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:38:29 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-97747377-ab45-459b-8869-b8bf695b8c07 tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71e30c64-9f20-40fc-8297-b8766df23284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71b02195-00a5-4c0a-944c-6c4acc15b44d', 'volume_size': 1}' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:38:29 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-97747377-ab45-459b-8869-b8bf695b8c07 tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf1268de-19fb-4c02-9249-9cd9f843e6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 23:38:29 devstack cinder-volume[87607]: INFO cinder.volume.flows.manager.create_volume [None req-97747377-ab45-459b-8869-b8bf695b8c07 tempest-ProjectReaderTests-2093354218 None] Volume volume-71b02195-00a5-4c0a-944c-6c4acc15b44d (71b02195-00a5-4c0a-944c-6c4acc15b44d): created successfully Jul 16 23:38:29 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-97747377-ab45-459b-8869-b8bf695b8c07 tempest-ProjectReaderTests-2093354218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf1268de-19fb-4c02-9249-9cd9f843e6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87607) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 23:38:29 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-97747377-ab45-459b-8869-b8bf695b8c07 tempest-ProjectReaderTests-2093354218 None] Flow 'volume_create_manager' (50a6e3da-dd76-4b07-b6eb-3d07457767df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87607) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 23:38:29 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-97747377-ab45-459b-8869-b8bf695b8c07 tempest-ProjectReaderTests-2093354218 None] Created volume successfully. Jul 16 23:38:29 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-8f3b0fb0-2dee-489a-93b0-2498eaeb572c tempest-ProjectReaderTests-2093354218 None] Acquiring lock "cinder-71b02195-00a5-4c0a-944c-6c4acc15b44d-delete_volume" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:38:29 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-8f3b0fb0-2dee-489a-93b0-2498eaeb572c tempest-ProjectReaderTests-2093354218 None] Lock "cinder-71b02195-00a5-4c0a-944c-6c4acc15b44d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:38:29 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-8f3b0fb0-2dee-489a-93b0-2498eaeb572c tempest-ProjectReaderTests-2093354218 None] Acquiring lock "cinder-quobyte-71b02195-00a5-4c0a-944c-6c4acc15b44d" by "delete_volume" {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 23:38:29 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-8f3b0fb0-2dee-489a-93b0-2498eaeb572c tempest-ProjectReaderTests-2093354218 None] Lock "cinder-quobyte-71b02195-00a5-4c0a-944c-6c4acc15b44d" acquired by "delete_volume" :: waited 0.015s {{(pid=87607) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 23:38:29 devstack cinder-volume[87607]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce85ff5-7fff-4e84-9d81-adbdf57829e4]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 23:38:29 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8f3b0fb0-2dee-489a-93b0-2498eaeb572c tempest-ProjectReaderTests-2093354218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-71b02195-00a5-4c0a-944c-6c4acc15b44d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:30 devstack sudo[107999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-71b02195-00a5-4c0a-944c-6c4acc15b44d Jul 16 23:38:30 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:30 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8f3b0fb0-2dee-489a-93b0-2498eaeb572c tempest-ProjectReaderTests-2093354218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-71b02195-00a5-4c0a-944c-6c4acc15b44d" returned: 0 in 0.343s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8f3b0fb0-2dee-489a-93b0-2498eaeb572c tempest-ProjectReaderTests-2093354218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-71b02195-00a5-4c0a-944c-6c4acc15b44d {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:30 devstack sudo[108004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-71b02195-00a5-4c0a-944c-6c4acc15b44d Jul 16 23:38:30 devstack sudo[108004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:30 devstack sudo[108004]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8f3b0fb0-2dee-489a-93b0-2498eaeb572c tempest-ProjectReaderTests-2093354218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9/volume-71b02195-00a5-4c0a-944c-6c4acc15b44d" returned: 0 in 0.240s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:30 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-8f3b0fb0-2dee-489a-93b0-2498eaeb572c tempest-ProjectReaderTests-2093354218 None] Lock "cinder-quobyte-71b02195-00a5-4c0a-944c-6c4acc15b44d" released by "delete_volume" :: held 0.618s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:38:30 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:SELECT=101,cinder:INSERT=40,cinder:UPDATE=146,cinder:DELETE=12 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:38:30 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:DELETE=12,cinder:SELECT=108,cinder:INSERT=34,cinder:UPDATE=134 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:38:30 devstack cinder-volume[87607]: DEBUG cinder.quota [None req-8f3b0fb0-2dee-489a-93b0-2498eaeb572c tempest-ProjectReaderTests-2093354218 None] Created reservations ['9d2f25c0-655a-4917-ab58-49321881db8e', 'ea536584-9a94-4049-b6e2-3db04cd2e72f', '5e5e02cd-8982-46c3-9f50-5d68dad27519', 'b5620939-1cf4-426c-9fb5-b1cd3a656272'] {{(pid=87607) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 23:38:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-8f3b0fb0-2dee-489a-93b0-2498eaeb572c tempest-ProjectReaderTests-2093354218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:38:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-8f3b0fb0-2dee-489a-93b0-2498eaeb572c tempest-ProjectReaderTests-2093354218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:38:30 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-8f3b0fb0-2dee-489a-93b0-2498eaeb572c tempest-ProjectReaderTests-2093354218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:38:30 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-8f3b0fb0-2dee-489a-93b0-2498eaeb572c tempest-ProjectReaderTests-2093354218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:38:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-8f3b0fb0-2dee-489a-93b0-2498eaeb572c tempest-ProjectReaderTests-2093354218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:38:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8f3b0fb0-2dee-489a-93b0-2498eaeb572c tempest-ProjectReaderTests-2093354218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:30 devstack sudo[108007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:38:30 devstack sudo[108007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:30 devstack sudo[108007]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:30 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-8f3b0fb0-2dee-489a-93b0-2498eaeb572c tempest-ProjectReaderTests-2093354218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.238s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:30 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-8f3b0fb0-2dee-489a-93b0-2498eaeb572c tempest-ProjectReaderTests-2093354218 None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:38:30 devstack cinder-volume[87607]: INFO cinder.volume.manager [None req-8f3b0fb0-2dee-489a-93b0-2498eaeb572c tempest-ProjectReaderTests-2093354218 None] Deleted volume successfully. Jul 16 23:38:30 devstack cinder-volume[87607]: DEBUG cinder.coordination [None req-8f3b0fb0-2dee-489a-93b0-2498eaeb572c tempest-ProjectReaderTests-2093354218 None] Lock "cinder-71b02195-00a5-4c0a-944c-6c4acc15b44d-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=87607) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 23:38:39 devstack cinder-volume[87607]: DEBUG oslo_service.periodic_task [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:38:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 16 23:38:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 16 23:38:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72': None} {{(pid=87607) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 23:38:39 devstack cinder-volume[87607]: DEBUG cinder.volume.drivers.quobyte [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-516cc469-583b-4139-bdbc-f411d1591b72'] {{(pid=87607) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 23:38:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.lockutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87607) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 16 23:38:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 23:38:39 devstack sudo[108016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9 Jul 16 23:38:39 devstack sudo[108016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 23:38:39 devstack sudo[108016]: pam_unix(sudo:session): session closed for user root Jul 16 23:38:39 devstack cinder-volume[87607]: DEBUG oslo_concurrency.processutils [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e3a548ca1772a3d33bfe9383a3199cf9" returned: 0 in 0.230s {{(pid=87607) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 23:38:39 devstack cinder-volume[87607]: DEBUG cinder.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Notifying Schedulers of capabilities ... {{(pid=87607) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 23:38:39 devstack cinder-volume[87607]: DEBUG oslo_service.periodic_task [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] Running periodic task VolumeManager._thread_info {{(pid=87607) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 23:38:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] thread count: 28 {{(pid=87607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 23:38:39 devstack cinder-volume[87607]: DEBUG cinder.volume.manager [None req-ca901449-0a34-4b56-808c-f5a2cb1ab234 None None] thread info: [<_MainThread(MainThread, started 139090403627136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87607) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 23:38:40 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:INSERT=2,cinder:UPDATE=6,cinder:SELECT=2 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 23:38:40 devstack cinder-volume[87607]: DEBUG dbcounter [-] [87607] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=87607) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}