From e057d7f45becb2bd4eef184c74a700132b2ec223 Mon Sep 17 00:00:00 2001 From: Mikhail Poludin Date: Tue, 19 Nov 2024 11:00:16 +0100 Subject: [PATCH] Change 'three' to 'four' in README (#202) --- scripts/README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/README.md b/scripts/README.md index 1613d8cd..79d2e195 100644 --- a/scripts/README.md +++ b/scripts/README.md @@ -2,7 +2,7 @@ ## Fine-tuning -In the handbook, we provide three main ways to align LLMs for chat: +In the handbook, we provide four main ways to align LLMs for chat: - Full fine-tuning on a multi-GPU machine with DeepSpeed ZeRO-3 (tested on an 8 x A100 (80GB) node). - LoRA or QLoRA fine-tuning on a single consumer 24GB GPU (tested on an RTX 4090).