SwabianGPT: How I finetuned a LLM for dialect-translation
A practical journey through fine-tuning a LLAMA 3.1 model to translate between Standard German and Swabian dialect, covering data preparation with synthetic context, QLoRA-based training techniques, …