🛠️ Red Russian Gemma (WIP)

Overview

This project fine-tunes a Gemma language model using PEFT and LoRA on this dataset.

This is a dataset of texts by communist authors of the Soviet era. Everything is in Russian language.

The goal is to generate text that reflects general communistic patterns (and writing styles of any of these author) in writing speech.

Name		Name	Last commit message	Last commit date
Latest commit History 8 Commits
data		data
imgs		imgs
scripts		scripts
.gitignore		.gitignore
README.md		README.md
red-russian-gemma-lora-hf.ipynb		red-russian-gemma-lora-hf.ipynb