Overview

From scratch implementation of Gemma

Technical Details

• Framework: PyTorch
• Dataset: TinyShakespeare
• Category: Language Models

Implementation Details

I implemented the Gemma using Pytorch on the tineshakespeare dataset.

Gemma: Open Models Based on Gemini Research and Technology

Datasets

tinyshakespeare: Link

Frameworks:

Pytorch

Source Code

📁 GitHub Repository: Gemma

View the complete implementation, training scripts, and documentation on GitHub.