Overview

From scratch implementation of Llama

Technical Details

• Framework: PyTorch
• Dataset: TinyShakespeare
• Category: Language Models

Implementation Details

I implemented Llama using Pytorch on the tineshakespeare dataset.

LLaMA: Open and Efficient Foundation Language Models.

Datasets

tinyshakespeare: Link

Frameworks:

Pytorch

Source Code

📁 GitHub Repository: Llama

View the complete implementation, training scripts, and documentation on GitHub.