| SmolCluster | Distributed Deep Learning Library for Heterogeneous Hardware |
Research Library, Personal Project, Online
Educational Library for training/inference of neural networks across heterogenous compute like Mac minis, Raspberry Pi, and GPUs, written using only socket library in Python. Supports FSDP, Classic Data Parallelism, Elastic DP, Synchronous Parameter Server, and Model Parallelism.