HomebrewNLP

All

6 repositories

Olmax
Public
HomebrewNLP in JAX flavour for maintable TPU-Training
tpu jax
Python
•
BSD 2-Clause "Simplified" License
•6•47•26•2•Updated Jan 20, 2024Jan 20, 2024
HomebrewNLP-MTF
Public archive
HomebrewNLP in Mesh-TensorFlow flavour for distributed TPU training
hpc tensorflow transformer gpt tpu revnet mesh-tensorflow mlp-mixer momentumnet
Python
•
BSD 2-Clause "Simplified" License
•2•0•0•0•Updated Feb 1, 2023Feb 1, 2023
revlib
Public
Simple and efficient RevNet-Library for PyTorch with XLA and DeepSpeed support and parameter offload
tpu revnet xla deepspeed momentumnet deep-learning pytorch
Python
•
BSD 2-Clause "Simplified" License
•6•124•1•1•Updated Aug 6, 2022Aug 6, 2022
HomebrewNLP
Public
A case study of efficient training of large language models using commodity hardware.
machine-learning research pytorch artificial-intelligence transformer attention gpt
Python
•
BSD 2-Clause "Simplified" License
•8•68•1•1•Updated Aug 4, 2022Aug 4, 2022
AGI-at-Home
Public
AGI@Home
robotics agi artificial-general-intelligence unsupervised-machine-learning
Python
•0•6•2•0•Updated Jun 24, 2022Jun 24, 2022
lm-evaluation-harness
Public
A framework for few-shot evaluation of autoregressive language models.
Python
•
MIT License
•2k•0•0•0•Updated May 16, 2022May 16, 2022