Skip to content

@AlibabaPAI Alibaba Group - PAI

Change the repository type filter

All

    Repositories list

    21 repositories

    • torchacc

      Public
      PyTorch distributed training acceleration framework
      pytorchxlallm-training
      Python
      •
      Apache License 2.0
      •5•34•3•5•Updated Nov 19, 2024Nov 19, 2024

    • FlashModels

      Public
      Fast and easy distributed model training examples.
      deep-learningpytorchzerodata-parallelismmodel-parallelismdistributed-trainingxlatensor-parallelismllmfsdp
      Python
      •
      Apache License 2.0
      •4•9•0•4•Updated Nov 19, 2024Nov 19, 2024

    • xla

      Public
      Enabling PyTorch on XLA Devices (e.g. Google TPU)
      C++
      •
      Other
      •482•1•0•2•Updated Nov 19, 2024Nov 19, 2024

    • llumnix

      Public
      Efficient and easy multi-instance LLM serving
      Python
      •
      Apache License 2.0
      •12•213•0•6•Updated Nov 18, 2024Nov 18, 2024

    • openxla

      Public
      A machine learning compiler for GPUs, CPUs, and ML accelerators
      C++
      •
      Apache License 2.0
      •434•0•0•0•Updated Nov 7, 2024Nov 7, 2024

    • reconfigurable-dl-scheduler

      Public
      Apache License 2.0
      •0•0•0•0•Updated Oct 31, 2024Oct 31, 2024

    • easyckpt

      Public
      Apache License 2.0
      •0•2•0•0•Updated Oct 12, 2024Oct 12, 2024

    • transformers

      Public
      🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
      Python
      •
      Apache License 2.0
      •27k•0•0•2•Updated Sep 24, 2024Sep 24, 2024

    • Megatron

      Public
      Ongoing research training transformer models at scale
      Python
      •
      Other
      •2.4k•0•0•0•Updated Sep 13, 2024Sep 13, 2024

    • FLASHNN

      Public
      Python
      •
      Apache License 2.0
      •8•79•1•2•Updated Sep 9, 2024Sep 9, 2024

    • accelerate

      Public
      🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support
      Python
      •
      Apache License 2.0
      •968•0•0•0•Updated Aug 27, 2024Aug 27, 2024

    • pytorch

      Public
      Tensors and Dynamic neural networks in Python with strong GPU acceleration
      Python
      •
      Other
      •23k•0•0•0•Updated Aug 5, 2024Aug 5, 2024

    • OLMo

      Public
      Modeling, training, eval, and inference code for OLMo
      Python
      •
      Apache License 2.0
      •474•0•0•0•Updated Feb 4, 2024Feb 4, 2024

    • Modelzoo-Data

      Public archive
      DeepRec modelzoo's data set
      Python
      •
      Apache License 2.0
      •2•1•0•0•Updated Feb 16, 2023Feb 16, 2023

    • EasyParallelLibrary

      Public
      Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed giant model training.
      Python
      •
      Apache License 2.0
      •49•0•0•0•Updated Feb 28, 2022Feb 28, 2022

    • nni

      Public
      An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.
      Python
      •
      MIT License
      •1.8k•0•0•0•Updated Nov 30, 2021Nov 30, 2021

    • DAPPLE

      Public
      An Efficient Pipelined Data Parallel Approach for Training Large Model
      pipeline-parallelismhybrid-parallelismdistribution-strategy-planner
      Python
      •15•70•0•0•Updated Dec 11, 2020Dec 11, 2020

    • one_shot_text_labeling

      Public
      code and data for paper "One-shot Text Field Labeling using Attention and BeliefPropagation for Structure Information Extraction"
      MIT License
      •6•61•3•0•Updated Aug 9, 2020Aug 9, 2020

    • sparsehash-c11

      Public
      Experimental C++11 version of sparsehash
      C++
      •
      BSD 3-Clause "New" or "Revised" License
      •59•0•0•0•Updated May 26, 2020May 26, 2020

    • gradient-checkpointing

      Public
      Make huge neural nets fit in memory
      Python
      •
      MIT License
      •271•2•0•0•Updated Jan 19, 2018Jan 19, 2018

    • tpu-demos

      Public
      Python
      •
      Apache License 2.0
      •1.8k•0•0•0•Updated Jan 9, 2018Jan 9, 2018