vLLM HPC Installer

Automated installation script for vLLM on HPC systems with ROCm support. This installer specifically targets AMD MI300X GPUs and similar architectures in HPC environments.

Features

• Automated installation of vLLM and all dependencies
• ROCm support with PyTorch nightly builds
• Flash Attention integration
• Anaconda environment management
• Comprehensive logging and error handling
• HPC module management
• Support for AMD MI300X GPUs (customizable for other architectures)

Prerequisites

• Access to an HPC system with ROCm support
• AMD GPU (default configuration for MI300X)
• Git
• Anaconda/Miniconda
• Module environment system

Quick Start

1. Clone the repository:

git clone https://github.com/AI-DarwinLabs/vllm-hpc-installer.git
cd vllm-hpc-installer

2. Make the script executable:

chmod +x install.sh

3. Run the installer:

./install.sh

Configuration

You can customize the installation by editing config/default_config.sh:

• PYTHON_VERSION: Python version (default: 3.11)
• PYTORCH_ROCM_VERSION: ROCm version for PyTorch (default: 6.2)
• GPU_ARCH: GPU architecture (default: gfx942 for MI300X)
• CONDA_ENV_NAME: Name of the conda environment (default: vllm)

Directory Structure

vllm-hpc-installer/
├── install.sh           # Main installation script
├── config/             # Configuration files
├── modules/            # Installation modules
└── docs/              # Documentation

Documentation

• Installation Guide
• Contributing Guidelines
• Changelog

Support

For issues and feature requests, please use the GitHub Issues page.

Contributing

Contributions are welcome! Please read our Contributing Guidelines before submitting pull requests.