Tools for merging pretrained large language models.
-
Updated
Dec 15, 2024 - Python
#
model-merging
Here are 23 public repositories matching this topic...
Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities. arXiv:2408.07666.
generative-model ensemble-learning transfer-learning zero-shot-learning robustness multi-task-learning attack-defense generalization meta-learning model-fusion federated-learning continual-learning few-shot-learning diffusion-models multi-domain-learning foundation-models large-language-models llms model-merging knowledge-fusion
-
Updated
Dec 17, 2024
FusionBench: A Comprehensive Benchmark/Toolkit of Deep Model Fusion
deep-neural-networks machine-learning-algorithms model-fusion multi-tasking model-ensemble large-language-models model-merging model-mixing model-upscaling
-
Updated
Dec 16, 2024 - Python
Code release for Dataless Knowledge Fusion by Merging Weights of Language Models (https://openreview.net/forum?id=FCnohuR6AnM)
-
Updated
Jul 25, 2023 - Python
AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.
-
Updated
Oct 28, 2024 - Python
ZhiJian: A Unifying and Rapidly Deployable Toolbox for Pre-trained Model Reuse
toolbox regularization knowledge-distillation pre-trained-model model-reuse parameter-efficient-tuning model-merging
-
Updated
Sep 2, 2023 - Python
Official repository of "Localizing Task Information for Improved Model Merging and Compression" [ICML 2024]
-
Updated
Oct 25, 2024 - Python
Representation Surgery for Multi-Task Model Merging. ICML, 2024.
-
Updated
Oct 10, 2024 - Python
DELLA-Merging: Reducing Interference in Model Merging through Magnitude-Based Sampling
-
Updated
Jul 12, 2024 - Python
All-in-one UI for merged LLMs in Hugging Face
ai leaderboard merge huggingface large-language-models llm generative-ai model-merging mergekit mergoo
-
Updated
Jun 10, 2024 - Python
Exploring Model Kinship for Merging Large Language Models
natural-language-processing artificial-intelligence merging kinship large-language-models model-merging knowledge-fusion model-kinship
-
Updated
Nov 15, 2024 - Jupyter Notebook
Localize-and-Stitch: Efficient Model Merging via Sparse Task Arithmetic
-
Updated
Aug 27, 2024 - Python
[ECCV'24] MaxFusion: Plug & Play multimodal generation in text to image diffusion models
-
Updated
Nov 2, 2024 - Jupyter Notebook
flow-merge is a powerful Python library that enables seamless merging of multiple transformer-based language models using the most popular merge methods such as model soups, SLERP, ties-MERGING or DARE.
-
Updated
Oct 1, 2024 - Python
[ECCV 2024] MagMax: Leveraging Model Merging for Seamless Continual Learning (official repository)
-
Updated
Jul 29, 2024 - Python
A model merging project for generalizing Featured Finite State Machines (FFSMs) to unify behaviors across Software Product Lines (SPLs)
-
Updated
Nov 2, 2024 - Java
Merge transformers without using like a bajillion GB of RAM
-
Updated
Aug 5, 2023 - Python
An easy-to-use Python library for merging PyTorch models.
-
Updated
Jun 13, 2024 - Python
SurgeryV2: Bridging the Gap Between Model Merging and Multi-Task Learning with Deep Representation Surgery. Arxiv, 2024.
-
Updated
Oct 21, 2024 - Python
This repository serves as a template for creating new projects based on FusionBench. It includes all the necessary configurations and boilerplate code to get started quickly.
-
Updated
Nov 21, 2024 - Python
Improve this page
Add a description, image, and links to the model-merging topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the model-merging topic, visit your repo's landing page and select "manage topics."