Model Fusion Explorer Lab
Discover the cutting-edge research in AI model merging and fusion techniques
Model Fusion
Combining multiple AI models for superior performance
Latest Research Breakthroughs
Evolutionary
arXiv:2509.12951
Black-box Model Merging
Merging API-only models like GPT-4 without weight access using evolutionary algorithms
+22% math accuracy
Gradient
arXiv:2410.08371
Differentiable Adaptive Merging
80% faster merging via learned coefficients with gradient descent
Optimized merge weights
Multilingual
arXiv:2408.07666
Multi-Lingual Fusion
Merged 7 language models achieving 92.3% of GPT-4 at 20% cost
Cross-lingual transfer
Benchmark Results
| Technique | STEM Acc. | Coding Acc. | Safety Score | Training Cost |
|---|---|---|---|---|
| Blackbox (Evo-Merging) | 84.5% | 76.8% | 92.1 | $8,200 |
| DAM | 82.1% | 74.3% | 89.7 | $1,900 |
| TIES-Merging | 79.4% | 70.1% | 85.2 | $3,500 |
| Model Soup | 75.6% | 68.9% | 82.4 | $600 |
Model Composition
Blackbox Baseline Architecture
Mistral-8x22B (35%)
DeepSeek-Coder (30%)
Qwen-72B (25%)
Blackbox-Lex (10%)
Start Exploring Model Fusion Today
Experiment with cutting-edge model merging techniques using our open-source toolkit
git clone https://github.com/huggingface/mergekit
mergekit-yaml phi-3.yaml merge_output --allow-crimes