← Open Source
SakanaAI

evolutionary-model-merge

Official repository of Evolutionary Optimization of Model Merging Recipes.

Model DevelopmentFine-tuningPython
Open on GitHub
Momentum
+-1stars in 24 hours-0.1%
1.44k
Stars
124
Forks
+-1
This week
1
Contributors
Created 2024-03-05 · Updated 2026-10-16 · #18867 today
Top developers
mkshing

SakanaAI/evolutionary-model-merge is ranked 18,867 with 1,439 stars.

Same-category comparison

SakanaAI/evolutionary-model-merge is ranked 18,867 among these 8 peers; wenet-e2e/wespeaker is ranked 18,868.

Same-category comparison
NameRankMetrics
reczoo/FuxiCTR18,857
Language:
Python
Stars:
1,491
Forks:
240
Description:
A configurable, tunable, and reproducible library for CTR prediction https://fuxictr.github.io.
speedinghzl/CCNet18,858
Language:
Python
Stars:
1,486
Forks:
274
Description:
CCNet: Criss-Cross Attention for Semantic Segmentation (TPAMI 2020 & ICCV 2019).
hysts/pytorch_image_classification18,861
Language:
Python
Stars:
1,451
Forks:
306
Description:
PyTorch implementation of image classification models for CIFAR-10/CIFAR-100/MNIST/FashionMNIST/Kuzushiji-MNIST/ImageNet.
oliverguhr/transformer-time-series-prediction18,862
Language:
Python
Stars:
1,451
Forks:
259
Description:
proof of concept for a transformer-based time series prediction model.
wenet-e2e/wespeaker18,868
Language:
Python
Stars:
1,436
Forks:
208
Description:
Research and Production Oriented Speaker Verification, Recognition and Diarization Toolkit.
gradslam/gradslam18,869
Language:
Python
Stars:
1,426
Forks:
167
Description:
gradslam is an open source differentiable dense SLAM library for PyTorch.
xl0/lovely-tensors18,875
Language:
Jupyter Notebook
Stars:
1,398
Forks:
22
Description:
Tensors, for human consumption.
reiniscimurs/DRL-robot-navigation18,880
Language:
Python
Stars:
1,377
Forks:
195
Description:
Deep Reinforcement Learning for mobile robot navigation in ROS Gazebo simulator. Using Twin Delayed Deep Deterministic Policy Gradient (TD3) neural network, a robot learns to navigate to a random goal point in a simulated environment while avoiding obstacles.
Key parameters and specifications
Key parameters and specifications
ParameterValue
LanguagePython
CategoryModel Development
SubcategoryFine-tuning
Stars1,439
Forks124
Contributors1
Created date2024-03-05
Updated date2026-10-16
Stars in 1 day-1
Stars in 7 days-1
Rank18,867
Previous rank10,322
Rank change-8,545
7-day stars rank17,153
Previous 7-day stars rank12,619
7-day stars rank change-4,534
Total stars rank8,361
Previous total stars rank8,345
Total stars rank change-16
CountryJapan
README summary

🐟 Evolutionary Optimization of Model Merging Recipes 🤗 Models | 👀 Demo | 📚 Paper | 📝 Blog | 🐦 Twitter This repository serves as a central hub for SakanaAI's Evolutionary Model Merge series, showcasing its releases and resources. It includes models and code for reproducing the evaluation presented in our paper. Look forward to more updates and additions coming soon. 1, GAIR/Abel-7B-002 | EvoLLM-JP-v1-10B | 10B | Microsoft Research License | EvoLLM-JP-v1-7B, shisa-gamma-7b-v1 | | EvoLLM-JP-A-v1-7B | 7B | Apache 2

. 0 | shisa-gamma-7b-v1, Arithmo2-Mistral-7B, GAIR/Abel-7B-002 | | EvoVLM-JP-v1-7B | 7B | Apache 2. 6-Mistral-7B, shisa-gamma-7b-v1 Comparing EvoLLM-JP w/ Source LLMs For details on the evaluation, please refer to Section 4. 2** | Comparing EvoVLM-JP w/ Existing VLMs For details on the evaluation, please see Section 4. 50 | | Heron BLIP Japanese StableLM Base 7B llava-620k | 14. 25** | \*1: Japanese Stable VLM cannot be evaluated using the JA-VG

-VQA-500 dataset because this model has used this dataset for training. Download fastext Model We use fastext to detect language for evaluation. Please download from this link and place it in your current directory. If you place the file in a directory other than the current directory, specify the path to the file using the environment variable. Install Libraries We conducted our tests in the following environment: Python Version 3. We cannot guarantee that it will work in other

environments. Run To launch evaluation, run the following script with a certain config. Acknowledgement We would like to thank the developers of the source models for their contributions and for making their work available. Our math evaluation code builds on the WizardMath repository, and we are grateful for their work.

Frequently asked questions

How many stars and forks are recorded?

SakanaAI/evolutionary-model-merge has 1,439 stars and 124 forks.

What is the repository rank?

SakanaAI/evolutionary-model-merge is ranked 18,867.

What language and category are recorded?

SakanaAI/evolutionary-model-merge has 1,439 stars, uses Python and belongs to Model Development.

Which repository is closest in rank?

SakanaAI/evolutionary-model-merge is compared with wenet-e2e/wespeaker, ranked 18,868 with 1,436 stars.

README

🐟 Evolutionary Optimization of Model Merging Recipes

🤗 Models | 👀 Demo | 📚 Paper | 📝 Blog | 🐦 Twitter

This repository serves as a central hub for SakanaAI's Evolutionary Model Merge series, showcasing its releases and resources. It includes models and code for reproducing the evaluation presented in our paper. Look forward to more updates and additions coming soon.

Models

Our Models

Model Size License Source
EvoLLM-JP-v1-7B 7B Microsoft Research License shisa-gamma-7b-v1, WizardMath-7B-V1.1, GAIR/Abel-7B-002
EvoLLM-JP-v1-10B 10B Microsoft Research License EvoLLM-JP-v1-7B, shisa-gamma-7b-v1
EvoLLM-JP-A-v1-7B 7B Apache 2.0 shisa-gamma-7b-v1, Arithmo2-Mistral-7B, GAIR/Abel-7B-002
EvoVLM-JP-v1-7B 7B Apache 2.0 LLaVA-1.6-Mistral-7B, shisa-gamma-7b-v1

Comparing EvoLLM-JP w/ Source LLMs

For details on the evaluation, please refer to Section 4.1 of the paper.

Model MGSM-JA (acc ↑) lm-eval-harness (avg ↑)
Shisa Gamma 7B v1 9.6 66.1
WizardMath 7B V1.1 18.4 60.1
Abel 7B 002 30.0 56.5
Arithmo2 Mistral 7B 24.0 56.4
EvoLLM-JP-A-v1-7B 52.4 69.0
EvoLLM-JP-v1-7B 52.0 70.5
EvoLLM-JP-v1-10B 55.6 66.2

Comparing EvoVLM-JP w/ Existing VLMs

For details on the evaluation, please see Section 4.2 of the paper.

Model JA-VG-VQA-500 (ROUGE-L ↑) JA-VLM-Bench-In-the-Wild (ROUGE-L ↑)
LLaVA-1.6-Mistral-7B 14.32 41.10
Japanese Stable VLM -*1 40.50
Heron BLIP Japanese StableLM Base 7B llava-620k 14.51 33.26
EvoVLM-JP-v1-7B 19.70 51.25
  • *1: Japanese Stable VLM cannot be evaluated using the JA-VG-VQA-500 dataset because this model has used this dataset for training.

Reproducing the Evaluation

1. Clone the Repo

git clone https://github.com/SakanaAI/evolutionary-model-merge.git
cd evolutionary-model-merge

2. Download fastext Model

We use fastext to detect language for evaluation. Please download lid.176.ftz from this link and place it in your current directory. If you place the file in a directory other than the current directory, specify the path to the file using the LID176FTZ_PATH environment variable.

3. Install Libraries

pip install -e .

We conducted our tests in the following environment: Python Version 3.10.12 and CUDA Version 12.3. We cannot guarantee that it will work in other environments.

4. Run

To launch evaluation, run the following script with a certain config. All configs used for the paper are in configs.

python evaluate.py --config_path {path-to-config}

Acknowledgement

We would like to thank the developers of the source models for their contributions and for making their work available. Our math evaluation code builds on the WizardMath repository, and we are grateful for their work.

Nearby in the ranking
Similar items