← Open Source
aim-uofa

Matcher

[ICLR'24 & IJCV‘25] Matcher: Segment Anything with One Shot Using All-Purpose Feature Matching.

Model DevelopmentArchitecturePython
Open on GitHub
Momentum
+0stars in 24 hours0.0%
583
Stars
47
Forks
+2
This week
5
Contributors
Created 2023-05-20 · Updated 2026-10-14 · #16583 today
Top developers
yangliu96cshenpaolopertino

aim-uofa/Matcher is ranked 16,583 with 583 stars.

Same-category comparison

aim-uofa/Matcher is ranked 16,583 among these 8 peers; OysterQAQ/ACG2vec is ranked 16,582.

Same-category comparison
NameRankMetrics
google/qkeras16,573
Language:
Python
Stars:
584
Forks:
108
Description:
QKeras: a quantization deep learning library for Tensorflow Keras.
henrikbostrom/crepes16,574
Language:
Python
Stars:
584
Forks:
46
Description:
Python package for conformal prediction.
100/Solid16,578
Language:
Python
Stars:
583
Forks:
60
Description:
🎯 A comprehensive gradient-free optimization framework written in Python.
OysterQAQ/ACG2vec16,582
Stars:
583
Forks:
24
Description:
ACG2vec (Anime Comics Games to vector) are committed to creating a playground that combines ACG and Deep learning.(.
cheind/pytorch-blender16,585
Language:
Python
Stars:
583
Forks:
44
Description:
:sweat_drops: Seamless, distributed, real-time integration of Blender into PyTorch data pipelines.
facebookresearch/optimizers16,587
Language:
Python
Stars:
583
Forks:
67
Description:
For optimization algorithm research and development.
pterhoer/FaceImageQuality16,589
Language:
Python
Stars:
583
Forks:
92
Description:
Code and information for face image quality assessment with SER-FIQ.
stanford-crfm/mistral16,590
Language:
Python
Stars:
583
Forks:
51
Description:
Mistral: A strong, northwesterly wind: Framework for transparent and accessible large-scale language model training, built with Hugging Face 🤗 Transformers.
Key parameters and specifications
Key parameters and specifications
ParameterValue
LanguagePython
CategoryModel Development
SubcategoryArchitecture
KeywordsComputer vision
Stars583
Forks47
Contributors5
Created date2023-05-20
Updated date2026-10-14
Stars in 1 day0
Stars in 7 days2
Rank16,583
Previous rank16,373
Rank change-210
7-day stars rank8,773
Previous 7-day stars rank7,413
7-day stars rank change-1,360
Total stars rank17,166
Previous total stars rank17,137
Total stars rank change-29
CountryChina
README summary

Matcher: Segment Anything with One Shot Using All-Purpose Feature Matching Yang Liu 1* , Muzhi Zhu 1* , Hengtao Li 1* , Hao Chen 1 , Xinlong Wang 2 , Chunhua Shen 1 1 Zhejiang University, 2 Beijing Academy of Artificial Intelligence ICLR 2024 🚀 Overview 📖 Description Powered by large-scale pre-training, vision foundation models exhibit significant potential in open-world image understanding. However, unlike large language models that excel at directly tackling various language tasks, vision foundation models require a task-specific model

structure followed by fine-tuning on specific tasks. In this work, we present **Matcher**, a novel perception paradigm that utilizes off-the-shelf vision foundation models to address various perception tasks. Matcher can segment anything by using an in-context example without training. Additionally, we design three effective components within the Matcher framework to collaborate with these foundation models and unleash their full potential in diverse perception tasks. Matcher demonstrates impressive generalization performance across various segmentation tasks, all without training

. Our visualization results further showcase the open-world generality and flexibility of Matcher when applied to images in the wild. 1 Matcher has been accepted to ICLR 2024! 1 Matcher supports Semantic-SAM for better part segmentation. 1 Release code of one-shot semantic segmentation and one-shot part segmentation tasks. 📖 Recommanded Works SINE: A Simple Image Segmentation Framework via In-Context Examples. DiffewS: Unleashing the Potential of the Diffusion Model in Few-shot Semantic Segmentation. 👻 Getting Started See Preparing

Datasets for Matcher. 🖼️ Demo One-Shot Semantic Segmantation One-Shot Object Part Segmantation Cross-Style Object and Object Part Segmentation Controllable Mask Output Video Object Segmentation 🎫 License For academic use, this project is licensed under the 2-clause BSD License. For commercial use, please contact Chunhua Shen. 🖊️ Citation If you find this project useful in your research, please consider to cite: Acknowledgement SAM, DINOv2, SegGPT, HSNet, Semantic-SAM and detectron2.

Frequently asked questions

How many stars and forks are recorded?

aim-uofa/Matcher has 583 stars and 47 forks.

What is the repository rank?

aim-uofa/Matcher is ranked 16,583.

What language and category are recorded?

aim-uofa/Matcher has 583 stars, uses Python and belongs to Model Development.

Which repository is closest in rank?

aim-uofa/Matcher is compared with OysterQAQ/ACG2vec, ranked 16,582 with 583 stars.

README

Matcher: Segment Anything with One Shot Using All-Purpose Feature Matching

Yang Liu1*,   Muzhi Zhu1*,   Hengtao Li1*,   Hao Chen1,   Xinlong Wang2,   Chunhua Shen1

1Zhejiang University,   2Beijing Academy of Artificial Intelligence

ICLR 2024

🚀 Overview

📖 Description

Powered by large-scale pre-training, vision foundation models exhibit significant potential in open-world image understanding. However, unlike large language models that excel at directly tackling various language tasks, vision foundation models require a task-specific model structure followed by fine-tuning on specific tasks. In this work, we present Matcher, a novel perception paradigm that utilizes off-the-shelf vision foundation models to address various perception tasks. Matcher can segment anything by using an in-context example without training. Additionally, we design three effective components within the Matcher framework to collaborate with these foundation models and unleash their full potential in diverse perception tasks. Matcher demonstrates impressive generalization performance across various segmentation tasks, all without training. Our visualization results further showcase the open-world generality and flexibility of Matcher when applied to images in the wild.

Paper

ℹ️ News

  • 2024.1 Matcher has been accepted to ICLR 2024!
  • 2024.1 Matcher supports Semantic-SAM for better part segmentation.
  • 2024.1 We provide a Gradio Demo.
  • 2024.1 Release code of one-shot semantic segmentation and one-shot part segmentation tasks.

📖 Recommanded Works

  • SINE: A Simple Image Segmentation Framework via In-Context Examples. GitHub.
  • DiffewS: Unleashing the Potential of the Diffusion Model in Few-shot Semantic Segmentation. GitHub.

🗓️ TODO

  • [x] Gradio Demo
  • [x] Release code of one-shot semantic segmentation and one-shot part segmentation tasks
  • [x] Release code and models for VOS (see vos-dev branch)

🏗️ Installation

See installation instructions.

👻 Getting Started

See Preparing Datasets for Matcher.

See Getting Started with Matcher.

🖼️ Demo

One-Shot Semantic Segmantation

One-Shot Object Part Segmantation

Cross-Style Object and Object Part Segmentation

Controllable Mask Output

Video Object Segmentation

https://github.com/aim-uofa/Matcher/assets/119775808/9ff9502d-7d2a-43bc-a8ef-01235097d62b

🎫 License

For academic use, this project is licensed under the 2-clause BSD License. For commercial use, please contact Chunhua Shen.

🖊️ Citation

If you find this project useful in your research, please consider to cite:

@article{liu2023matcher,
  title={Matcher: Segment Anything with One Shot Using All-Purpose Feature Matching},
  author={Liu, Yang and Zhu, Muzhi and Li, Hengtao and Chen, Hao and Wang, Xinlong and Shen, Chunhua},
  journal={arXiv preprint arXiv:2305.13310},
  year={2023}
}

Acknowledgement

SAM, DINOv2, SegGPT, HSNet, Semantic-SAM and detectron2.

Nearby in the ranking
Similar items