Curated collection of notable models and spaces from the week of April 17.
merve PRO
merve
AI & ML interests
I love this website
VLMs, vision & co
Recent Activity
new activity 1 day ago
lerobot/pi0fast-base:Add eval results for VLABench new activity 1 day ago
nvidia/GR00T-N1-2B:Add eval results for VLABench new activity 1 day ago
lerobot/pi05_base:Add eval results for VLABenchOrganizations
![Unofficial Mistral Community [deprecated]'s profile picture](https://cdn-avatars.huggingface.co/v1/production/uploads/6141a88b3a0ec78603c9e784/HAdAzcs1CDB9OxgxT2W9K.png)
-
google/translategemma-27b-it
Image-Text-to-Text • Updated • 13.5k • 366 -
kakaocorp/kanana-2-30b-a3b-mid-2601
Text Generation • 31B • Updated • 42 • 31 -
black-forest-labs/FLUX.2-klein-base-4B
Image-to-Image • Updated • 1.48M • • 126 -
google/translategemma-12b-it
Image-Text-to-Text • Updated • 17.7k • 293
A collection of real-time detectors.
-
facebook/metaclip-2-worldwide-s16
Zero-Shot Image Classification • 0.4B • Updated • 178 • 9 -
facebook/metaclip-2-worldwide-m16
Zero-Shot Image Classification • 0.5B • Updated • 419 • 4 -
facebook/metaclip-2-worldwide-l14
Zero-Shot Image Classification • 1B • Updated • 391 • 13 -
facebook/metaclip-2-worldwide-b32
Zero-Shot Image Classification • 0.6B • Updated • 102 • 7
All the releases of the week of 30th May.
A collection of DSE models for multimodal retrieval
Models and datasets of the second week of Jan 2025.
-
ibm-granite/granite-3.0-8b-instruct
Text Generation • Updated • 27.6k • 206 -
ibm-granite/granite-3.0-2b-instruct
Text Generation • 3B • Updated • 5.28k • 49 -
CohereLabs/aya-expanse-8b
Text Generation • 8B • Updated • 18.3k • 424 -
CohereLabs/aya-expanse-32b
Text Generation • 32B • Updated • 10.9k • • 292
Recent depth models
Collection of useful computer vision backbones to fine-tune. It also includes large image classification models, that can be used as backbone.
-
microsoft/resnet-50
Image Classification • Updated • 316k • • 492 -
google/vit-base-patch16-224-in21k
Image Feature Extraction • 86.4M • Updated • 5.01M • 404 -
google/vit-base-patch32-224-in21k
Image Feature Extraction • 88M • Updated • 10.8k • 19 -
facebook/dinov2-large
Image Feature Extraction • 0.3B • Updated • 1.45M • 105
-
facebook/detr-resnet-50
Object Detection • 41.6M • Updated • 229k • • 946 -
facebook/detr-resnet-101-dc5
Object Detection • 60.7M • Updated • 2.13k • 19 -
facebook/detr-resnet-50-dc5
Object Detection • 41.6M • Updated • 7.27k • 6 -
google/owlvit-base-patch32
Zero-Shot Object Detection • 0.2B • Updated • 170k • 148
This is a collection for models that can be used for zero-shot image classification.
-
openai/clip-vit-large-patch14
Zero-Shot Image Classification • 0.4B • Updated • 21.2M • 2k -
openai/clip-vit-base-patch32
Zero-Shot Image Classification • Updated • 20.4M • 918 -
laion/CLIP-ViT-bigG-14-laion2B-39B-b160k
Zero-Shot Image Classification • Updated • 66.2k • 311 -
kakaobrain/align-base
Zero-Shot Image Classification • Updated • 15.1k • 31
-
microsoft/xclip-base-patch32
Video Classification • 0.2B • Updated • 234k • 109 -
facebook/timesformer-base-finetuned-k400
Video Classification • Updated • 19.5k • 43 -
facebook/timesformer-base-finetuned-k600
Video Classification • Updated • 2.68k • 12 -
google/vivit-b-16x2
Video Classification • Updated • 19.2k • 11
This collection contains models and demos of SAM and it's smaller friends.
A collection dedicated to SigLIP applications
-
Draw To Search Art
🐠73Draw/upload image and search among WikiART using SigLIP
-
Compare Clip Siglip
🏃23Compare strong zero-shot image classification models
-
Multilingual Zero Shot Image Clf
🏢13Comparing powerful multilingual zero-shot image clf models
-
BAAI/bunny-phi-2-siglip-lora
Text Generation • Updated • 75 • 48
A collection of everything SegGPT.
-
google/owlvit-base-patch32
Zero-Shot Object Detection • 0.2B • Updated • 170k • 148 -
google/owlvit-base-patch16
Zero-Shot Object Detection • Updated • 11.1k • 13 -
google/owlvit-large-patch14
Zero-Shot Object Detection • Updated • 12.7k • 29 -
google/owlv2-base-patch16
Zero-Shot Object Detection • 0.2B • Updated • 19.9k • 30
-
google/owlvit-base-patch32
Zero-Shot Object Detection • 0.2B • Updated • 170k • 148 -
google/owlvit-base-patch16
Zero-Shot Object Detection • Updated • 11.1k • 13 -
google/owlvit-large-patch14
Zero-Shot Object Detection • Updated • 12.7k • 29 -
google/owlv2-base-patch16
Zero-Shot Object Detection • 0.2B • Updated • 19.9k • 30
A collection of video-language models
-
Video Llava
🐨21Generate descriptions by uploading images or videos
-
llava-hf/LLaVA-NeXT-Video-7B-hf
Video-Text-to-Text • 7B • Updated • 109k • 121 -
llava-hf/LLaVA-NeXT-Video-7B-DPO-hf
Video-Text-to-Text • 7B • Updated • 3.1k • 11 -
llava-hf/LLaVA-NeXT-Video-7B-32K-hf
Image-Text-to-Text • 8B • Updated • 202 • 8
Curated collection of notable models and spaces from the week of April 17.
-
OpenMOSS-Team/MOSS-Audio-4B-Instruct
Audio-Text-to-Text • 5B • Updated • 421 • 28 -
OpenMOSS-Team/MOSS-Audio-8B-Thinking
Audio-Text-to-Text • 9B • Updated • 607 • 40 -
bytedance-research/Timer-S1
Time Series Forecasting • 8B • Updated • 1.59k • 19 -
BugTraceAI/BugTraceAI-Apex-G4-26B-Q4
25B • Updated • 17.2k • 54
YOLO26 models: detection, segmentation, classification, pose, and OBB variants with demos and ONNX variants.
-
Wuli-art/Qwen-Image-2512-Turbo-LoRA
Text-to-Image • Updated • 10k • 214 -
miromind-ai/MiroThinker-v1.5-235B
Text Generation • 235B • Updated • 118 • 254 -
prithivMLmods/Qwen-Image-Edit-2511-Object-Remover
Image-to-Image • Updated • 6.28k • • 56 -
tencent/Youtu-LLM-2B-Base
Text Generation • Updated • 2.73k • 42
-
facebook/sam3
Mask Generation • 0.9B • Updated • 2.29M • 1.91k -
SAM3 Video Segmentation
🐠112Track and label objects in videos using text prompts or clicks
-
onnx-community/sam3-tracker-ONNX
Mask Generation • Updated • 945 • 31 -
SAM3 Tracker WebGPU
🎯30Segment images with click points and download cutouts
-
NVLM: Open Frontier-Class Multimodal LLMs
Paper • 2409.11402 • Published • 74 -
BRAVE: Broadening the visual encoding of vision-language models
Paper • 2404.07204 • Published • 20 -
Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models
Paper • 2403.18814 • Published • 48 -
Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Multimodal Models
Paper • 2409.17146 • Published • 121
Models mentioned in https://huggingface.co/papers/2404.07204
-
facebook/dinov2-large
Image Feature Extraction • 0.3B • Updated • 1.45M • 105 -
google/flan-t5-xl
3B • Updated • 78.2k • 532 -
google/siglip-large-patch16-384
Zero-Shot Image Classification • 0.7B • Updated • 105k • 11 -
google/vit-huge-patch14-224-in21k
Image Feature Extraction • 0.6B • Updated • 19.8k • 22
-
facebook/deit-base-distilled-patch16-384
Image Classification • 87.6M • Updated • 182k • • 8 -
facebook/convnextv2-base-1k-224
Image Classification • 88.7M • Updated • 4.5k • • 4 -
facebook/deit-base-distilled-patch16-224
Image Classification • Updated • 6.43k • • 34 -
google/vit-base-patch32-384
Image Classification • 88.3M • Updated • 5.09k • • 23
A collection of instance/semantic/panoptic segmentation models.
-
facebook/maskformer-swin-large-coco
Image Segmentation • 0.2B • Updated • 465 • 27 -
nvidia/segformer-b0-finetuned-ade-512-512
Image Segmentation • 3.75M • Updated • 376k • • 184 -
facebook/detr-resnet-50-dc5-panoptic
Image Segmentation • 43M • Updated • 53 • 3 -
nvidia/segformer-b5-finetuned-cityscapes-1024-1024
Image Segmentation • Updated • 35.5k • • 43
Collection of image to image editing, image enhancement (SR, deblur, brighten) and text-to-image adapter models.
This collection contains image captioning and OCR models.
-
Salesforce/blip-image-captioning-large
Image-to-Text • 0.5B • Updated • 1.42M • 1.47k -
Salesforce/blip-image-captioning-base
Image-to-Text • Updated • 2.19M • 849 -
microsoft/trocr-base-handwritten
Image-to-Text • 0.3B • Updated • 160k • 491 -
microsoft/git-large-coco
Image-to-Text • 0.4B • Updated • 5.79k • 105
Foundation models for computer vision.
Models and applications of OWL-ViT and OWLv2.
A collection of open-source document AI 📄 📝 📈
Papers about vision-language models, most important ones are on top of the list.
-
Improved Baselines with Visual Instruction Tuning
Paper • 2310.03744 • Published • 39 -
DeepSeek-VL: Towards Real-World Vision-Language Understanding
Paper • 2403.05525 • Published • 49 -
Qwen-VL: A Frontier Large Vision-Language Model with Versatile Abilities
Paper • 2308.12966 • Published • 11 -
LLaVA-Gemma: Accelerating Multimodal Foundation Models with a Compact Language Model
Paper • 2404.01331 • Published • 27
-
google/owlvit-base-patch32
Zero-Shot Object Detection • 0.2B • Updated • 170k • 148 -
google/owlvit-base-patch16
Zero-Shot Object Detection • Updated • 11.1k • 13 -
google/owlvit-large-patch14
Zero-Shot Object Detection • Updated • 12.7k • 29 -
google/owlv2-base-patch16
Zero-Shot Object Detection • 0.2B • Updated • 19.9k • 30
A comprehensive collection on DAv2
This collection has all the vision language leaderboards.
-
Vidore Leaderboard
🥇206Browse and compare visual document retrieval model scores
-
Open VLM Leaderboard
🌎1.01kVLMEvalKit Evaluation Results Collection
-
Vision Arena (Testing VLMs side-by-side)
🖼562Explore AI-powered visual tasks in Vision Arena
-
SEED-Bench Leaderboard
🏆85Submit model evaluation results to leaderboard
All the models and demos for SAM2
Curated collection of notable models and spaces from the week of April 17.
Curated collection of notable models and spaces from the week of April 17.
-
OpenMOSS-Team/MOSS-Audio-4B-Instruct
Audio-Text-to-Text • 5B • Updated • 421 • 28 -
OpenMOSS-Team/MOSS-Audio-8B-Thinking
Audio-Text-to-Text • 9B • Updated • 607 • 40 -
bytedance-research/Timer-S1
Time Series Forecasting • 8B • Updated • 1.59k • 19 -
BugTraceAI/BugTraceAI-Apex-G4-26B-Q4
25B • Updated • 17.2k • 54
-
google/translategemma-27b-it
Image-Text-to-Text • Updated • 13.5k • 366 -
kakaocorp/kanana-2-30b-a3b-mid-2601
Text Generation • 31B • Updated • 42 • 31 -
black-forest-labs/FLUX.2-klein-base-4B
Image-to-Image • Updated • 1.48M • • 126 -
google/translategemma-12b-it
Image-Text-to-Text • Updated • 17.7k • 293
YOLO26 models: detection, segmentation, classification, pose, and OBB variants with demos and ONNX variants.
-
Wuli-art/Qwen-Image-2512-Turbo-LoRA
Text-to-Image • Updated • 10k • 214 -
miromind-ai/MiroThinker-v1.5-235B
Text Generation • 235B • Updated • 118 • 254 -
prithivMLmods/Qwen-Image-Edit-2511-Object-Remover
Image-to-Image • Updated • 6.28k • • 56 -
tencent/Youtu-LLM-2B-Base
Text Generation • Updated • 2.73k • 42
A collection of real-time detectors.
-
facebook/sam3
Mask Generation • 0.9B • Updated • 2.29M • 1.91k -
SAM3 Video Segmentation
🐠112Track and label objects in videos using text prompts or clicks
-
onnx-community/sam3-tracker-ONNX
Mask Generation • Updated • 945 • 31 -
SAM3 Tracker WebGPU
🎯30Segment images with click points and download cutouts
-
facebook/metaclip-2-worldwide-s16
Zero-Shot Image Classification • 0.4B • Updated • 178 • 9 -
facebook/metaclip-2-worldwide-m16
Zero-Shot Image Classification • 0.5B • Updated • 419 • 4 -
facebook/metaclip-2-worldwide-l14
Zero-Shot Image Classification • 1B • Updated • 391 • 13 -
facebook/metaclip-2-worldwide-b32
Zero-Shot Image Classification • 0.6B • Updated • 102 • 7
All the releases of the week of 30th May.
A collection of DSE models for multimodal retrieval
Models and datasets of the second week of Jan 2025.
-
NVLM: Open Frontier-Class Multimodal LLMs
Paper • 2409.11402 • Published • 74 -
BRAVE: Broadening the visual encoding of vision-language models
Paper • 2404.07204 • Published • 20 -
Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models
Paper • 2403.18814 • Published • 48 -
Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Multimodal Models
Paper • 2409.17146 • Published • 121
-
ibm-granite/granite-3.0-8b-instruct
Text Generation • Updated • 27.6k • 206 -
ibm-granite/granite-3.0-2b-instruct
Text Generation • 3B • Updated • 5.28k • 49 -
CohereLabs/aya-expanse-8b
Text Generation • 8B • Updated • 18.3k • 424 -
CohereLabs/aya-expanse-32b
Text Generation • 32B • Updated • 10.9k • • 292
Recent depth models
Models mentioned in https://huggingface.co/papers/2404.07204
-
facebook/dinov2-large
Image Feature Extraction • 0.3B • Updated • 1.45M • 105 -
google/flan-t5-xl
3B • Updated • 78.2k • 532 -
google/siglip-large-patch16-384
Zero-Shot Image Classification • 0.7B • Updated • 105k • 11 -
google/vit-huge-patch14-224-in21k
Image Feature Extraction • 0.6B • Updated • 19.8k • 22
Collection of useful computer vision backbones to fine-tune. It also includes large image classification models, that can be used as backbone.
-
microsoft/resnet-50
Image Classification • Updated • 316k • • 492 -
google/vit-base-patch16-224-in21k
Image Feature Extraction • 86.4M • Updated • 5.01M • 404 -
google/vit-base-patch32-224-in21k
Image Feature Extraction • 88M • Updated • 10.8k • 19 -
facebook/dinov2-large
Image Feature Extraction • 0.3B • Updated • 1.45M • 105
-
facebook/deit-base-distilled-patch16-384
Image Classification • 87.6M • Updated • 182k • • 8 -
facebook/convnextv2-base-1k-224
Image Classification • 88.7M • Updated • 4.5k • • 4 -
facebook/deit-base-distilled-patch16-224
Image Classification • Updated • 6.43k • • 34 -
google/vit-base-patch32-384
Image Classification • 88.3M • Updated • 5.09k • • 23
-
facebook/detr-resnet-50
Object Detection • 41.6M • Updated • 229k • • 946 -
facebook/detr-resnet-101-dc5
Object Detection • 60.7M • Updated • 2.13k • 19 -
facebook/detr-resnet-50-dc5
Object Detection • 41.6M • Updated • 7.27k • 6 -
google/owlvit-base-patch32
Zero-Shot Object Detection • 0.2B • Updated • 170k • 148
A collection of instance/semantic/panoptic segmentation models.
-
facebook/maskformer-swin-large-coco
Image Segmentation • 0.2B • Updated • 465 • 27 -
nvidia/segformer-b0-finetuned-ade-512-512
Image Segmentation • 3.75M • Updated • 376k • • 184 -
facebook/detr-resnet-50-dc5-panoptic
Image Segmentation • 43M • Updated • 53 • 3 -
nvidia/segformer-b5-finetuned-cityscapes-1024-1024
Image Segmentation • Updated • 35.5k • • 43
This is a collection for models that can be used for zero-shot image classification.
-
openai/clip-vit-large-patch14
Zero-Shot Image Classification • 0.4B • Updated • 21.2M • 2k -
openai/clip-vit-base-patch32
Zero-Shot Image Classification • Updated • 20.4M • 918 -
laion/CLIP-ViT-bigG-14-laion2B-39B-b160k
Zero-Shot Image Classification • Updated • 66.2k • 311 -
kakaobrain/align-base
Zero-Shot Image Classification • Updated • 15.1k • 31
Collection of image to image editing, image enhancement (SR, deblur, brighten) and text-to-image adapter models.
-
microsoft/xclip-base-patch32
Video Classification • 0.2B • Updated • 234k • 109 -
facebook/timesformer-base-finetuned-k400
Video Classification • Updated • 19.5k • 43 -
facebook/timesformer-base-finetuned-k600
Video Classification • Updated • 2.68k • 12 -
google/vivit-b-16x2
Video Classification • Updated • 19.2k • 11
This collection contains image captioning and OCR models.
-
Salesforce/blip-image-captioning-large
Image-to-Text • 0.5B • Updated • 1.42M • 1.47k -
Salesforce/blip-image-captioning-base
Image-to-Text • Updated • 2.19M • 849 -
microsoft/trocr-base-handwritten
Image-to-Text • 0.3B • Updated • 160k • 491 -
microsoft/git-large-coco
Image-to-Text • 0.4B • Updated • 5.79k • 105
Foundation models for computer vision.
This collection contains models and demos of SAM and it's smaller friends.
Models and applications of OWL-ViT and OWLv2.
A collection dedicated to SigLIP applications
-
Draw To Search Art
🐠73Draw/upload image and search among WikiART using SigLIP
-
Compare Clip Siglip
🏃23Compare strong zero-shot image classification models
-
Multilingual Zero Shot Image Clf
🏢13Comparing powerful multilingual zero-shot image clf models
-
BAAI/bunny-phi-2-siglip-lora
Text Generation • Updated • 75 • 48
A collection of open-source document AI 📄 📝 📈
A collection of everything SegGPT.
Papers about vision-language models, most important ones are on top of the list.
-
Improved Baselines with Visual Instruction Tuning
Paper • 2310.03744 • Published • 39 -
DeepSeek-VL: Towards Real-World Vision-Language Understanding
Paper • 2403.05525 • Published • 49 -
Qwen-VL: A Frontier Large Vision-Language Model with Versatile Abilities
Paper • 2308.12966 • Published • 11 -
LLaVA-Gemma: Accelerating Multimodal Foundation Models with a Compact Language Model
Paper • 2404.01331 • Published • 27
-
google/owlvit-base-patch32
Zero-Shot Object Detection • 0.2B • Updated • 170k • 148 -
google/owlvit-base-patch16
Zero-Shot Object Detection • Updated • 11.1k • 13 -
google/owlvit-large-patch14
Zero-Shot Object Detection • Updated • 12.7k • 29 -
google/owlv2-base-patch16
Zero-Shot Object Detection • 0.2B • Updated • 19.9k • 30
-
google/owlvit-base-patch32
Zero-Shot Object Detection • 0.2B • Updated • 170k • 148 -
google/owlvit-base-patch16
Zero-Shot Object Detection • Updated • 11.1k • 13 -
google/owlvit-large-patch14
Zero-Shot Object Detection • Updated • 12.7k • 29 -
google/owlv2-base-patch16
Zero-Shot Object Detection • 0.2B • Updated • 19.9k • 30
-
google/owlvit-base-patch32
Zero-Shot Object Detection • 0.2B • Updated • 170k • 148 -
google/owlvit-base-patch16
Zero-Shot Object Detection • Updated • 11.1k • 13 -
google/owlvit-large-patch14
Zero-Shot Object Detection • Updated • 12.7k • 29 -
google/owlv2-base-patch16
Zero-Shot Object Detection • 0.2B • Updated • 19.9k • 30
A comprehensive collection on DAv2
This collection has all the vision language leaderboards.
-
Vidore Leaderboard
🥇206Browse and compare visual document retrieval model scores
-
Open VLM Leaderboard
🌎1.01kVLMEvalKit Evaluation Results Collection
-
Vision Arena (Testing VLMs side-by-side)
🖼562Explore AI-powered visual tasks in Vision Arena
-
SEED-Bench Leaderboard
🏆85Submit model evaluation results to leaderboard
A collection of video-language models
-
Video Llava
🐨21Generate descriptions by uploading images or videos
-
llava-hf/LLaVA-NeXT-Video-7B-hf
Video-Text-to-Text • 7B • Updated • 109k • 121 -
llava-hf/LLaVA-NeXT-Video-7B-DPO-hf
Video-Text-to-Text • 7B • Updated • 3.1k • 11 -
llava-hf/LLaVA-NeXT-Video-7B-32K-hf
Image-Text-to-Text • 8B • Updated • 202 • 8
All the models and demos for SAM2