Holistic Evaluation of Multimodal LLMs on Spatial Intelligence
-
Updated
Apr 14, 2026 - Python
#
mllm-evaluation
Here are 23 public repositories matching this topic...
[ACL 2025] FinMME: Benchmark Dataset for Financial Multi-Modal Reasoning Evaluation
-
Updated
Jun 19, 2025 - Python
[CVPR'24 Highlight] The official code and data for paper "EgoThink: Evaluating First-Person Perspective Thinking Capability of Vision-Language Models"
-
Updated
Mar 25, 2025 - Python
General AI evaluation and Gauge Engine. A unified evaluation engine for LLMs, MLLMs, audio, and diffusion models.
-
Updated
Apr 17, 2026 - Python
[CVPR'25] 🌟🌟 EgoTextVQA: Towards Egocentric Scene-Text Aware Video Question Answering
-
Updated
Jun 19, 2025 - Python
Why We Feel: Breaking Boundaries in Emotional Reasoning with Multimodal Large Language Models
-
Updated
Sep 30, 2025 - Python
On Path to Multimodal Generalist: General-Level and General-Bench
benchmark llm mllm multimodal-large-language-models multimodal-generalist llm-evaluation mllms mllm-evaluation
-
Updated
Jul 11, 2025 - Python
The official code and data for paper "VidEgoThink: Assessing Egocentric Video Understanding Capabilities for Embodied AI"
-
Updated
Mar 25, 2025 - Python
The code repository for "OmniEvalKit: A Modular, Lightweight Toolbox for Evaluating Large Language Model and its Omni-Extensions"
-
Updated
Feb 21, 2025 - Python
[ICASSP'26] PictOBI-20k: A dataset designed to evaluate large multimodal models on the visual decipherment tasks of pictographic OBCs
-
Updated
Jan 16, 2026 - Python
A Multimodal Benchmark for Evaluating Scientific Reasoning Capabilities of VLMs
-
Updated
Jun 6, 2025 - Python
offcial implementatio of "Investigating Redundancy in Multimodal Large Language Models with Multiple Vision Encoders" (ICLR2026)
-
Updated
Feb 13, 2026 - JavaScript
Office implementation of EgoPrivacy (ICML2025)
-
Updated
Oct 9, 2025
Office codebase for ICML 2025 paper "Core Knowledge Deficits in Multi-Modal Language Models"
-
Updated
Mar 7, 2026 - HTML
A high-performance highly-customizable reverse OCR tool that renders text or huggingface-compatible datasets to images. Dimension, DPI, CSS configurable!
python ocr asynchronous data-preprocessing image-rendering multimodal huggingface-datasets multimodal-large-language-models mllm-evaluation deepseek-ocr
-
Updated
Feb 11, 2026 - Python
Multi-modal and Vision Language Model Spatial Reasoning Benchmark
benchmark-framework vision-language-model multimodal-large-language-models mllm-evaluation mllm-reasoning vlm-benchmark mllm-spatial-reasoning
-
Updated
Feb 19, 2026 - Python
Official repository of paper titled "FPBench: A Comprehensive Benchmark of Multimodal Large Language Models for Fingerprint Analysis".
benchmark fingerprint biometrics llms fingerprint-verification multimodal-large-language-models llms-benchmarking mllms multimodal-llms mllm-evaluation
-
Updated
Apr 8, 2026 - Python
Benchmark for evaluating MLLMs as judges of vision-task outputs across intrinsic and tool-mediated settings
-
Updated
Mar 10, 2026 - Jupyter Notebook
(WACV 2026) The Perceptual Observatory: Characterizing robustness and grounding in multimodal LLMs (MLLMs)
benchmark evaluation robustness visual-grounding vision-language cognition-and-perception mllm mllm-evaluation wacv2026
-
Updated
Feb 23, 2026 - Python
Improve this page
Add a description, image, and links to the mllm-evaluation topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the mllm-evaluation topic, visit your repo's landing page and select "manage topics."