Multi-modal LLM
Multi-modal LLM
Some 
| Repository | Description | Stars | Forks | Last Updated |
|---|---|---|---|---|
| atfortes / Awesome-Controllable-Diffusion | Collection of papers and resources on Controllable Generation using Diffusion Models, including ControlNet, DreamBooth, and others. | 225 | 11 | 30-Jan-24 |
| mlpc-ucsd / BLIVA (AAAI 2024) | BLIVA: A Simple Multimodal LLM for Better Handling of Text-rich Visual Questions | 208 | 20 | 21-Dec-23 |
| vincentlux / Awesome-Multimodal-LLM | Reading list for Multimodal Large Language Models | 43 | 4 | 17-Aug-23 |
| ChenDelong1999 / polite-flamingo | Visual Instruction Tuning with Polite Flamingo - training multi-modal LLMs to be both clever and polite! (AAAI-24 Oral) | 53 | 3 | 9-Dec-23 |
| codingonion / awesome-llm-and-aigc | A collection of some awesome public projects about Large Language Model, Vision Foundation Model and AI Generated Content. | 388 | 44 | 29-Jan-24 |
| eugeneyan / open-llms | A list of open LLMs available for commercial use. | 9,359 | 561 | 10-Jan-24 |
| PacktPublishing / Pretrain-Vision-and-Large-Language-Models-in-Python | Pretrain Vision and Large Language Models in Python, Published by Packt | 61 | 21 | 22-Dec-23 |
| showlab / Awesome-MLLM-Hallucination | A curated list of resources dedicated to hallucination of multimodal large language models (MLLM). | 15 | 1 | 18-Jan-24 |
| Atomic-man007 / Awesome_Multimodel_LLM | Awesome_Multimodel is a curated GitHub repository that provides a comprehensive collection of resources for Multimodal Large Language Models (MLLM). | 111 | 9 | 5-Jan-24 |
| FreedomIntelligence / MLLM-Bench | Evaluating Multi-modal LLMs using GPT-4V | 27 | 1 | 7-Jan-24 |
| Q-Future / Q-Instruct | Low-level visual instruction tuning, with a 200K dataset and a model zoo for fine-tuned checkpoints. | 120 | 8 | 28-Dec-23 |
| Jacksonlark / open-mllms | open llm for multimodal | 14 | 2 | 18-May-23 |
| Q-Future / Q-Bench | A benchmark for multi-modality LLMs (MLLMs) on low-level vision and visual quality assessment. | 159 | 9 | 22-Jan-24 |
| microsoft / LMOps | General technology for enabling AI capabilities w/ LLMs and MLLMs | 2,912 | 199 | 29-Jan-24 |
| shure-dev / Awesome-LLM-Towards-AGI | LLM Toward AGI / Awesome repos&surveys / Chain of Thought / LLM / Prompt engineering / Reasoning / Robot / Agent / Planning / Reinforcement Learning / Created by @shure-dev / Check our notion | 17 | 5 | 1-Feb-24 |
| yunlong10 / Awesome-LLMs-for-Video-Understanding | 🔥🔥🔥Latest Papers, Codes and Datasets on Vid-LLMs. | 256 | 7 | 8-Jan-24 |