milvlg Goto Github PK

activitynet-qa

An VideoQA dataset based on the videos from ActivityNet

anetqa

anetqa-code

bottom-up-attention.pytorch

A PyTorch reimplementation of bottom-up-attention models

bst

imp

a family of multimodal small language models

mcan-vqa

Deep Modular Co-Attention Networks for Visual Question Answering

mmnas

Deep Multimodal Neural Architecture Search

mt-captioning

A PyTorch implementation of the paper Multimodal Transformer with Multiview Visual Representation for Image Captioning

openvqa

A lightweight, scalable, and general framework for visual question answering research

prophet

Implementation of CVPR 2023 paper "Prompting Large Language Models with Answer Heuristics for Knowledge-based Visual Question Answering".

rosita

ROSITA: Enhancing Vision-and-Language Semantic Alignments via Cross- and Intra-modal Knowledge Integration

xmchat