bhathiya-hw Goto Github PK

bertviz

BertViz: Visualize Attention in Transformer Models (BERT, GPT2, BART, etc.)

csr

detrex

detrex is a research platform for Transformer-based Instance Recognition algorithms including DETR (ECCV 2020), Deformable-DETR (ICLR 2021), Conditional-DETR (ICCV 2021), DAB-DETR (ICLR 2022), DN-DETR (CVPR 2022), DINO (ICLR 2023), H-DETR (CVPR 2023), MaskDINO (CVPR 2023), DETA (ArXiv 2022), etc.

embert

Code for EmBERT, a transformer model for embodied, language-guided visual task completion.

git_demo

Demo on setting git

graphvqa

GraphVQA: Language-Guided Graph Neural Networks for Scene Graph Question Answering

greaselm

GreaseLM: Graph REASoning Enhanced Language Models

grec_mdetr

A benchmark dataset for GRES and GREC [CVPR2023 Highlight]

lxmert

PyTorch code for EMNLP 2019 paper "LXMERT: Learning Cross-Modality Encoder Representations from Transformers".

mac-network

Implementation for the paper "Compositional Attention Networks for Machine Reasoning" (Hudson and Manning, ICLR 2018)

moca

Code and models of MOCA (Modular Object-Centric Approach) proposed in "Factorizing Perception and Policy for Interactive Instruction Following" (ICCV 2021). We address the task of long horizon instruction following with a modular architecture that decouples a task into visual perception and action policy prediction.

modulated_detr

multigen

Language Generation with Multi-hop Reasoning on Commonsense Knowledge Graph

resc

Improving One-stage Visual Grounding by Recursive Sub-query Construction, ECCV 2020

scene_graph_benchmark

image scene graph generation benchmark

simmc

With the aim of building next generation virtual assistants that can handle multimodal inputs and perform multimodal actions, we introduce two new datasets (both in the virtual shopping domain), the annotation schema, the core technical tasks, and the baseline models. The code for the baselines and the datasets will be opensourced.

simmc2

simpletod

Official repository for "SimpleTOD: A Simple Language Model for Task-Oriented Dialogue"

soloist

teach

TEACh is a dataset of human-human interactive dialogues to complete tasks in a simulated household environment.

vit-pytorch

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

vl-t5

PyTorch code for "Unifying Vision-and-Language Tasks via Text Generation" (ICML 2021)