Name: John Hewitt
Type: User
Company: Stanford University
Bio: I'm a PhD student working on: NLP, structure, interpretability, bash scripts, understanding, multilinguality, and teaching others to do the same.
Location: Stanford, CA, USA
Blog: https://nlp.stanford.edu/~johnhew
John Hewitt's Projects
A beautiful Jekyll theme for academics
The website for presenting Backpack models
The original Backpack Language Model implementation, a fork of FlashAttention
repo for CIS 371 Spring 2018
Codebase for running (conditional) probing experiments
Repository describing example random control tasks for designing and interpreting neural probes
Code for analyzing mental health outcomes with VR head tracking data
Codebase implementing RNN constructions that generate Dyck-(k,m)
Codebase implementing LMs for learning the Dyck-(k,m) bounded hierarchical language
DyNet: The Dynamic Neural Network Toolkit
Rough codebase for exploring initialization strategies for new word embeddings in pretrained LMs
A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.
Simple, fast unsupervised word aligner
Apache-Compliant Java port of Chris Dyer's fast_align
Code and model for the paper "Improving Language Understanding by Generative Pre-Training"
Joshua Decoder Useful Scripts
Backpacks fork of EleutherAI's LM evaluation harness.
Code for "Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks"
Tools for working with the Massively Multilingual Image Dataset
Morphologically-motivated phrase tables from AMTA 2016 paper
Interactive poetry generation
Stores paper references, outputs to bib/html, does basic sanity checking on bib entries
The SAIL blog
Sentence scrambling. Also de-scrambling. Not sure how. commit -m "what"