jbloomaus / alphabetical_probe Goto Github PK
View Code? Open in Web Editor NEWThis project forked from mwatkins1970/alphabetical_probe
Experimental code which trains 26 linear probes to detect the presence of alphabetic letters in GPT-J token strings, given their embeddings. Exploring the resulting vector arithmetic and its impact on GPT-J spelling abilities