nickduran / llm-linguistic-alignment Goto Github PK

• alignment-GPT-only.ipynb
• alignment-BERT-only.ipynb

alignment-GPT-only.ipynb contains code for generating semantic alignment scores using OPENAI's GPT

• Note: you will need to ask Dr. Duran for the API key for running code

alignment-BERT-only.ipynb contains code for generating semantic alignment scores using BERT from HuggingFace

• Note: this needs to be worked on and outputs data similar to that of "GPT-only"

For now, ignore the other .ipynb and .sh files (05-08-24). These are for running the complete NLP analysis (based on the ALIGN tool) in SOL and need to be updated.