lorypack Goto Github PK

abc_model_choice

Simple python implementation of Approximate Bayesian Computation for Model Choice

abcpy

ABCpy package

abcpy-models

automated_annotation

awesome-llms-evaluation-papers

The papers are organized according to our survey: Evaluating Large Language Models: A Comprehensive Survey.

bpmf

Python implementation of Bayesian Probabilistic matrix Factorization algorithm.

conformal_bayes

Conformal Bayes with importance sampling

deepspeed_llama

Finetuning LLaMA with DeepSpeed

emergent_analogies_llm

Code for 'Emergent Analogical Reasoning in Large Language Models'

evals

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

gemini

Gemini is a modern LaTex beamerposter theme 🖼

genbayes_likelihoodfree_scoringrules

Code for the paper "Generalized Bayesian Likelihood-Free Inference Using Scoring Rules Estimators"

generativenetworksscoringrulesprobabilisticforecasting

helm

Holistic Evaluation of Language Models (HELM), a framework to increase the transparency of language models (https://arxiv.org/abs/2211.09110).

kl-divergence-estimators

Testing methods for estimating KL-divergence from samples.

llm-liedetector

Code for the paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"

lorypack.github.io

My personal webpage

mine_pytorch

MINE: Mutual Information Neural Estimation in pytorch

open-react-template

A free React / Next.js landing page template designed to showcase open source projects, SaaS products, online services, and more. Made by

prontoqa

Synthetic question-answering dataset to formally analyze the chain-of-thought output of large language models on a reasoning task.

py-irt

Bayesian IRT models in Python

pysteps

Python framework for short-term ensemble prediction systems.

recommend

recommendation system with python

sbi_gen_networks_srs

Code for the paper: "Simulation-Based Inference with Generative Neural Networks via Scoring Rule Minimization"

sbibm

Simulation-based inference benchmark

sm-expfam-lfi

Code for the paper: "Score Matched Conditional Exponential Families for Likelihood-Free Inference", https://jmlr.org/papers/v23/21-0061.html

tinybenchmarks

Evaluating LLMs with fewer examples

tomchallenges