Comments (4)
Hey! Thanks for the inputs, and I think you are right! That row should be in the upper if block.
If you are willing to, do you want to change that and submit PR? I will merge it as a quick fix.
On my end, I will update the tutorial results once I have more time as well as other changes needed. I will also just go back and check all my old data gen function to make sure nothing big is missing. Hopefully, this will make alignment easier to find, since it creates noise during the learning process.
Thanks again! Much appreciated!
from pyvene.
And yes, counterfactual label and base label can be the same, which is a no change (null) intervention.
from pyvene.
@dangng2004 hey, I updated the code as well as the tutorial! the evaluation results increased slightly due to this change. Thanks again for catching this!
from pyvene.
Glad I could help!
from pyvene.
Related Issues (20)
- [P1] Adding tests for functions in `modeling_utils.py`
- [P1] Adding tests for interventions and their util functions
- [P2] Mac chip MPS mode support HOT 1
- [P1] Tutorial of Inference-time Intervention HOT 1
- Bug in BoundlessRotatedSpaceIntervention HOT 1
- [P1] Speed up training of multiple DAS interventions with caching
- [P2] Sparse autoencoders HOT 3
- [P1] Optionally remove the dependency of the config file HOT 1
- [P0] Upgrade tutorials to new API HOT 1
- [P1] Dynamic Intervention Scheduler
- [P2] Add a new huggingface collator for working with Pyvene models
- [P0] Make interface compatible with HF trainer
- [Bug]: pyvene.ai is taking too long to respond HOT 2
- [P0] Adding back GPT2 and other model supports
- [Bug]: Is this repo support MPT architecture ? i got error HOT 1
- [P0] `IntervenableModel.save()` doesn't save trained model parameters
- [P1] Tuned lens support
- [Bug]: Whether to support intervene_on_prompt=False HOT 2
- [Feature Request / Suggestion]: Capturing of the residual stream HOT 5
- [P0] Making `RepresentationConfig` a PretrainedConfig object
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pyvene.