Git Product home page Git Product logo

causal-methods-evaluation's Introduction

Evaluation of Honesty property in Causal forests

This repository is part of the Bachelor's thesis project of Matej Havelka for CSE3000 in Q4 2022. Other bachelor projects can be found here. This project studies the effect of honesty on causal forests in different situations and tries to conclude whether using honesty in general cases is beneficial or not. To access the bachelors thesis you might require TU Delft login, the paper can be found in the TU Delft repository TODO: provide link.

How to run it

To add run the experiment you can run the main script. It might take quite a while (at least 2 hours on my setup). Afterwards you should be able to find the results in newly generated directories, most importantly in the parameterization directory. Each experiment is a separate function, it automatically saves all figures in an appropriate folder. To save all intermediate results make sure to go to the session class and enable saving tables. This is automatically disabled by default as it makes the running time double. Default number of threads is equal to 6, if your setup supports more feel free to update this in the session class as well.

How to extend it

To add a new model you need to extend the CausalMethod class in the appropriate class. Then add a new function to the experiment builder that adds the causal method. Afterwards you can construct the experiment with whatever data generators there are.

To add a new generator you need to create a new function in experiment builder where you define the necessary functions to generate that data. With that you can add it to any experiment as you would with other generators.

For further examples refer to the main script.

Authors

Matej Havelka - [email protected]

causal-methods-evaluation's People

Contributors

matejhav avatar patrik-bartak avatar

Stargazers

 avatar

Watchers

 avatar  avatar

Forkers

patrik-bartak

causal-methods-evaluation's Issues

Showing of graphs

Show graph

  • currently show_graph does nothing
  • add option to every layer of possible running

Data generation optimization

Optimize Data Generation

  • Data generation generates in rows rather than columns
  • Add numpy implementations for further optimization
  • Generation happens in every replication
  • First data is generated, written into a file and then returned

Experiment works only when data is saved

Save Data being mandatory

  • Experiment generates data and uses the generated file to run the experiment.
  • This leads to the fact that all experiments need to save data
  • Saving data is quite expensive time-wise thus a solution to this would optimize the code

Saving pandas tables

Save pandas table

  • Table that is saved is not readable
  • Text overflows
  • Table is generated on the bottom with a lot of whitespace above
  • Ideally generate a table that takes up the entire space of the png

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.