Git Product home page Git Product logo

echotrain's Introduction

EchoTrain

Training engine of EchoApp.

Four classes mainly used for training process:

  • DatasetHandler: This class is implemented in the dataset directory and creates data generators from a given dataset by using the create_data_generators method.
  • PreProcessor: This class is implemented in the model directory and performs required processes before using the data generators in training and finally returns processed data in a new data generator. The following image shows these processes for a dataset:

alt text

  • Model: This class is implemented in the model directory and define the structure of the model that wants to be trained and metrics that wants to be used for evaluating the model during the training process.
  • Trainer: This class is implemented in the training directory and Train the given model based on the inputs and config file moreover store tensorboard and mlflow logs by using train method and determine the best weights for the model, and store the config file by using export method.

alt text

Training

The model could be trained by using the following command:

python train.py --experiment_dir /path/to/experiment

by using the following command the program will determine to load the corresponding dataset, model, and preprocess's by using the config file in the experiment directory and then train the model based on the loaded files.

Installation

Conda

This command could be used to create a conda environment of the project:

conda env create -f environment.yml

Colab

This command could be used to install the requirements of this project on google colab:

!pip install -r requirements_colab.txt

Automation

  • After cloning this project from git, the following commands could be used to create the conda environment based on the environment.yml file: echotrain.py -c or echotrain.py --create_env

  • Any time that you need to build the package for model directory the following commands could be used: echotrain.py -b or echotrain.py --build_model. This will generate a .whl file inside dist sub-directory which will be used to install the model package using pip install file_name.whl on any target python environment.

  • Also, you could install the requirements needed in the colab by using the following commands: echotrain.py -cr or echotrain.py --colab_requirements

  • Finally, the conda environment could be created in the colab by using the following commands: echotrain.py -ce or echotrain.py --colab_conda_env

echotrain's People

Contributors

iamsoroush avatar arashharirpoosh avatar azin536 avatar benyaminghn avatar sarmeili avatar zzmirror avatar kimiaghodoosi avatar

Watchers

 avatar

Forkers

sarmeili

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.