Git Product home page Git Product logo

fastaionawscloud9's Introduction

Miniconda + FastAI + Jupyter notebook + Cloud9 on AWS

Pre-requsites

AWS cloud9(t2.micro is not available because of memory limit. Use t2.small or above)

Resizing disk is needed. Default disk space is 8GB and this is totally not enough. I think 16GB is enough to run.

Resizing disk guide

Download script in above link and run.

./resize.sh 16

Run disk resizing script in above link. And before running disk resizing, Cloud9 needs to set aws access key and secret key. You need to configure this things.

aws configure

your hands

Script

git clone https://github.com/fastai/fastai
wget https://repo.continuum.io/miniconda/Miniconda3-latest-Linux-x86_64.sh
chmod a+x Miniconda3-latest-Linux-x86_64.sh 
./Miniconda3-latest-Linux-x86_64.sh 

Download dataset and unzip to "fastai/data/bulldozers/". Check below movie to download dataset. https://youtu.be/CzdWqFTmn0Y?t=939

unzip bulldoz.zip 

Activate python3 virtual env. FastAI needs python3. I had a trouble because of python2 comparability.

conda create -n fastaienv python=3.6 anaconda

Add uninstalled packages. Cloud9 has default python version2.7. So that you need to specify python.

conda install -c anaconda bcolz
conda update -n base conda
conda install feather-format -c conda-forge
python3 -m pip install opencv-python
python3 -m pip install graphviz
python3 -m pip install sklearn_pandas
python3 -m pip install isoweek
python3 -m pip install pandas_summary

Run Jupyter notebook

jupyter notebook --ip=0.0.0.0 --port=8080 --no-browser

Run Preview - Preview Running Application on Cloud9 then you can see one browser opened. And you can get accees link like below. Or you can check your instance id in your browser(example : https://ap-southeast-1.console.aws.amazon.com/cloud9/ide/[instance_id])

http://[your instance id].vfs.cloud9.ap-southeast-1.amazonaws.com/

Add above port.(Below link is an example)

http://[your instance id].vfs.cloud9.ap-southeast-1.amazonaws.com:8080/

In terminal, you can get logged access token. Insert the token to login.

http://[your instance id].vfs.cloud9.ap-southeast-1.amazonaws.com:8080/tree?token=[token]

DONE!

References

https://medium.com/@GuruAtWork/fast-ai-lesson-1-7fc38e978d37 https://github.com/fastai/fastai/blob/master/README.md#installation-issues

fastaionawscloud9's People

Contributors

larsien avatar

Stargazers

Youngmin Yoo avatar  avatar kyunglog.kim avatar  avatar

Watchers

 avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.