Git Product home page Git Product logo

ml-python's Introduction

Example python implementations of basic machine learning algorithms

The repository ml-python contains IPython notebooks outlining example implementations and applications of machine learning algorithms using Python 3, numpy, and maybe pandas.

Motivation

The motivation for creating these notebooks came from taking Andrew Ng's machine learning course on Coursera. The class implements the algorithms in GNU Octave / MATLAB so I decided to try implementing them using Python as a challenge, to reinforce the concepts, and also just for fun.

These notebooks are intended to serve as examples and references for the basic gist of the outlined machine learning algorithms.

Current examples:

  • Linear regression
  • Logistic regression
  • k-means clustering
  • Artificial neural networks (vanilla or using Keras)
  • Support vector machines

Upcoming examples:

These are currently in progress at various stages of completion.

  • Limitations of k-means clustering
  • Cross-validation

ml-python's People

Contributors

jonchar avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar

ml-python's Issues

Objective function in SMO SVM

Hello jonchar,

I was reading your notebook on solving SVM with SMO algorithm. Unfortunately there is a part that I might misunderstand and looks as an error to me. When you define your objective function, you return :
``return np.sum(alphas) - 0.5 * np.sum(target * target * kernel(X_train, X_train) * alphas * alphas)

However, I think the term (target * target) is target^2 (element wise multiplication) instead of a matrix composed of target_i * target_j. To agree with the theory, I would have coded target[:,None] * target[None,:] to get such matrix.

One more time, I might be wrong, and I would really appreciate your feedback on it.

Best,

Kilian

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.