Git Product home page Git Product logo

ml-serving-seldon-core's Introduction

How-to Guide

Install Seldon System

kubectl create namespace seldon-system

helm upgrade --install seldon-core seldon-core-operator \
    --version 1.15.1 \
    --repo https://storage.googleapis.com/seldon-charts \
    --set usageMetrics.enabled=true \
    --namespace seldon-system \
    --set istio.enabled=true

Create another namespace for all of our seldon deployments

kubectl create ns seldon

Quick start

Deploy your first iris model using the following commands

kubectl apply -f deployments/quickstart.yaml

Port-forward to access the service locally via istio ingress

kubectl port-forward svc/istio-ingressgateway 8000:80 -n istio-system

Open Swagger UI at the following address or this, and paste the following request body to enjoy the result.

{"data": {"ndarray": [[1,2,3,4]]}}

Install Source2Image tool

Source2Image (s2i) is a tool which is used by Redhat to automatically create docker images from source code.

Install s2i following this link

Build a custom image as follows. Please refer to this documentation if you want to understand more about this magic.

s2i build . seldonio/seldon-core-s2i-python3:1.17.1 fullstackdatascience/intrusion_detection:0.1

Feel free to replace fullstackdatascience/intrusion_detection:0.1 by your own image.

Along with testing APIs by Swagger UI, you can use cURL similar to this. Please update your corresponding cookie.

curl 'http://localhost:8000/seldon/seldon/iris-model/api/v1.0/predictions' \
  -H 'Content-Type: application/json' \
  -H 'Cookie: authservice_session=MTY5OTIzMzE3NHxOd3dBTkZGS1ZsVlhTMGcyV2tOTlNEZERXVXRPVEVaSlZ6ZFNRa0ZKUWpaRVdrOVFSekpLUjBvelZFUlVNazlQV2xSRE0wUktVRkU9fECnA2G0l8e4Suv04Og8lnq1AqT113VuI23RFeq4wHmF' \
  --data-raw '{"data":{"ndarray":[[5.0, 0.0, 0.0, 0.0, 0.0, 1.0, 0.0, 0.0, 255.0, 250.0, 0.98, 0.01, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]]}}'

Install KNative for outlier detection

Install Knative Eventing version 0.24.4. From version 0.25, it requires minimum version of Kubernetes is 1.20.

kubectl apply -f https://github.com/knative/eventing/releases/download/v0.24.4/eventing-crds.yaml
kubectl apply -f https://github.com/knative/eventing/releases/download/v0.24.4/eventing-core.yaml

ml-serving-seldon-core's People

Watchers

Truong Nguyen avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.