GOPA, A Spider Written in Go.

• Light weight, low footprint, memory requirement should < 100MB
• Easy to deploy, no runtime or dependency required
• Easy to use, no programming or scripts ability needed, out of box features

• How to use
  • Requirements
  • Setup
    • Download Pre Built Package
    • Compile The Package Manually
  • Required Config
  • Start
  • Stop
• Configuration
• UI
• API
• Architecture
• Contributing
• License

• Elasticsearch v5.3+

First of all, get it, two opinions: download the pre-built package or compile it yourself.

Go to Release or Snapshot page, download the right package for your platform.

Note: Darwin is for Mac

• Mac/Linux: Run make build to build the Gopa.
  
• Windows: Checkout this wiki page - How to build GOPA on windows.

So far, we have:

gopa, the main program, a single binary.
gopa.yml, main configuration for gopa.

Note: Elasticsearch version should >= v5.3

• Enable elastic module in gopa.yml, update the elasticsearch's setting:

- name: elastic
  enabled: true
  kv_enabled: true
  orm_enabled: true
  elasticsearch:
    endpoint: http://localhost:9200
    index_prefix: gopa-
    username: elastic
    password: changeme

Besides Elasticsearch, Gopa doesn't require any other dependencies, just simply run ./gopa to start the program.

Gopa can be run as daemon(Note: Only available on Linux and Mac):

➜  gopa git:(master) ✗ ./bin/gopa --daemon
  ________ ________ __________  _____
 /  _____/ \_____  \\______   \/  _  \
/   \  ___  /   |   \|     ___/  /_\  \
\    \_\  \/    |    \    |  /    |    \
 \______  /\_______  /____|  \____|__  /
        \/         \/                \/
[gopa] 0.10.0_SNAPSHOT
///last commit: 99616a2, Fri Oct 20 14:04:54 2017 +0200, medcl, update version to 0.10.0 ///
[10-21 16:01:09] [INF] [instance.go:23] workspace: data/gopa/nodes/0
[gopa] started.

Also run ./gopa -h to get the full list of command line options.

➜  gopa git:(master) ✗ ./bin/gopa -h
  ________ ________ __________  _____
 /  _____/ \_____  \\______   \/  _  \
/   \  ___  /   |   \|     ___/  /_\  \
\    \_\  \/    |    \    |  /    |    \
 \______  /\_______  /____|  \____|__  /
        \/         \/                \/
[gopa] 0.10.0_SNAPSHOT
///last commit: 99616a2, Fri Oct 20 14:04:54 2017 +0200, medcl, update version to 0.10.0 ///
Usage of ./bin/gopa:
-config string
the location of config file (default "gopa.yml")
-cpuprofile string
write cpu profile to this file
-daemon
run in background as daemon
-debug
run in debug mode, gopa will quit with panic error
-log string
the log level,options:trace,debug,info,warn,error (default "info")
-log_path string
the log path (default "log")
-memprofile string
write memory profile to this file
-pidfile string
pidfile path (only for daemon)
-pprof string
enable and setup pprof/expvar service, eg: localhost:6060 , the endpoint will be: http://localhost:6060/debug/pprof/ and http://localhost:6060/debug/vars

It's safety to press ctrl+c stop the current running Gopa, Gopa will handle the rest,saving the checkpoint, you may restore the job later,the world is still in your hand.

If you are running Gopa as daemon, you may stop it like this:

 kill -QUIT `pgrep gopa`

• Search Console http://127.0.0.1:9000/
• Admin Console http://127.0.0.1:9000/admin/

You are sincerely and warmly welcomed to play with this project, from UI style to core features, or just a piece of document, welcome! let's make it better.

Released under the Apache License, Version 2.0 .