mgeide / poortego Goto Github PK

Open-source python project to handle the storage and linking of open-source intelligence (ala Maltego)

License: MIT License

Python 100.00%

poortego's Introduction

poortego

Latest iteration of poortego is a completely new code-base (the old ruby/metasploit code is under the poortego-ruby branch in case this ever wants to be revived).

This new iteration stems from the fun that I've had playing with neo4j and using the unix-shell command style for traversing data (nodes/links and their labels/properties within the graph). I'm planning on using this framework for cyber threat indicators- but this framework could easily be used for managing other data points.

Current command interface/dispatcher is built ontop of python cmd2 and uses py2neo for neo4j REST communication.

The bare-bones commands work at present:

help, exit, and namespace (standard)
add and ln (wizards)
cd, ls, pwd (traversals)
session, storage, and user (information)
purge

Roadmap

Soon to come (less than 1mo):

additional argument support for bare-bones commands
rm
cat
find
man
import/export (csv, json, mtgx, STIX, IOC, etc.)

Then (1-2mo):

"transforms" (scripts to interact with data and create new nodes/linkages)
"cron" (or "machines" in maltego lingo) to run/re-run scheduled transforms
document retrieval (ala- curl/wget)
raw document/file storage (link neo4j node to file-system path location) -- maybe use a separate document storage solution (e.g., couchdb)

Later:

Improved user/group/auth support (e.g., ldap)
Better client/server support (ideally so little/no client-side requirements) -- server API - REST/web, e.g., https://x.x.x.x/poortego.php?cmd=ls
web interface / browser plug-in? (always preferred cli)

poortego's People

Contributors

Stargazers

Watchers

poortego's Issues

Contributing + license?

Hello,

I enjoy using Maltego, but I would be interested in seeing more free alternatives flourish. I was wondering:

are you still interested in people contributing code?
if so, are there particular things people can work on without stepping on your toes?
you specify that the project is free-as-in-beer, but what about free-as-in-speech? What license do you intend to release under?

Thanks. :)

Resurrection

Would love to see this project resurrected, something like this is badly needed by the OSINT community.

py2neo compatibility

I understand this might be a dead project... anyhow I think the imports and related for py2neo in neo4j_database.py no longer work because they have been deprecated. See https://neo4j.com/blog/py2neo-2-0-unleashed/ (Nov 2014)

e.g. I think
from py2neo import neo4j, node, rel

should now be
from py2neo import Graph, Node, Relationship

e.g.

Python 2.7.5 (default, Nov  6 2016, 00:28:07)
[GCC 4.8.5 20150623 (Red Hat 4.8.5-11)] on linux2
Type "help", "copyright", "credits" or "license" for more information.
>>> from py2neo import neo4j, node, rel
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
ImportError: cannot import name neo4j
>>> from py2neo import Graph, Node, Relationship
>>>

But then there are more issues like "get_or_create_index" which doesn't seem to exist anymore...

  File "/home/user/poortego-master/poortego/data_management/neo4j/neo4j_database.py", line 24, in set_database_defaults
    self.indexes.append( self.db_conn.get_or_create_index(neo4j.Node, "NameIdx") )
AttributeError: 'Graph' object has no attribute 'get_or_create_index'

Tested with py2neo 3.1.2 and neo4j community 3.1.0

Ruby Project

Is poortego a ruby project? It looks more like python...

rake db:migrate issue

Im currently running Lubuntu 3.2.0-39-generic.

When trying to execute db:migrate command, I have obtain the following error. Any guidance is much appreciated :)

@-vb:~/Downloads/poortego-master/lib/rails$ rake db:migrate
rake aborted!
/home/tmuser/Downloads/poortego-master/lib/rails/config/initializers/session_store.rb:3: syntax error, unexpected ':', expecting $end
...sion_store :cookie_store, key: '_poortego-rails_session'
^

Tasks: TOP => db:migrate => environment
(See full trace by running task with --trace)
@-vb:~/Downloads/poortego-master/lib/rails$ cat /home/tmuser/Downloads/poortego-master/lib/rails/config/initializers/session_store.rb

Be sure to restart your server when you modify this file.

PoortegoRails::Application.config.session_store :cookie_store, key: '_poortego-rails_session'

Use the database for sessions instead of the cookie-based default,

which shouldn't be used to store highly confidential information

(create the session table with "rails generate session_migration")

PoortegoRails::Application.config.session_store :active_record_store

New Fork of Poortego project!!!

Here is the URL:
https://git.james-clarke.ynh.fr/james/poortego

I have not yet done anything. I will need some initial advice from the initial developer. Once i have the software working, i can document everything.

TODO:

Get some info from how the software works from original developer. (email convo with developer)
update the INSTALL instructions
update codebase to new library versions bit by bit