Git Product home page Git Product logo

assemblyline-services's Introduction

Custom services for AssemblyLine 4

A set of custom services extending the capabilities of AssemblyLine 4. They are created as a hobby project, so please do not expect production quality. They should work with the latest version of AssemblyLine 4.

Services

ASAR Extractor

Simple service extracting ASAR Archives using official asar tool from Electron. By default, node modules are omitted from the extracted files, but it can be configured using submission parameters.

ASTGrep

Service using AST-Grep to analyze the source code. Currently used only for obfuscation detection and deobfuscation. At the moment, only builtin rules are supported.

ClamAV

This service uses the ClamAV antivirus engine to scan files for viruses. It leverages the daemon mode to keep db definitions in memory and avoid reloading them for each scan. Support for Freshclam and directly downloading custom databases, both as AL-native update service. Both ClamAV and Freshclam can be fully configured.

Comodo AV (abandoned)

A try to use the last version of Comodo AV engine for Linux. Because of the lack of pre-loading of the database, it's been abandoned. It may still work, though.

File Similarity

Comparing TLSH hashes to find similar files. It supports external lists in CSV as well as files badlisted in the AssemblyLine system. Both are updated periodically, as native AL update services. Not recommended for use with large number of badlisted files, it's just a linear comparison.

Hashlookup

It performs hash lookups to identify well-known good and bad files. It be used to avoid analyzing well-known files. Responses are cached. Currently supported services:

  • CIRCL Hashlookup: identify well-known files and return trust score. DNS queries are used to check for the hash, and then REST API to get more details. It could be an online alternative to loading NIST NSRL database (and more) into Safelist service.
  • Cymru Malware Hash Registr: identify well-known malware files. Only DNS queries are used. This service does not offer extended details (e.g. no malware name).

Network Information

Service to get information about IPs and domains. Currently supported:

  • IP data from MMDB files (you can configure your own, the default one is GeoOpen),
  • WHOIS data for domains, including domains extracted from URIs. Results are cached.

Supported heuristics:

  • newly created domains (based on WHOIS data).

PCAP Extractor

This service list TCP flows from a pcap file using Tshark. If supported by Tshark, it can also extract files. It tries to set as much as possible tags, and respect safelisting to avoid unnecessary operations.

Supported heuristics:

  • external HTTP/non-HTTP connections,
  • data exfiltration threshold (based on total data sent out).

Python Magic

Designed to help with analysis of Python artifacts. Currently supported:

  • unpacking PyInstaller executables (using pyinstxtractor-ng),
  • decompyling Python bytecode (.pyc) (using Decompyle++),
  • extracting declared dependencies and matching them against configurable lists of suspicious and malicious packages,

Semgrep

Service using Semgrep OSS to analyze code for malicious activity. Currently in the alpha stage. By default configured to use rules from GuardDog project.

Simple Downloader

Very simple service to download URLs, without running a whole browser. User-agent can be configured.

License

Although the code is licensed under the MIT license, the services may use third-party data or dependencies. Please respect the applicable licenses.

assemblyline-services's People

Contributors

kam193 avatar

Stargazers

Antoine Cailliau avatar Alexandre Dulaunoy avatar Kevin avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.