Git Product home page Git Product logo

opendts's Introduction

OpenDTS: Real-Time Domestic Terrorism Threat Detector

TLDR: This project uses a multi-layered approach to predict whether or not someone, or some group is indicating the intention to commit mass harm. Only right-wing extremist groups are eligible for data processing. To predict indication of the intent to commit hate-based acts of violence.

OpenDTS (Domestic Threat Scanner) is a project intended to provide analytical insight into hostile sentiment towards a given demographic experiencing discrimination.

Users may create profiles to help them track sentiment towards one group.

opendts's People

Contributors

daethyra avatar dependabot[bot] avatar

Stargazers

 avatar  avatar  avatar

Watchers

 avatar

opendts's Issues

AutoGPT submodule error

Not properly linked to the commit in question

  • re-init submodule locally, force push if necessary

Fine-tune GPT-4

DTS-GPT is a non-privacy respecting classification model for assigning a T/F value to a piece of text, no more than 512 characters.

Steer w/ system prompts.
Ask for binary output
10shot examples
Token limits: I::512/O::16

Orchestration Files Require Review

Docker compose files from submodules and the core modules must be merged into a single compose file, for the top-level directory

  • Review / Merge compose.yml files
    • AutoGPT, AutoThreader, OpenDTS
  • Restrict Docker images WWW exposure

Query LLM module

  • dataset, embeddings are useless unless freely accessible by the AI

Fresh roadmap.md

  • desperately needed
  • account progress made
  • add end goal functionalities
  • intended use
  • intended audience
  • detailed outline of action steps including deadlines via GH milestones

MK-I tweaks + Preprocessing

--> tokenizer.py

Requires heavy updates, including but not limited to, data standardization, cleaning out stop words, and sanitizing the rest

Module from ABR integration

  • Fig. 1
    • Module from ABR integration

Cybersentinel

Missing model

  • release CS as package
  • CS is NOT ODTS
  • CS is a secondary layer of sentiment analysis classification

Pyproject.toml failure

File "C:\************\.venv\Lib\site-packages\Cython\Build\Dependencies.py", line 1125, in cythonize
  result.get(99999)  # seconds
  ^^^^^^^^^^^^^^^^^
File "C:\************\Python\Python311\Lib\multiprocessing\pool.py", line 774, in get
  raise self._value

Cython.Compiler.Errors.CompileError: sklearn\ensemble_hist_gradient_boosting\splitting.pyx

  143│
  144│                 error = ChefBuildError("\n\n".join(message_parts))
  145│
  146│             if error is not None:
→ 147│                 raise error from None
  148│
  149│             return path
  150│
  151│     def _prepare_sdist(self, archive: Path, destination: Path | None = None) -> Path:

Note: This error originates from the build backend, and is likely not a problem with poetry but with scikit-learn (0.24.2) not supporting PEP 517 builds. You can verify this by running 'pip wheel --use-pep517 "scikit-learn (==0.24.2)"'.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.