raptor-ml / raptor Goto Github PK

Transform your pythonic research to an artifact that engineers can deploy easily.

License: Apache License 2.0

Dockerfile 0.48% Makefile 3.13% Go 52.98% Shell 0.73% Python 40.07% Starlark 1.12% Jinja 1.50%

ai-infra data-engineering data-science dataops feature-engineering feature-extraction feature-platform featurestore kubeflow kubernetes machine-learning ml mlops model-deployment production raptor raptor-ml reactive-ml

raptor's People

Contributors

Stargazers

Watchers

Forkers

eefrat tamirfri almogbaku fossabot hartl3y94 shaharco epec254 nivasgopi30 orazoulay jamestiotio alonbabushka

raptor's Issues

state warmup

In case of a disaster, the system should be able to recover by fetching the "top hits" from the historical storage and putting them back in the state provider.

At the moment, this is not urgent due to Redis ability to persist data (and the fact that we're not supporting other state driver)

🐛 Lint failed for 261db53642e0decbd78757cc3361300f2d7e4df6

https://github.com/natun-ai/natun/actions/runs/2474821266

🐛 Lint failed for bd2efcbf9b5e74d4c05eb78b76ebbba67ec5cf55

https://github.com/natun-ai/natun/actions/runs/2447237859

Headless / 0 freshness - historical records

Currently, headless features are not being recorded in the historical data.
We need to find a mechanism to store this data for historical purposes.

This is notably important for features that have data connectors and might have transient data internally that is not replayable otherwise.

Point in time join

[historian] doesn't take snapshots of windows

🐛 Lint failed for adc054ddce02e06486f42fcd4b86228f87e91882

https://github.com/natun-ai/natun/actions/runs/2215869771

add key feature for featureset

🐛 License header missing for e76321b86244703055671d1fc9373b8f5f9139d9

https://github.com/natun-ai/natun/actions/runs/2224451663

🐛 Lint failed for 9633b1f1053d6ed3cf7984e1574113cb6051cb3c

https://github.com/natun-ai/natun/actions/runs/2451015550

🐛 Lint failed for ed78c392aa9c937332413e76d724dabf4d309845

https://github.com/natun-ai/natun/actions/runs/2391586764

🐛 Lint failed for 0f13067fe4dc875af99f596e38d2c035df6dbb47

https://github.com/natun-ai/natun/actions/runs/2170493472

🐛 License header missing for c6d21a3bc3ec0b867b0b1aa7c844cd73909b4feb

https://github.com/natun-ai/natun/actions/runs/2179897677

🐛 Lint failed for ef405aac9cd23f7cd4544f37d0d82dd77ea89011

https://github.com/natun-ai/natun/actions/runs/2400817665

🐛 Lint failed for 61595fb9ec4eab94cd419cb65ed90ee75c5dedbe

https://github.com/natun-ai/natun/actions/runs/2456340787

🐛 License header missing for 1d15606089d68b0dd4691063577f459d06248ac8

https://github.com/natun-ai/natun/actions/runs/2224332042

🐛 Lint failed for fbe825938530649c93a33a3022aee760669bd4bf

https://github.com/natun-ai/natun/actions/runs/2215836036

🐛 License header missing for e90abc614de6958d0ae710034fe2678df9bd83c2

https://github.com/natun-ai/natun/actions/runs/2179948600

document snowflake required roles

assist the following query
SHOW GRANTS TO ROLE NATUNSYSTEM;

Retrieving windowed feature without a function on "non-existing" should return an error

Pyexp: transform struct payloads to map

🐛 Lint failed for 354d242f10bcf288849525a8b8d6df8b52defda8

https://github.com/natun-ai/natun/actions/runs/2418356126

🐛 Lint failed for fbe825938530649c93a33a3022aee760669bd4bf

https://github.com/natun-ai/natun/actions/runs/2215836036

🐛 Lint failed for dbed7e4c45ed32c75253868dc9c9787608dbc378

https://github.com/natun-ai/natun/actions/runs/2400325842

Snowflake cleaner

On-time of the provider initialization, if not exists, create a scheduled task that cleans out active rows that have been finished.

See https://docs.snowflake.com/en/sql-reference/sql/merge.html

🐛 Lint failed for 23dba6c95387839b84534ff305b9a394d34141c0

https://github.com/natun-ai/natun/actions/runs/2471471281

🐛 Lint failed for 1b86b08b7714c0d8793924c53b922dee3eb00dfd

https://github.com/natun-ai/natun/actions/runs/2398897793

🐛 License header missing for 088c702d6b2ee99ff6b5de5f1ce9908d950cf6a3

https://github.com/natun-ai/natun/actions/runs/2245780911

🐛 Lint failed for 382d8231bbd854390cc271ef729059902ae08172

https://github.com/natun-ai/streaming-runner/actions/runs/2388863986

🐛 Lint failed for 3fb5ea173bbd25f55ea7d6c8371d30c0eaac9afd

https://github.com/natun-ai/natun/actions/runs/2388864108

🐛 Lint failed for be3678e08fe6876f62369ac99f8638598f3ba587

https://github.com/natun-ai/natun/actions/runs/2456412633

Write request on historical set

🐛 Lint failed for 71ee2392aeaa1c2c2fbdbf5c79b2603438e5466f

https://github.com/natun-ai/natun/actions/runs/2447208007

🐛 Lint failed for 0f13067fe4dc875af99f596e38d2c035df6dbb47

https://github.com/natun-ai/natun/actions/runs/2170493472

Snowflake udf for timetravel

🐛 Lint failed for 77000583c8282a7aa4e7d589ac2f12f14f9c25fe

https://github.com/natun-ai/streaming-runner/actions/runs/2259337447

🐛 Lint failed for 29dcd4d024025d00367f1cd620bd87f5ce3cad0f

https://github.com/natun-ai/natun/actions/runs/2391706810

🐛 Lint failed for 3727cae97119f7b40b5221f6c56b461061835e70

https://github.com/natun-ai/natun/actions/runs/2448611762

🐛 Lint failed for 757024801b0ba5c6d5a1c004313ba1e163d48d5e

https://github.com/natun-ai/natun/actions/runs/2391769495

🐛 License header missing for 9015daac740eb7f6ca577560201e753ec1d0975c

https://github.com/natun-ai/natun/actions/runs/2179957477

🐛 Lint failed for 71e525d0b2eeffb7ca522fa088eacdecc36a8563

https://github.com/natun-ai/natun/actions/runs/2391836900

FeatureSet manifest

🐛 License header missing for 4a93cd8b7c96388b487127d6d379cae711366349

https://github.com/natun-ai/natun/actions/runs/2156399379

🐛 Lint failed for e476197c0ae9c1aad3bf9edf613f4b0ca768ba63

https://github.com/natun-ai/streaming-runner/actions/runs/2448615077

🐛 Lint failed for dadd8e1692ec4e501dfd937aa411d652552abd3f

https://github.com/natun-ai/natun/actions/runs/2391285288

Replay/Prod mapping

Allow users to define the mapping strategy (identical, custom function) between the data connector to the feature.