prototyping Nebula Ingestion DDL about nebula HOT 6 CLOSED

FYI. This is interesting, we should talk about it later - https://materialize.com/docs/get-started/

In deed interesting project. Especially declarative MV syntax.

Here is foundation programming diagram it runs upon.
https://github.com/TimelyDataflow

a related industry oriented thought would be - robust full featured stream stream join is tricky and complicated at scale.

• starts with common use case like stream to materialized table join which users can run out of box with minimal learning needed.

• leverage built in columnar storage to filter efficient one pass hash join

• use omp to take advantage of parallel perf gain in heterogeneous hardware architecture.

from nebula.

support ddl based table ingestion declaration #63

from nebula.

FYI. This is interesting, we should talk about it later - https://materialize.com/docs/get-started/

from nebula.

A bit related topic. from adoption point of view, having a UI to d'n'd would be significant easier for end user compare to SQL and magnitudes compare to even python

My old team open sourced UI framework flow builder
https://github.com/chenqin/react-digraph

from nebula.

FYI. This is interesting, we should talk about it later - https://materialize.com/docs/get-started/

In deed interesting project. Especially declarative MV syntax.

Here is foundation programming diagram it runs upon.
https://github.com/TimelyDataflow

a related industry oriented thought would be - robust full featured stream stream join is tricky and complicated at scale.

• starts with common use case like stream to materialized table join which users can run out of box with minimal learning needed.
• leverage built in columnar storage to filter efficient one pass hash join
• use omp to take advantage of parallel perf gain in heterogeneous hardware architecture.

something related from splunk
https://twitter.com/esammer/status/1343675579850113024

from nebula.

I put a bit more on ingestion SQL during vacation. There is good amount of prototyping and experiment work needed before propose a complete solution. I plan to take a long shot and write a stand alone prototype.

from nebula.