Stream wrapper for JSONata about jsonata HOT 6 CLOSED

FYI, I was just chatting today with @andrew-coleman about this topic. I had created a proof of concept implementation of connecting jsonata to RxJS Observables. That implementation can bind both variables and the input value to Observables. The implementation should be reasonably efficient in terms of re-evaluations. By that I mean that it should only recompute things that actually need updating.

Note this used an alternative evaluation engine that I had created. That engine could also be applied to things like streams, mobx style observables, Promises, etc. As I said, it was just a proof of concept but perhaps someday it will mature to a point where others can use it.

from jsonata.

Closing this issue. Sounds like @xogeny's implementation might address this which will hopefully be the basis for the next major version of JSONata.

from jsonata.

/cc @Istar-Eldritch @maxogden

from jsonata.

Thanks for the headsup @bmpvieira.

I think it will be more complex than that, the reason being that we are presupposing a ndjson of small objects. What happens if we have a single json object that is massive with hundreds of keys and big nested arrays?

I haven't checked yet how JSONata works internally but I think it would be more relevant research for solutions that transform a JSONata expression to a SAX like event stream that works at byte level instead of object level. I am talking about something similar to what JSONStream does but with the much nicer JSONata syntax. This would be more performant than parsing whole objects and would cover a wide range of use cases.

from jsonata.

We are starting to think about how we might apply JSONata to streams. It's a complex area, and we don't expect to be able to solve all the problems. But we might be able to solve some.

Do you have any use cases that you can share with us which might help to guide our thinking? In particular I'm interested in cases where the JSONata syntax would have a clear advantage over JSONStream. Or perhaps some cases where combining JSONStream and JSONata has the potential to be made more straightforward.

from jsonata.

FYI, I was just chatting today with @andrew-coleman about this topic. I had created a proof of concept implementation of connecting jsonata to RxJS Observables. That implementation can bind both variables and the input value to Observables. The implementation should be reasonably efficient in terms of re-evaluations. By that I mean that it should only recompute things that actually need updating.

Note this used an alternative evaluation engine that I had created. That engine could also be applied to things like streams, mobx style observables, Promises, etc. As I said, it was just a proof of concept but perhaps someday it will mature to a point where others can use it.

@xogeny Is this implemented now? If not, can I get your proof of concept implementation somewhere?

from jsonata.