File System Persistence Engine about neventstore HOT 5 CLOSED

I'm interested. I have some very specific requirements in mind, but I'm more than happy to see what you can put together. I think the biggest thing is dealing with indexes--we're responsible for keeping our indexes current and consistent. Ideally, the indexes would be updated on a separate thread. In any case, go ahead. I'd like to see what you can come up with.

from neventstore.

Well I have a rather naive implementation up right now that does no indexing, going to work on that today. I think the indexes should be updated on a single background thread, although maybe full consistency / eventual consistency on indexes is something the user can configure in the wireup? I've never gone this low level before, so forgive me if this is all obvious. I am thinking of doing the indexing like: after a write to the event stream, put the commit info in a thread safe queue. Background thread dequeues, writes the position of the commit, which is just the length of the stream after the events are persisted, then what's being indexed e.g. streamrevision.

from neventstore.

Yes, we definitely want to update indexes on the background thread. The indexes should probably have two representations: in memory (which is fully consistent with writes) and on disk (which is eventually consistent as you have mentioned).

One thing to make sure we do properly is error correction. For example, if a write occurs and succeeds, but then the process dies before the index update occurs. Ideally we'll be able to go to the end of the commit stream at startup and see that something exists. We should then be able to parse the contents to see if one or more commits actually occurred and then we can update the indexes accordingly.

from neventstore.

I'm going to close this as an issue in GitHub, but I still want to make sure you're interested in moving forward with this project.

from neventstore.

I am. I'm coming up to a good break point with my current project, so I should be able to spend sometime on this next week.

from neventstore.