DynamoDB Performance Issue when StreamEnabled is True or Enable Kinesis Streaming Destination about localstack HOT 5 CLOSED

Hello @kunhuang3 and thanks a lot for your report! We've started working towards improving the performance of DynamoDB when streams are enabled.

Just as a note, I don't think we will be able to have the same performance as the baseline setup with no streams, because we have to execute a lot more logic to retrieve the previous version of the item and forward the data. That said, it seems from our preliminary benchmarks that we will be able to bring it much closer (around 2 times slower than without streams) than what it is currently, which from your benchmark would be around a 10x speed up.

I'll keep you updated about when the fix will be available. Thank you again for your report!

from localstack.

Welcome to LocalStack! Thanks for reporting your first issue and our team will be working towards fixing the issue for you or reach out for more background information. We recommend joining our Slack Community for real-time help and drop a message to LocalStack Pro Support if you are a Pro user! If you are willing to contribute towards fixing this issue, please have a look at our contributing guidelines and our contributing guide.

from localstack.

Hello @kunhuang3 ! The fix should be available in the latest docker image. Could you please give it a try? See #10415 for more details,

from localstack.

Hey @thrau Thanks for the update.
Running the benchmark in latest docker image, the performance looks good.

• No stream: 1.8291230201721191
• DDB stream enabled: 6.7653350830078125
• Kinesis Data Stream: 4.290841102600098

from localstack.

Hi @kunhuang3, thanks for the feedback and confirming the fix improved the performance in the benchmark. Did it fix the issue you encountered in your real use-case as well?

Thank you again for providing a very detailed report with the code and results, it helped a lot to reproduce the issue and fix it.

I believe we can consider the issue closed in the meantime, but feel free to comment again if there's still anything.
Thank you again!

from localstack.