Why doesn't this repo make mysql faster than torndb? about tornado-mysql HOT 8 CLOSED

In general, async is slower. Especially on Python.

• async operation makes a lot of function call. function call is very slow on Python.
• Writing fast C extension is more difficult than blocking.

When comparing memory consumption under massive (and slow) concurrency,
async code consumes less memory than blocking code. Since thread uses stack memory.

See also: http://techspot.zzzeek.org/2015/02/15/asynchronous-python-and-databases/

from tornado-mysql.

WOW !! Great post!
So, in my single thread tornado server, there is no need to use this async-mysql. It'll not increase in performance under massive (and slow) concurrency.

But without any increase performance, when should i use async-mysql ?

from tornado-mysql.

When you want to measure performance difference between threadpool vs async. :)

from tornado-mysql.

If you want to serve more than one user at a time with your tornado server, it makes sense to use an async database driver. Otherwise if you have relatively long-running queries to the db, the request handler will be blocked until it gets the result from the db and no other requests would be processed at the time.

from tornado-mysql.

@bazzilic threadpool can be used for concurrency.
In case of redis, subscribing pubsub channel is good example to use async client.
Redis is optimized for massive concurrent client and subscribing pubsub channel may be blocked for long time.

But in case of MySQL, I don't know good real example to use async client,
since MySQL server is not optimized for massive concurrent connections.

from tornado-mysql.

@methane get it! Then, how about async memcached/redis cache?

from tornado-mysql.

Memcached is stateless (transaction-less) and supports pipelining.
So fastest way is pipelining + multiplexing. You can use only one connection for concurrent requests.
It reduces packets/sec and server-side CPU usage.

In case of redis, most queries except pubsub are same to memcached.
When using pubsub, Tornado-Redis may help you.

from tornado-mysql.

Oo⚬h, thanks a lot!

from tornado-mysql.