Comments (26)
roadscape
commented on August 18, 2024
Caching 100,000 posts
Ordered by: cumulative time
ncalls tottime percall cumtime percall filename:lineno(function)
2 0.000 0.000 726.833 363.416 core.py:1(<module>)
385/1 0.012 0.000 726.833 726.833 {built-in method builtins.exec}
1 0.000 0.000 726.462 726.462 core.py:327(run)
1 0.009 0.009 726.451 726.451 core.py:309(cache_missing_posts)
1 0.492 0.492 726.121 726.121 cache.py:153(update_posts_batch)
201 0.002 0.000 616.376 3.067 http_client.py:158(exec)
100 0.012 0.000 616.359 6.164 steem_client.py:31(get_content_batch)
100 0.013 0.000 616.347 6.163 steem_client.py:96(__exec_batch)
100100 0.043 0.000 616.334 0.006 http_client.py:254(exec_batch)
201 0.002 0.000 613.601 3.053 poolmanager.py:301(urlopen)
201 0.005 0.000 613.587 3.053 connectionpool.py:447(urlopen)
31134 0.050 0.000 611.966 0.020 socket.py:572(readinto)
31134 0.038 0.000 611.868 0.020 ssl.py:991(recv_into)
31134 0.033 0.000 611.822 0.020 ssl.py:857(read)
31134 0.020 0.000 611.786 0.020 ssl.py:618(read)
31134 611.766 0.020 611.766 0.020 {method 'read' of '_ssl._SSLSocket' objects}
34017 0.071 0.000 611.629 0.018 {method 'readline' of '_io.BufferedReader' objects}
201 0.004 0.000 526.329 2.619 connectionpool.py:322(_make_request)
201 0.001 0.000 526.036 2.617 client.py:1287(getresponse)
201 0.003 0.000 526.031 2.617 client.py:290(begin)
201 0.004 0.000 525.971 2.617 client.py:257(_read_status)
100 0.785 0.008 98.488 0.985 cache.py:25(batch_queries)
138476 1.097 0.000 97.786 0.001 methods.py:48(query)
201 0.002 0.000 87.227 0.434 response.py:441(from_httplib)
201 0.002 0.000 87.209 0.434 response.py:113(__init__)
201 0.003 0.000 87.205 0.434 response.py:346(read)
201 0.003 0.000 86.483 0.430 client.py:438(read)
201 0.038 0.000 86.480 0.430 client.py:558(_readall_chunked)
31001 0.041 0.000 85.876 0.003 client.py:534(_get_chunk_left)
31001 0.073 0.000 85.757 0.003 client.py:504(_read_next_chunk_size)
138479 0.159 0.000 70.732 0.001 base.py:879(execute)
138476 0.117 0.000 70.530 0.001 elements.py:261(_execute_on_connection)
138476 0.634 0.000 70.412 0.001 base.py:1009(_execute_clauseelement)
138479 0.930 0.000 46.386 0.000 base.py:1104(_execute_context)
692553 13.304 0.000 42.931 0.000 {method 'sub' of '_sre.SRE_Pattern' objects}
138481 0.071 0.000 35.510 0.000 default.py:469(do_execute)
138483 35.082 0.000 35.464 0.000 {method 'execute' of 'psycopg2.extensions.cursor' objects}
138478 0.297 0.000 23.037 0.000 elements.py:373(compile)
138478 0.221 0.000 22.740 0.000 elements.py:438(_compiler)
138478 0.733 0.000 22.519 0.000 compiler.py:376(__init__)
138478 0.324 0.000 21.481 0.000 compiler.py:177(__init__)
3991334/138478 1.914 0.000 21.158 0.000 compiler.py:241(process)
3991344/138478 2.124 0.000 20.974 0.000 visitors.py:75(_compiler_dispatch)
138476 0.293 0.000 20.736 0.000 compiler.py:737(visit_textclause)
138476 0.108 0.000 19.007 0.000 <string>:1(text)
138476 0.217 0.000 18.899 0.000 elements.py:1240(_create_text)
138476 0.177 0.000 18.682 0.000 elements.py:1225(__init__)
3852856 3.190 0.000 15.628 0.000 compiler.py:738(do_bindparam)
3852856 5.025 0.000 13.999 0.000 elements.py:1232(repl)
100000 2.609 0.000 10.348 0.000 cache.py:38(generate_cached_post_sql)
3852856 4.281 0.000 8.186 0.000 compiler.py:1173(visit_bindparam)
138476 1.955 0.000 7.903 0.000 default.py:554(_init_compiled)
3852856 4.814 0.000 7.304 0.000 elements.py:861(__init__)
138476 0.625 0.000 5.312 0.000 methods.py:19(log)
277011 0.193 0.000 4.653 0.000 re.py:184(sub)
726.833s elapsed = 137.58 posts/s
201 0.002 0.000 616.376 3.067 http_client.py:158(exec)
100 0.785 0.008 98.488 0.985 cache.py:25(batch_queries)
84.8% fetching
13.6% writing
1.6% other
from hivemind.
roadscape
commented on August 18, 2024
Approx. 20 hours-worth of block following. follows are by far the most expensive.
total SQL time: 1668s
75.0% 1250672.00ms 54.89avg 22783x -- UPDATE hive_accounts SET followers = (SELECT COUNT(*) FROM hive_follows WHERE state = 1 AND following = hive_accounts.name), following = (SELECT COUNT(*) FROM hive_follows WHERE st
10.5% 175061.00ms 8753.05avg 20x -- UPDATE hive_accounts SET rank = r.rnk FROM (SELECT id, ROW_NUMBER() OVER (ORDER BY vote_weight DESC) as rnk FROM hive_accounts) r WHERE hive_accounts.id = r.id AND rank != r.rnk;
5.6% 92639.00ms 4.04avg 22916x -- SELECT post_id, author, permlink FROM hive_posts_cache WHERE post_id IN (SELECT post_id FROM hive_posts_cache WHERE is_paidout = 0 AND payout_at <= :date)
3.5% 58481.00ms 0.16avg 360078x -- INSERT INTO hive_posts_cache (post_id, author, permlink, title, preview, body, img_url, payout, promoted, payout_at, updated_at, created_at, rshares, votes, json, is_nsfw, is_paido
2.7% 45378.00ms 0.50avg 90735x -- COMMIT
0.9% 14222.00ms 0.19avg 75467x -- SELECT id, is_deleted FROM hive_posts WHERE author = :a AND permlink = :p
0.5% 7773.00ms 0.01avg 1526106x -- UPDATE hive_accounts SET proxy = :proxy, post_count = :post_count, reputation = :reputation, proxy_weight = :proxy_weight, vote_weight = :vote_weight, kb_used = :kb_used, active_at
0.3% 5183.00ms 0.03avg 190610x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...) ON CONFLICT (follower, following) DO UPDATE SET state = :state
0.3% 4556.00ms 227.80avg 20x -- SELECT name FROM hive_accounts WHERE cached_at < (NOW() AT TIME ZONE 'utc') - INTERVAL '12 HOUR'
0.2% 3177.00ms 0.01avg 239761x -- INSERT INTO hive_post_tags (post_id, tag) VALUES (...) ON CONFLICT DO NOTHING
0.2% 2794.00ms 0.04avg 66848x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...)
0.2% 2601.00ms 0.03avg 90735x -- START TRANSACTION
0.1% 1710.00ms 0.01avg 297641x -- SELECT id,is_deleted FROM hive_posts WHERE author = :a AND permlink = :p
0.1% 1441.00ms 0.03avg 49168x -- SELECT id, depth, category, community FROM hive_posts WHERE author = :a AND permlink = :p
0.1% 934.00ms 0.00avg 239761x -- DELETE FROM hive_post_tags WHERE post_id = :id
0.0% 647.00ms 0.04avg 17695x -- INSERT INTO hive_feed_cache (account, post_id, created_at) VALUES (...)
0.0% 337.00ms 337.00avg 1x -- SELECT name, id FROM hive_accounts
0.0% 204.00ms 0.03avg 6627x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
0.0% 177.00ms 0.01avg 23036x -- INSERT INTO hive_blocks (num, hash, prev, txs, created_at) VALUES (...)
0.0% 83.00ms 0.01avg 6627x -- INSERT INTO hive_feed_cache (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
0.0% 49.00ms 0.01avg 7014x -- SELECT id, depth FROM hive_posts WHERE author = :a AND permlink = :p
0.0% 45.00ms 0.00avg 66848x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
0.0% 27.00ms 0.00avg 41107x -- SELECT * FROM hive_communities WHERE name = :n LIMIT 1
0.0% 18.00ms 0.05avg 387x -- UPDATE hive_posts SET is_deleted = 1 WHERE id = :id
0.0% 1.00ms 1.00avg 1x -- SELECT * FROM pg_catalog.pg_tables WHERE schemaname != 'pg_catalog' AND schemaname != 'information_schema'
0.0% 1.00ms 0.00avg 1346x -- INSERT INTO hive_accounts (name, created_at) VALUES (...)
0.0% 1.00ms 0.00avg 387x -- DELETE FROM hive_posts_cache WHERE post_id = :id
0.0% 0.00ms 0.00avg 1x -- SELECT 1 FROM hive_posts_cache LIMIT 1
0.0% 0.00ms 0.00avg 1x -- SELECT (SELECT COALESCE(MAX(id), 0) FROM hive_posts) - (SELECT COALESCE(MAX(post_id), 0) FROM hive_posts_cache)
0.0% 0.00ms 0.00avg 3x -- SELECT MAX(num) FROM hive_blocks
0.0% 0.00ms 0.00avg 1274x -- SELECT name, id FROM hive_accounts WHERE name IN :names
0.0% 0.00ms 0.00avg 387x -- DELETE FROM hive_feed_cache WHERE post_id = :id
0.0% 0.00ms 0.00avg 15x -- UPDATE hive_posts SET is_valid = :is_valid, is_deleted = 0, parent_id = :parent_id, category = :category, community = :community, depth = :depth WHERE id = :id
0.0% 0.00ms 0.00avg 15x -- DELETE FROM hive_feed_cache WHERE account = :account AND post_id = :id
from hivemind.
roadscape
commented on August 18, 2024
hive_follows: 27.2M rows, 12% dead, 87% active, 0.3% muted
tier of 'following' cnt, # accounts, % util
from hivemind.
roadscape
commented on August 18, 2024
sql from 1.5 hrs of block listening, using follow-ints and fresh vacuum/analyze
46.0% 153579.00ms 84.43avg 1819x -- SELECT post_id, author, permlink FROM hive_posts_cache WHERE post_id IN (SELECT post_id FROM hive_posts_cache WHERE is_paidout = '0' AND payout_at <= :date)
16.2% 54280.00ms 30.26avg 1794x -- UPDATE hive_accounts SET followers = (SELECT COUNT(*) FROM hive_follows2 WHERE state = 1 AND following = hive_accounts.id), following = (SELECT COUNT(*) FROM hive_follows2 WHERE st
15.5% 51704.00ms 1.23avg 42019x -- INSERT INTO hive_posts_cache (post_id, author, permlink, title, preview, body, img_url, payout, promoted, payout_at, updated_at, created_at, rshares, votes, json, is_nsfw, is_paido
5.5% 18262.00ms 9131.00avg 2x -- UPDATE hive_accounts SET rank = r.rnk FROM (SELECT id, ROW_NUMBER() OVER (ORDER BY vote_weight DESC) as rnk FROM hive_accounts) r WHERE hive_accounts.id = r.id AND rank != r.rnk;
3.2% 10847.00ms 0.15avg 74682x -- UPDATE hive_accounts SET proxy = :proxy, post_count = :post_count, reputation = :reputation, proxy_weight = :proxy_weight, vote_weight = :vote_weight, kb_used = :kb_used, active_at
2.7% 8885.00ms 1.25avg 7102x -- SELECT id, is_deleted FROM hive_posts WHERE author = :a AND permlink = :p
2.2% 7256.00ms 0.27avg 27280x -- INSERT INTO hive_follows2 (follower, following, created_at, state) VALUES (...) ON CONFLICT (follower, following) DO UPDATE SET state = :state
2.2% 7244.00ms 1.01avg 7200x -- COMMIT
1.6% 5259.00ms 0.18avg 29333x -- INSERT INTO hive_post_tags (post_id, tag) VALUES (...) ON CONFLICT DO NOTHING
1.5% 4926.00ms 0.14avg 35207x -- SELECT id,is_deleted FROM hive_posts WHERE author = :a AND permlink = :p
0.9% 3008.00ms 0.10avg 29333x -- DELETE FROM hive_post_tags WHERE post_id = :id
0.8% 2806.00ms 0.44avg 6344x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...)
0.8% 2634.00ms 0.57avg 4657x -- SELECT id, depth, category, community FROM hive_posts WHERE author = :a AND permlink = :p
0.2% 824.00ms 0.49avg 1688x -- INSERT INTO hive_feed_cache (account, post_id, created_at) VALUES (...)
0.2% 660.00ms 330.00avg 2x -- SELECT name FROM hive_accounts WHERE cached_at < (NOW() AT TIME ZONE 'utc') - INTERVAL '12 HOUR'
0.2% 542.00ms 542.00avg 1x -- SELECT name, id FROM hive_accounts
0.1% 384.00ms 0.64avg 602x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
0.1% 234.00ms 0.60avg 390x -- INSERT INTO hive_accounts (name, created_at) VALUES (...)
0.1% 233.00ms 0.39avg 602x -- INSERT INTO hive_feed_cache (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
0.1% 192.00ms 0.03avg 7201x -- START TRANSACTION
0.0% 133.00ms 0.21avg 638x -- SELECT id, depth FROM hive_posts WHERE author = :a AND permlink = :p
0.0% 82.00ms 0.05avg 1819x -- INSERT INTO hive_blocks (num, hash, prev, txs, created_at) VALUES (...)
0.0% 66.00ms 0.01avg 6344x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
0.0% 29.00ms 0.01avg 3873x -- SELECT * FROM hive_communities WHERE name = :n LIMIT 1
from hivemind.
roadscape
commented on August 18, 2024
sql from ~56 hrs of block listening (stock mysql)
43.1% 775968.00ms 12.01avg 64615x -- UPDATE hive_accounts SET followers = (SELECT COUNT(*) FROM hive_follows WHERE state = 1 AND following = hive_accounts.name), following = (SELECT COUNT(*) FROM hive_follows WHERE st
23.5% 422697.00ms 0.35avg 1200679x -- INSERT INTO hive_posts_cache (post_id, author, permlink, title, preview, body, img_url, payout, promoted, payout_at, updated_at, created_at, rshares, votes, json, is_nsfw, is_paido
17.7% 319023.00ms 5696.84avg 56x -- UPDATE hive_accounts JOIN ( SELECT id, @rownum:=@rownum+1 rank FROM hive_accounts, (SELECT @rownum:=0) r ORDER BY vote_weight DESC ) ranks USING(id) SET hive_accounts.rank = ranks.
5.9% 105404.00ms 0.41avg 255359x -- COMMIT
4.2% 75788.00ms 0.30avg 255358x -- START TRANSACTION
1.9% 35093.00ms 0.15avg 228340x -- SELECT id, is_deleted FROM hive_posts WHERE author = :a AND permlink = :p
1.3% 22755.00ms 0.01avg 3553383x -- UPDATE hive_accounts SET proxy = :proxy, post_count = :post_count, reputation = :reputation, proxy_weight = :proxy_weight, vote_weight = :vote_weight, kb_used = :kb_used, active_at
0.5% 9295.00ms 165.98avg 56x -- SELECT name FROM hive_accounts WHERE cached_at < NOW() - INTERVAL 12 HOUR
0.4% 7916.00ms 0.01avg 1045400x -- SELECT id,is_deleted FROM hive_posts WHERE author = :a AND permlink = :p
0.4% 6738.00ms 0.02avg 439425x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...) ON DUPLICATE KEY UPDATE state = :state
0.3% 4512.00ms 0.01avg 857601x -- INSERT IGNORE INTO hive_post_tags (post_id, tag) VALUES (...)
0.2% 4019.00ms 0.02avg 201163x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...)
0.2% 2714.00ms 0.04avg 67374x -- SELECT post_id, author, permlink FROM hive_posts_cache WHERE post_id IN (SELECT post_id FROM hive_posts_cache WHERE is_paidout = 0 AND payout_at <= :date)
0.1% 2539.00ms 0.02avg 147982x -- SELECT id, depth, category, community FROM hive_posts WHERE author = :a AND permlink = :p
0.1% 1986.00ms 0.00avg 857601x -- DELETE FROM hive_post_tags WHERE post_id = :id
0.1% 1294.00ms 0.02avg 67373x -- INSERT INTO hive_blocks (num, hash, prev, txs, created_at) VALUES (...)
0.0% 770.00ms 0.04avg 20371x -- INSERT IGNORE INTO hive_reblogs (account, post_id, created_at) VALUES (...)
0.0% 503.00ms 0.00avg 201163x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
0.0% 370.00ms 0.00avg 121234x -- SELECT * FROM hive_communities WHERE name = :n LIMIT 1
0.0% 348.00ms 0.01avg 53232x -- INSERT INTO hive_feed_cache (account, post_id, created_at) VALUES (...)
0.0% 126.00ms 0.01avg 21397x -- SELECT id, depth FROM hive_posts WHERE author = :a AND permlink = :p
0.0% 116.00ms 0.01avg 20371x -- INSERT IGNORE INTO hive_feed_cache (account, post_id, created_at) VALUES (...)
0.0% 26.00ms 0.01avg 4276x -- INSERT INTO hive_accounts (name, created_at) VALUES (...)
0.0% 22.00ms 0.02avg 1026x -- DELETE FROM hive_posts_cache WHERE post_id = :id
0.0% 3.00ms 0.06avg 51x -- UPDATE hive_posts SET is_valid = :is_valid, is_deleted = 0, parent_id = :parent_id, category = :category, community = :community, depth = :depth WHERE id = :id
0.0% 2.00ms 0.00avg 1026x -- UPDATE hive_posts SET is_deleted = 1 WHERE id = :id
0.0% 2.00ms 0.00avg 1026x -- DELETE FROM hive_feed_cache WHERE post_id = :id
0.0% 0.00ms 0.00avg 3967x -- SELECT name, id FROM hive_accounts WHERE name IN :names
0.0% 0.00ms 0.00avg 51x -- DELETE FROM hive_feed_cache WHERE account = :account AND post_id = :id
from hivemind.
roadscape
commented on August 18, 2024
table_name | row_estimate | total_bytes | index_bytes | toast_bytes | total | index | toast | table | perrow_total | perrow_index | perrow_table
---------------------+--------------+-------------+-------------+-------------+------------+------------+------------+---------+--------------+--------------+--------------
hive_posts_cache | 2.00488e+07 | 65656479744 | 11992702976 | 8543494144 | 61 GB | 11 GB | 8148 MB | 42 GB | 3275 bytes | 598 bytes | 2677 bytes
hive_posts | 2.01516e+07 | 7860576256 | 4528160768 | 8192 | 7496 MB | 4318 MB | 8192 bytes | 3178 MB | 390 bytes | 225 bytes | 165 bytes
hive_follows_old | 2.76701e+07 | 5122301952 | 3381886976 | | 4885 MB | 3225 MB | | 1660 MB | 185 bytes | 122 bytes | 63 bytes
hive_blocks | 1.79128e+07 | 3896877056 | 1626570752 | | 3716 MB | 1551 MB | | 2165 MB | 218 bytes | 91 bytes | 127 bytes
hive_follows | 2.76701e+07 | 3811360768 | 2367152128 | | 3635 MB | 2257 MB | | 1377 MB | 138 bytes | 86 bytes | 52 bytes
hive_post_tags | 1.31421e+07 | 1383276544 | 767197184 | | 1319 MB | 732 MB | | 588 MB | 105 bytes | 58 bytes | 47 bytes
hive_feed_cache_old | 5.95597e+06 | 786046976 | 462340096 | | 750 MB | 441 MB | | 309 MB | 132 bytes | 78 bytes | 54 bytes
hive_feed_cache | 5.95979e+06 | 715169792 | 451166208 | | 682 MB | 430 MB | | 252 MB | 120 bytes | 76 bytes | 44 bytes
hive_accounts | 497003 | 479010816 | 142032896 | 73728 | 457 MB | 135 MB | 72 kB | 321 MB | 964 bytes | 286 bytes | 678 bytes
hive_reblogs | 2.04772e+06 | 269893632 | 158531584 | | 257 MB | 151 MB | | 106 MB | 132 bytes | 77 bytes | 54 bytes
hive_modlog | 0 | 24576 | 16384 | 8192 | 24 kB | 16 kB | 8192 bytes | 0 bytes | 0 | 0 | 0
hive_communities | 0 | 16384 | 8192 | 8192 | 16 kB | 8192 bytes | 8192 bytes | 0 bytes | 0 | 0 | 0
hive_members | 0 | 8192 | 8192 | | 8192 bytes | 8192 bytes | | 0 bytes | 0 | 0 | 0
hive_flags | 0 | 8192 | 8192 | | 8192 bytes | 8192 bytes | | 0 bytes | 0 | 0 | 0
from hivemind.
roadscape
commented on August 18, 2024
table_name | row_estimate | total_bytes | index_bytes | toast_bytes | total | index | toast | table | perrow_total | perrow_index | perrow_table
---------------------+--------------+-------------+-------------+-------------+------------+------------+------------+---------+--------------+--------------+--------------
hive_posts_cache | 2.01751e+07 | 26150248448 | 1375780864 | 8847843328 | 24 GB | 1312 MB | 8438 MB | 15 GB | 1296 bytes | 68 bytes | 1228 bytes
hive_posts | 2.01516e+07 | 7971176448 | 4609449984 | 8192 | 7602 MB | 4396 MB | 8192 bytes | 3206 MB | 396 bytes | 229 bytes | 167 bytes
hive_blocks | 1.79128e+07 | 3907584000 | 1631010816 | | 3727 MB | 1555 MB | | 2171 MB | 218 bytes | 91 bytes | 127 bytes
hive_follows | 2.78358e+07 | 3176120320 | 1721278464 | | 3029 MB | 1642 MB | | 1387 MB | 114 bytes | 62 bytes | 52 bytes
hive_post_tags | 1.37659e+07 | 1442398208 | 802177024 | | 1376 MB | 765 MB | | 611 MB | 105 bytes | 58 bytes | 47 bytes
hive_feed_cache_old | 5.95597e+06 | 786046976 | 462340096 | | 750 MB | 441 MB | | 309 MB | 132 bytes | 78 bytes | 54 bytes
hive_feed_cache | 5.95979e+06 | 717185024 | 452370432 | | 684 MB | 431 MB | | 253 MB | 120 bytes | 76 bytes | 44 bytes
hive_reblogs | 2.04772e+06 | 273481728 | 161128448 | | 261 MB | 154 MB | | 107 MB | 134 bytes | 79 bytes | 55 bytes
hive_accounts | 493181 | 114319360 | 36954112 | 24576 | 109 MB | 35 MB | 24 kB | 74 MB | 232 bytes | 75 bytes | 157 bytes
hive_modlog | 0 | 24576 | 16384 | 8192 | 24 kB | 16 kB | 8192 bytes | 0 bytes | 0 | 0 | 0
hive_communities | 0 | 16384 | 8192 | 8192 | 16 kB | 8192 bytes | 8192 bytes | 0 bytes | 0 | 0 | 0
hive_members | 0 | 8192 | 8192 | | 8192 bytes | 8192 bytes | | 0 bytes | 0 | 0 | 0
hive_flags | 0 | 8192 | 8192 | | 8192 bytes | 8192 bytes | | 0 bytes | 0 | 0 | 0
from hivemind.
roadscape
commented on August 18, 2024
[DEBUG] total STEEM time: 886s
43.3% 384045.00ms 15.13avg 25378x -- get_content()
32.9% 291530.00ms 64.77avg 4501x -- get_dynamic_global_properties()
13.0% 115444.00ms 2.50avg 46089x -- get_accounts()
10.8% 95422.00ms 109.93avg 868x -- get_block()
[DEBUG] total SQL time: 188s
53.1% 99829.00ms 143.02avg 698x -- SELECT post_id, author, permlink FROM hive_posts_cache WHERE is_paidout = '0' AND payout_at <= :date
20.4% 38418.00ms 55.12avg 697x -- UPDATE hive_accounts SET followers = (SELECT COUNT(*) FROM hive_follows WHERE state = 1 AND following = hive_accounts.id), following = (SELECT COUNT(*) FROM hive_follows WHERE stat
13.7% 25768.00ms 1.26avg 20473x -- INSERT INTO hive_posts_cache (post_id, author, permlink, category, depth, children, title, preview, body, img_url, payout, promoted, payout_at, updated_at, created_at, rshares, vot
6.3% 11887.00ms 11887.00avg 1x -- UPDATE hive_accounts SET rank = r.rnk FROM (SELECT id, ROW_NUMBER() OVER (ORDER BY vote_weight DESC) as rnk FROM hive_accounts) r WHERE hive_accounts.id = r.id AND rank != r.rnk;
2.0% 3789.00ms 0.20avg 19117x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...) ON CONFLICT (follower, following) DO UPDATE SET state = :state
1.0% 1855.00ms 0.38avg 4821x -- SELECT id, is_deleted FROM hive_posts WHERE author = :a AND permlink = :p
1.0% 1796.00ms 0.65avg 2781x -- COMMIT
0.6% 1084.00ms 0.08avg 13601x -- INSERT INTO hive_post_tags (post_id, tag) VALUES (...) ON CONFLICT DO NOTHING
0.5% 962.00ms 0.07avg 13601x -- DELETE FROM hive_post_tags WHERE post_id = :id
0.4% 825.00ms 0.05avg 17603x -- SELECT id,is_deleted FROM hive_posts WHERE author = :a AND permlink = :p
0.3% 620.00ms 620.00avg 1x -- SELECT name FROM hive_accounts WHERE cached_at < (NOW() AT TIME ZONE 'utc') - INTERVAL '12 HOUR'
0.3% 510.00ms 0.16avg 3134x -- SELECT id, depth, category, community FROM hive_posts WHERE author = :a AND permlink = :p
0.1% 233.00ms 0.06avg 4149x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...)
0.1% 211.00ms 0.08avg 2781x -- START TRANSACTION
0.1% 121.00ms 0.30avg 398x -- INSERT INTO hive_feed_cache (account_id, post_id, created_at) VALUES (...) ON CONFLICT (account_id, post_id) DO NOTHING
0.1% 104.00ms 0.00avg 37594x -- UPDATE hive_accounts SET proxy = :proxy, post_count = :post_count, reputation = :reputation, proxy_weight = :proxy_weight, vote_weight = :vote_weight, kb_used = :kb_used, active_at
0.1% 96.00ms 0.24avg 398x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
0.0% 46.00ms 0.11avg 418x -- SELECT id, depth FROM hive_posts WHERE author = :a AND permlink = :p
0.0% 9.00ms 0.01avg 698x -- INSERT INTO hive_blocks (num, hash, prev, txs, created_at) VALUES (...)
0.0% 9.00ms 0.00avg 4149x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
0.0% 3.00ms 0.00avg 2578x -- SELECT * FROM hive_communities WHERE name = :n LIMIT 1
0.0% 1.00ms 0.05avg 20x -- DELETE FROM hive_posts_cache WHERE post_id = :id
0.0% 0.00ms 0.00avg 30x -- INSERT INTO hive_accounts (name, created_at) VALUES (...)
0.0% 0.00ms 0.00avg 30x -- SELECT name, id FROM hive_accounts WHERE name IN :names
0.0% 0.00ms 0.00avg 20x -- UPDATE hive_posts SET is_deleted = '1' WHERE id = :id
0.0% 0.00ms 0.00avg 20x -- DELETE FROM hive_feed_cache WHERE post_id = :id
0.0% 0.00ms 0.00avg 1x -- UPDATE hive_posts SET is_valid = :is_valid, is_deleted = '0', parent_id = :parent_id, category = :category, community = :community, depth = :depth WHERE id = :id
from hivemind.
roadscape
commented on August 18, 2024
master @ 24d6687, 13 mins of block listening
overall: 86% fetching, 14% writing
790.305 395.152 core.py:1(<module>)
434.048 0.503 {built-in method time.sleep} 55%
298.868 0.120 http_client.py:164(exec) 38%
47.954 0.001 methods.py:48(query) 6%
overall about 50% of execution time is spent on reading/writing posts.
of this, 83% is spent fetching, 11% writing, 6% processing
176.877 0.332 cached_post.py:74(update_batch)
147.690 0.280 steem_client.py:63(get_content_batch) 83%
19.378 0.037 cached_post.py:126(_batch_queries) 11%
9.732 0.001 cached_post.py:136(_sql) 6%
operation stats:
[DEBUG] total STEEM time: 297s
49.5% 147415.00ms 14.01avg 10522x -- get_content()
30.1% 89743.00ms 63.74avg 1408x -- get_dynamic_global_properties()
10.7% 31853.00ms 3.05avg 10448x -- get_accounts()
8.8% 26262.00ms 99.10avg 265x -- get_block()
0.5% 1516.00ms 108.29avg 14x -- get_order_book()
0.3% 917.00ms 65.50avg 14x -- get_current_median_history_price()
[DEBUG] total SQL time: 20s
61.6% 12513.00ms 1.47avg 8528x -- UPDATE hive_posts_cache SET author = :author, permlink = :permlink, category = :category, depth = :depth, children = :children, title = :title, preview = :preview, body = :body, im
16.5% 3360.00ms 3360.00avg 1x -- SELECT name, id FROM hive_accounts
8.9% 1813.00ms 6.82avg 266x -- SELECT post_id, author, permlink FROM hive_posts_cache WHERE is_paidout = '0' AND payout_at <= :date
4.1% 838.00ms 0.42avg 1994x -- INSERT INTO hive_posts_cache (post_id, author, permlink, category, depth, children, title, preview, body, img_url, payout, promoted, payout_at, updated_at, created_at, rshares, vot
3.4% 683.00ms 0.10avg 6650x -- SELECT tag FROM hive_post_tags WHERE post_id = :id
1.9% 392.00ms 0.03avg 11438x -- SELECT id, is_deleted FROM hive_posts WHERE author = :a AND permlink = :p
from hivemind.
roadscape
commented on August 18, 2024
alt-cache @ 0351d34, 17 mins of block listening
overall: 83% fetching, 14% writing
1048.518 524.259 core.py:1(<module>)
636.210 0.502 {built-in method time.sleep} 61%
344.389 0.112 http_client.py:164(exec) 33%
56.471 0.001 methods.py:46(query) 5%
overall about 42% of execution time is spent on cached posts.
of this, 81% is spent fetching, 12% writing, 6% processing
171.197 0.486 cached_post.py:31(flush)
138.828 0.396 steem_client.py:63(get_content_batch) 81%
21.090 0.060 cached_post.py:166(_batch_queries) 12%
11.001 0.001 cached_post.py:176(_sql) 6%
op stats:
[DEBUG] total STEEM time: 342s
40.4% 138654.00ms 10.95avg 12667x -- get_content()
37.0% 126825.00ms 63.80avg 1988x -- get_dynamic_global_properties()
12.2% 41996.00ms 3.33avg 12604x -- get_accounts()
9.6% 32847.00ms 93.58avg 351x -- get_block()
0.4% 1503.00ms 83.50avg 18x -- get_order_book()
0.3% 1134.00ms 63.00avg 18x -- get_current_median_history_price()
[DEBUG] total SQL time: 21s
57.8% 12662.00ms 1.23avg 10256x -- UPDATE hive_posts_cache SET author = :author, permlink = :permlink, category = :category, depth = :depth, children = :children, title = :title, preview = :preview, body = :body, im
15.1% 3303.00ms 3303.00avg 1x -- SELECT name, id FROM hive_accounts
12.1% 2659.00ms 7.55avg 352x -- SELECT post_id, author, permlink FROM hive_posts_cache WHERE is_paidout = '0' AND payout_at <= :date
4.7% 1034.00ms 0.43avg 2411x -- INSERT INTO hive_posts_cache (post_id, author, permlink, category, depth, children, title, preview, body, img_url, payout, promoted, payout_at, updated_at, created_at, rshares, vot
3.4% 753.00ms 0.06avg 13182x -- SELECT id, is_deleted FROM hive_posts WHERE author = :a AND permlink = :p
2.2% 481.00ms 1.37avg 352x -- COMMIT
2.2% 472.00ms 0.06avg 8129x -- SELECT tag FROM hive_post_tags WHERE post_id = :id
from hivemind.
roadscape
commented on August 18, 2024
from hivemind.
roadscape
commented on August 18, 2024
alt-cache-timing @ 1400da5, sync 220k missing posts and 1668 blocks. jussi was having some hiccups during this time.
the "select paidout posts" query is bogging down steemd_listen quite a lot. vaccuum analyze solves it; need to tune autovac or add in-memory queue.
[DEBUG] total STEEM time: 1645s
91.6% 1506699.00ms 6.84avg 220424x -- get_content
4.6% 76323.00ms 1.13avg 67249x -- get_accounts
2.3% 38374.00ms 64.06avg 599x -- get_dynamic_global_properties
1.4% 22887.00ms 13.72avg 1668x -- get_block
0.0% 708.00ms 64.36avg 11x -- get_order_book
0.0% 682.00ms 62.00avg 11x -- get_current_median_history_price
[DEBUG] total SQL time: 658s
43.6% 286904.00ms 0.66avg 434671x -- UPDATE hive_posts_cache SET author = :author, permlink = :permlink, category = :category, depth = :depth, children = :children, title = :title, preview = :preview, body = :body, im
37.5% 246823.00ms 1059.33avg 233x -- SELECT post_id, author, permlink FROM hive_posts_cache WHERE is_paidout = '0' AND payout_at <= :date
4.0% 26333.00ms 0.69avg 38356x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
3.5% 22783.00ms 0.76avg 29881x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...)
2.0% 13478.00ms 0.20avg 67179x -- UPDATE hive_accounts SET proxy = :proxy, post_count = :post_count, reputation = :reputation, proxy_weight = :proxy_weight, vote_weight = :vote_weight, kb_used = :kb_used, active_at
1.9% 12770.00ms 0.03avg 496898x -- SELECT id, is_deleted FROM hive_posts WHERE author = :a AND permlink = :p
1.9% 12604.00ms 17.01avg 741x -- COMMIT
1.7% 11361.00ms 0.09avg 121644x -- SELECT tag FROM hive_post_tags WHERE post_id = :id
1.0% 6490.00ms 0.13avg 50628x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
0.5% 3492.00ms 3492.00avg 1x -- SELECT name, id FROM hive_accounts
0.5% 2977.00ms 0.08avg 35284x -- UPDATE hive_accounts SET followers = followers + :mag WHERE id = :id
0.4% 2674.00ms 0.11avg 23489x -- SELECT id, depth, category, community FROM hive_posts WHERE author = :author AND permlink = :permlink
0.3% 2040.00ms 0.31avg 6632x -- INSERT INTO hive_post_tags (post_id, tag) VALUES (...) ON CONFLICT DO NOTHING
0.3% 2023.00ms 0.07avg 29737x -- INSERT INTO hive_posts_cache (post_id, author, permlink, category, depth, children, title, preview, body, img_url, payout, promoted, payout_at, updated_at, created_at, rshares, vot
0.2% 1537.00ms 0.56avg 2755x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
0.2% 1408.00ms 0.13avg 11145x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
0.2% 1358.00ms 0.15avg 9166x -- INSERT INTO hive_feed_cache (account_id, post_id, created_at) VALUES (...) ON CONFLICT (account_id, post_id) DO NOTHING
from hivemind.
roadscape
commented on August 18, 2024
from hivemind.
roadscape
commented on August 18, 2024
[DEBUG] total STEEM time: 1504s
94.8% 1425968ms 6.34avg 224758x -- get_content
3.3% 49470ms 1.19avg 41413x -- get_accounts
1.1% 16105ms 68.53avg 235x -- get_dynamic_global_properties
0.8% 12491ms 16.39avg 762x -- get_block
0.0% 413ms 82.60avg 5x -- get_order_book
0.0% 326ms 65.20avg 5x -- get_current_median_history_price
[DEBUG] total SQL time: 531s
51.9% 275655ms 1.28avg 215850x -- UPDATE hive_posts_cache SET author = :author, permlink = :permlink, category = :category, depth = :depth, children = :children, title = :title, preview = :preview, body = :body, im
19.3% 102481ms 1056.51avg 97x -- SELECT post_id, author, permlink FROM hive_posts_cache WHERE is_paidout = '0' AND payout_at <= :date
13.2% 70109ms 0.30avg 230412x -- SELECT id, is_deleted FROM hive_posts WHERE author = :a AND permlink = :p
6.1% 32539ms 0.79avg 41413x -- UPDATE hive_accounts SET proxy = :proxy, post_count = :post_count, reputation = :reputation, proxy_weight = :proxy_weight, vote_weight = :vote_weight, kb_used = :kb_used, active_at
3.6% 19271ms 0.34avg 56036x -- SELECT tag FROM hive_post_tags WHERE post_id = :id
1.3% 7138ms 0.80avg 8906x -- INSERT INTO hive_posts_cache (post_id, author, permlink, category, depth, children, title, preview, body, img_url, payout, promoted, payout_at, updated_at, created_at, rshares, vot
0.8% 4005ms 11.16avg 359x -- COMMIT
0.6% 3283ms 3283.98avg 1x -- SELECT name, id FROM hive_accounts
from hivemind.
roadscape
commented on August 18, 2024
[DEBUG] total STEEM time: 628s
52.8% 331653ms 8.82avg 37603x -- get_content
28.2% 177000ms 69.52avg 2546x -- get_dynamic_global_properties
11.0% 69056ms 1.49avg 46467x -- get_accounts
7.5% 47218ms 89.94avg 525x -- get_block
0.3% 1818ms 69.92avg 26x -- get_order_book
0.3% 1711ms 65.82avg 26x -- get_current_median_history_price
[DEBUG] total SQL time: 161s (20.4%)
38.0% 61384ms 1.81avg 33922x -- UPDATE hive_posts_cache SET author = :author, permlink = :permlink, category = :category, depth = :depth, children = :children, title = :title, preview = :preview, body = :body, im (7.8%)
18.9% 30519ms 0.66avg 46467x -- UPDATE hive_accounts SET proxy = :proxy, post_count = :post_count, reputation = :reputation, proxy_weight = :proxy_weight, vote_weight = :vote_weight, kb_used = :kb_used, active_at (3.9%)
11.3% 18292ms 0.48avg 38305x -- SELECT id, is_deleted FROM hive_posts WHERE author = :a AND permlink = :p
6.6% 10728ms 0.38avg 28522x -- SELECT tag FROM hive_post_tags WHERE post_id = :id
2.7% 4424ms 8.24avg 537x -- COMMIT
2.7% 4387ms 0.63avg 6931x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
2.5% 4060ms 1.10avg 3678x -- INSERT INTO hive_posts_cache (post_id, author, permlink, category, depth, children, title, preview, body, img_url, payout, promoted, payout_at, updated_at, created_at, rshares, vot
2.4% 3821ms 3821.64avg 1x -- SELECT name, id FROM hive_accounts
2.2% 3481ms 0.65avg 5348x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
2.1% 3355ms 0.91avg 3685x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...)
2.0% 3192ms 0.53avg 6044x -- UPDATE hive_accounts SET followers = followers + :mag WHERE id = :id
1.9% 3007ms 5.72avg 526x -- SELECT post_id, author, permlink FROM hive_posts_cache WHERE is_paidout = '0' AND payout_at <= :date
1.5% 2458ms 0.85avg 2890x -- SELECT id, depth, category, community FROM hive_posts WHERE author = :author AND permlink = :permlink
1.4% 2254ms 2254.96avg 1x -- SELECT name FROM hive_accounts ORDER BY cached_at LIMIT :limit
0.8% 1294ms 1.44avg 900x -- INSERT INTO hive_post_tags (post_id, tag) VALUES (...) ON CONFLICT DO NOTHING
steem: 79.6%
db: 20.4%
42.0% get_content
22.4% get_dynamic_global_properties
8.8% get_accounts
7.8% UPDATE hive_posts_cache
6.0% get_block
3.9% UPDATE hive_accounts
2.3% SELECT id, is_deleted FROM hive_posts
6.8% other
with separate id/deleted/depth lookups: (new overheads for is_deleted/depth)
total lookups: 66000, uniq: 19664 (29.8%)
[DEBUG] total STEEM time: 856s
47.6% 407315ms 6.48avg 62904x -- get_content
31.0% 265192ms 62.77avg 4225x -- get_dynamic_global_properties
12.2% 104309ms 1.50avg 69632x -- get_accounts
8.5% 73138ms 74.63avg 980x -- get_block
0.4% 3707ms 86.22avg 43x -- get_order_book
0.3% 2534ms 58.93avg 43x -- get_current_median_history_price
[DEBUG] total SQL time: 318s
31.4% 99827ms 1.75avg 56930x -- UPDATE hive_posts_cache SET author = :author, permlink = :permlink, category = :category, depth = :depth, children = :children, title = :title, preview = :preview, body = :body, im
25.4% 80941ms 95.56avg 847x -- SELECT post_id, author, permlink FROM hive_posts_cache WHERE is_paidout = '0' AND payout_at <= :date
12.1% 38496ms 0.55avg 69632x -- UPDATE hive_accounts SET proxy = :proxy, post_count = :post_count, reputation = :reputation, proxy_weight = :proxy_weight, vote_weight = :vote_weight, kb_used = :kb_used, active_at
8.2% 26068ms 0.39avg 66648x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
5.1% 16181ms 0.35avg 46259x -- SELECT tag FROM hive_post_tags WHERE post_id = :id
4.5% 14453ms 0.25avg 58740x -- SELECT is_deleted FROM hive_posts WHERE id = :id
2.1% 6753ms 0.46avg 14767x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
1.7% 5441ms 0.91avg 5970x -- INSERT INTO hive_posts_cache (post_id, author, permlink, category, depth, children, title, preview, body, img_url, payout, promoted, payout_at, updated_at, created_at, rshares, vot
1.6% 5099ms 0.44avg 11598x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
1.3% 4192ms 0.30avg 14175x -- UPDATE hive_accounts SET followers = followers + :mag WHERE id = :id
1.1% 3479ms 3479.67avg 1x -- SELECT name, id FROM hive_accounts
1.1% 3380ms 0.57avg 5975x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...)
0.8% 2562ms 0.56avg 4563x -- SELECT id, depth, category, community FROM hive_posts WHERE author = :author AND permlink = :permlink
0.7% 2167ms 2167.96avg 1x -- SELECT name FROM hive_accounts ORDER BY cached_at LIMIT :limit
0.6% 1776ms 0.27avg 6623x -- UPDATE hive_accounts SET following = following + :mag WHERE id = :id
0.5% 1569ms 1.81avg 865x -- COMMIT
from hivemind.
roadscape
commented on August 18, 2024
post.id lookups: 29000, hits: 14818 (51.1%), entries: 19050
[DEBUG] total STEEM time: 843s
43.1% 363677ms 69.07avg 5265x -- get_dynamic_global_properties
33.9% 285595ms 9.81avg 29120x -- get_content
12.2% 103329ms 2.66avg 38858x -- get_accounts
10.0% 83948ms 92.45avg 908x -- get_block
0.4% 3717ms 80.83avg 46x -- get_order_book
0.4% 3330ms 72.41avg 46x -- get_feed_history
[DEBUG] total SQL time: 149s
38.0% 56839ms 62.53avg 909x -- SELECT post_id, author, permlink FROM hive_posts_cache WHERE is_paidout = '0' AND payout_at <= :date
15.0% 22527ms 0.58avg 38858x -- UPDATE hive_accounts SET proxy = :proxy, post_count = :post_count, reputation = :reputation, proxy_weight = :proxy_weight, vote_weight = :vote_weight, kb_used = :kb_used, active_at
14.3% 21472ms 0.92avg 23464x -- UPDATE hive_posts_cache SET author = :author, permlink = :permlink, category = :category, depth = :depth, children = :children, title = :title, preview = :preview, body = :body, im
6.3% 9437ms 0.65avg 14591x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
4.2% 6319ms 0.37avg 17089x -- SELECT tag FROM hive_post_tags WHERE post_id = :id
3.1% 4656ms 0.41avg 11354x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
2.5% 3717ms 0.66avg 5652x -- INSERT INTO hive_posts_cache (post_id, author, permlink, category, depth, children, title, preview, body, img_url, payout, promoted, payout_at, updated_at, created_at, rshares, vot
2.4% 3528ms 3528.45avg 1x -- SELECT name, id FROM hive_accounts
2.2% 3332ms 0.31avg 10826x -- UPDATE hive_accounts SET followers = followers + :mag WHERE id = :id
2.2% 3332ms 0.40avg 8260x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
2.0% 2930ms 0.52avg 5653x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...)
1.3% 1906ms 1906.04avg 1x -- SELECT name FROM hive_accounts ORDER BY cached_at LIMIT :limit
1.2% 1773ms 0.27avg 6489x -- UPDATE hive_accounts SET following = following + :mag WHERE id = :id
1.0% 1516ms 0.34avg 4451x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
from hivemind.
roadscape
commented on August 18, 2024
from hivemind.
roadscape
commented on August 18, 2024
Syncing blocks; 50.1% of SQL time spent on hive_follows.
[DEBUG] total STEEM time: 272s
99.9% 272,098ms 6.80avg 40000x -- get_block
0.1% 273ms 273.96avg 1x -- get_dynamic_global_properties
Fastest call was 273.955ms
[DEBUG] total SQL time: 1147s
25.8% 296463ms 0.38avg 774495x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
21.4% 245768ms 0.41avg 597060x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
15.9% 182772ms 0.62avg 294694x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
15.0% 172578ms 0.50avg 343332x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
6.4% 73746ms 0.32avg 232379x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
4.8% 54803ms 0.29avg 190495x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
2.9% 33023ms 0.37avg 88238x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
2.6% 30349ms 0.35avg 87785x -- INSERT INTO hive_feed_cache (account_id, post_id, created_at) VALUES (...) ON CONFLICT (account_id, post_id) DO NOTHING
1.2% 13715ms 0.54avg 25404x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
1.1% 12965ms 0.33avg 39676x -- INSERT INTO hive_blocks (num, hash, prev, txs, ops, created_at) VALUES (...)
1.1% 12850ms 0.31avg 42070x -- SELECT is_deleted FROM hive_posts WHERE id = :id
0.6% 7323ms 0.26avg 28054x -- SELECT depth FROM hive_posts WHERE id = :id
0.3% 3272ms 3272.19avg 1x -- SELECT name, id FROM hive_accounts
Batch load of posts
[DEBUG] total STEEM time: 307s
98.5% 302,907ms 1.05avg 287968x -- get_content
1.5% 4,655ms 4.66avg 1000x -- get_block
0.0% 63ms 63.39avg 1x -- get_dynamic_global_properties
Fastest call was 63.389ms
[DEBUG] total SQL time: 334s
73.7% 246363ms 0.86avg 287709x -- INSERT INTO hive_posts_cache (post_id, author, permlink, category, depth, children, title, preview, body, img_url, payout, promoted, payout_at, updated_at, created_at, rshares, vot
11.0% 36657ms 0.60avg 60867x -- INSERT INTO hive_post_tags (post_id, tag) VALUES (...) ON CONFLICT DO NOTHING
6.3% 21173ms 0.35avg 60867x -- SELECT tag FROM hive_post_tags WHERE post_id = :id
1.7% 5722ms 0.46avg 12427x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
1.7% 5523ms 19.18avg 288x -- COMMIT
1.2% 4088ms 0.40avg 10155x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
1.2% 3858ms 3858.16avg 1x -- SELECT name, id FROM hive_accounts
0.9% 3115ms 0.65avg 4818x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
0.8% 2619ms 0.48avg 5428x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
0.4% 1400ms 0.37avg 3830x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
0.3% 977ms 0.30avg 3206x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
0.1% 492ms 0.34avg 1449x -- INSERT INTO hive_feed_cache (account_id, post_id, created_at) VALUES (...) ON CONFLICT (account_id, post_id) DO NOTHING
0.1% 471ms 0.33avg 1450x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
0.1% 376ms 376.80avg 1x -- SELECT id, author, permlink FROM hive_posts WHERE is_deleted = '0' AND id > :id ORDER BY id LIMIT :limit
from hivemind.
roadscape
commented on August 18, 2024
url:https://api.steemitdev.com batch:500 workers:1 appbase:True
date: feb 5
activity: 400k payouts
[DEBUG] total STEEM time: 595s
99.5% 592,179ms 1.37avg 430828x -- get_content
0.3% 1,608ms 10.73avg 150x -- get_block
0.3% 1,505ms 0.92avg 1633x -- get_accounts
0.0% 69ms 69.39avg 1x -- get_dynamic_global_properties
Fastest call was 69.386ms
[DEBUG] total SQL time: 546s
86.4% 472392ms 1.10avg 429546x -- UPDATE hive_posts_cache SET author = :author, permlink = :permlink, category = :category, depth = :depth, children = :children, title = :title, preview = :preview, body = :body, im
5.9% 32329ms 0.32avg 100609x -- SELECT tag FROM hive_post_tags WHERE post_id = :id
4.9% 27049ms 62.04avg 436x -- COMMIT
0.6% 3223ms 3223.26avg 1x -- SELECT name, id FROM hive_accounts
0.5% 2817ms 0.84avg 3339x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
0.2% 1358ms 1358.39avg 1x -- SELECT post_id, author, permlink FROM hive_posts_cache WHERE is_paidout = '0' AND payout_at <= :date
0.2% 1245ms 0.76avg 1633x -- UPDATE hive_accounts SET proxy = :proxy, post_count = :post_count, reputation = :reputation, proxy_weight = :proxy_weight, vote_weight = :vote_weight, kb_used = :kb_used, active_at
0.2% 1080ms 0.85avg 1273x -- INSERT INTO hive_posts_cache (post_id, author, permlink, category, depth, children, title, preview, body, img_url, payout, promoted, payout_at, updated_at, created_at, rshares, vot
0.2% 1058ms 0.59avg 1791x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
0.2% 924ms 0.81avg 1138x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
0.1% 726ms 0.47avg 1561x -- UPDATE hive_accounts SET followers = followers + :mag WHERE id = :id
0.1% 621ms 1.13avg 550x -- INSERT INTO hive_post_tags (post_id, tag) VALUES (...) ON CONFLICT DO NOTHING
0.1% 533ms 0.30avg 1781x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
0.1% 326ms 0.40avg 817x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
0.0% 242ms 0.55avg 442x -- INSERT INTO hive_feed_cache (account_id, post_id, created_at) VALUES (...) ON CONFLICT (account_id, post_id) DO NOTHING
0.0% 228ms 0.32avg 712x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
0.0% 189ms 1.17avg 161x -- DELETE FROM hive_post_tags WHERE post_id = :id AND tag IN :tags
0.0% 117ms 0.39avg 301x -- UPDATE hive_accounts SET following = following + :mag WHERE id = :id
0.0% 90ms 0.75avg 121x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
ncalls tottime percall cumtime percall filename:lineno(function)
2 0.000 0.000 1244.330 622.165 core.py:1(<module>)
390/1 0.012 0.000 1244.330 1244.330 {built-in method builtins.exec}
1 0.005 0.005 1244.011 1244.011 core.py:217(run)
1 0.073 0.073 1239.327 1239.327 core.py:60(sync_from_steemd)
3 0.070 0.023 1222.654 407.551 cached_post.py:48(flush)
3 2.187 0.729 1220.976 406.992 cached_post.py:204(_update_batch)
867 0.059 0.000 594.663 0.686 http_client.py:143(_exec)
433 0.003 0.000 593.793 1.371 steem_client.py:236(__exec_batch)
433 0.054 0.000 593.785 1.371 steem_client.py:251(__exec_batch_with_retry)
431411 0.215 0.000 593.730 0.001 http_client.py:211(exec_batch)
432 0.046 0.000 592.229 1.371 steem_client.py:128(get_content_batch)
867 0.010 0.000 575.923 0.664 poolmanager.py:301(urlopen)
867 0.020 0.000 575.861 0.664 connectionpool.py:447(urlopen)
74517 0.098 0.000 570.999 0.008 socket.py:572(readinto)
74517 0.090 0.000 570.781 0.008 ssl.py:991(recv_into)
74517 0.070 0.000 570.671 0.008 ssl.py:857(read)
74517 0.050 0.000 570.593 0.008 ssl.py:618(read)
74517 570.543 0.008 570.543 0.008 {method 'read' of '_ssl._SSLSocket' objects}
83714 0.164 0.000 570.080 0.007 {method 'readline' of '_io.BufferedReader' objects}
547238 2.563 0.000 569.100 0.001 methods.py:18(wrap)
867 0.018 0.000 560.963 0.647 connectionpool.py:322(_make_request)
867 0.005 0.000 560.445 0.646 client.py:1287(getresponse)
867 0.013 0.000 560.419 0.646 client.py:290(begin)
867 0.014 0.000 560.151 0.646 client.py:257(_read_status)
547238 2.947 0.000 545.140 0.001 methods.py:76(__query)
439620 1.741 0.000 527.728 0.001 methods.py:95(query)
432 3.581 0.008 527.132 1.220 cached_post.py:260(_batch_queries)
547241 0.616 0.000 472.113 0.001 base.py:879(execute)
547238 0.462 0.000 471.344 0.001 elements.py:261(_execute_on_connection)
547238 2.579 0.000 470.882 0.001 base.py:1009(_execute_clauseelement)
547241 3.784 0.000 371.806 0.001 base.py:1104(_execute_context)
547243 0.319 0.000 316.987 0.001 default.py:469(do_execute)
547245 314.758 0.001 316.671 0.001 {method 'execute' of 'psycopg2.extensions.cursor' objects}
2736367 48.558 0.000 152.976 0.000 {method 'sub' of '_sre.SRE_Pattern' objects}
430819 14.254 0.000 98.604 0.000 cached_post.py:270(_sql)
547240 0.855 0.000 95.076 0.000 elements.py:373(compile)
547240 0.802 0.000 94.221 0.000 elements.py:438(_compiler)
547240 3.099 0.000 93.420 0.000 compiler.py:376(__init__)
547240 1.132 0.000 89.381 0.000 compiler.py:177(__init__)
14066037/547240 6.498 0.000 88.249 0.000 compiler.py:241(process)
14066047/547240 18.279 0.000 87.791 0.000 visitors.py:75(_compiler_dispatch)
547238 1.040 0.000 75.999 0.000 compiler.py:737(visit_textclause)
547242 0.439 0.000 65.010 0.000 <string>:1(text)
547242 0.929 0.000 64.571 0.000 elements.py:1240(_create_text)
547242 0.726 0.000 63.642 0.000 elements.py:1225(__init__)
13518797 11.236 0.000 57.448 0.000 compiler.py:738(do_bindparam)
13518797 16.164 0.000 46.970 0.000 elements.py:1232(repl)
547238 8.049 0.000 39.825 0.000 default.py:554(_init_compiled)
100609 0.387 0.000 35.134 0.000 methods.py:112(query_col)
13518797 14.932 0.000 31.530 0.000 compiler.py:1173(visit_bindparam)
13518827 16.318 0.000 25.063 0.000 elements.py:861(__init__)
from hivemind.
roadscape
commented on August 18, 2024
url:https://api.steemitdev.com batch:500 workers:1 appbase:True
date: feb 6
activity: 387 blocks; 10,244 posts (~3000 inserts)
[DEBUG] total STEEM time: 21s
71.6% 15,448ms 1.51avg 10244x -- get_content
14.0% 3,020ms 0.93avg 3257x -- get_accounts
12.7% 2,743ms 7.09avg 387x -- get_block
1.7% 372ms 372.73avg 1x -- get_dynamic_global_properties
[STEEM] Fastest call was 181.005ms
[MEM] peak memory usage: 385.68MB
[DEBUG] total SQL time: 57s
34.2% 19817ms 2.74avg 7245x -- UPDATE hive_posts_cache SET updated_at = :updated_at, title = :title, preview = :preview, body = :body, img_url = :img_url, is_nsfw = :is_nsfw, is_declined = :is_declined, is_full_
8.1% 4720ms 1.57avg 2998x -- INSERT INTO hive_posts_cache (post_id, author, permlink, category, depth, created_at, payout_at, updated_at, title, preview, body, img_url, is_nsfw, is_declined, is_full_power, is_
7.6% 4425ms 1.47avg 3004x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
7.6% 4420ms 0.59avg 7520x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
6.3% 3660ms 215.33avg 17x -- COMMIT
5.5% 3215ms 0.74avg 4323x -- UPDATE hive_accounts SET followers = followers + :mag WHERE id = :id
5.5% 3200ms 3200.36avg 1x -- SELECT name, id FROM hive_accounts
5.2% 3030ms 0.43avg 7085x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
3.9% 2277ms 0.47avg 4804x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
3.8% 2229ms 0.51avg 4382x -- SELECT tag FROM hive_post_tags WHERE post_id = :id
3.7% 2117ms 0.65avg 3257x -- UPDATE hive_accounts SET proxy = :proxy, post_count = :post_count, reputation = :reputation, proxy_weight = :proxy_weight, vote_weight = :vote_weight, kb_used = :kb_used, active_at
3.6% 2063ms 3.17avg 652x -- INSERT INTO hive_post_tags (post_id, tag) VALUES (...) ON CONFLICT DO NOTHING
1.3% 754ms 0.32avg 2376x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
1.0% 594ms 0.31avg 1917x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
0.7% 398ms 0.45avg 891x -- INSERT INTO hive_feed_cache (account_id, post_id, created_at) VALUES (...) ON CONFLICT (account_id, post_id) DO NOTHING
0.3% 200ms 0.33avg 611x -- UPDATE hive_accounts SET following = following + :mag WHERE id = :id
0.3% 168ms 0.28avg 605x -- SELECT is_deleted FROM hive_posts WHERE id = :id
0.3% 159ms 0.61avg 261x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
0.3% 146ms 0.38avg 387x -- INSERT INTO hive_blocks (num, hash, prev, txs, ops, created_at) VALUES (...)
0.2% 117ms 0.37avg 314x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
0.1% 83ms 0.30avg 278x -- SELECT depth FROM hive_posts WHERE id = :id
0.1% 46ms 2.21avg 21x -- DELETE FROM hive_post_tags WHERE post_id = :id AND tag IN :tags
0.1% 31ms 31.82avg 1x -- SELECT post_id FROM hive_posts_cache WHERE is_paidout = '0' AND payout_at <= :date
0.0% 15ms 15.96avg 1x -- SELECT id, author, permlink FROM hive_posts WHERE id IN :ids
from hivemind.
roadscape
commented on August 18, 2024
url:https://api.steemitstage.com batch:500 workers:1 appbase:False
date: feb 7
activity: listen
[DEBUG] total STEEM time: 1800s
54.6% 982,836ms 3.99avg 246087x -- get_content
24.1% 433,909ms 102.97avg 4214x -- get_block
19.1% 343,489ms 2.57avg 133609x -- get_accounts
0.8% 13,822ms 61.99avg 223x -- get_dynamic_global_properties
0.7% 13,200ms 62.86avg 210x -- get_feed_history
0.7% 12,808ms 60.99avg 210x -- get_order_book
[STEEM] Fastest call was 48.074ms
[MEM] peak memory usage: 391.20MB
[DEBUG] total SQL time: 1800s
25.4% 457957ms 0.96avg 478946x -- UPDATE hive_posts_cache SET updated_at = :updated_at, title = :title, preview = :preview, body = :body, img_url = :img_url, is_nsfw = :is_nsfw, is_declined = :is_declined, is_full_
15.7% 283271ms 25.76avg 10996x -- COMMIT
12.2% 219766ms 0.63avg 350736x -- UPDATE hive_accounts SET proxy = :proxy, post_count = :post_count, reputation = :reputation, proxy_weight = :proxy_weight, vote_weight = :vote_weight, kb_used = :kb_used, active_at
8.7% 156234ms 0.39avg 397881x -- SELECT tag FROM hive_post_tags WHERE post_id = :id
6.7% 120155ms 0.48avg 251646x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
5.9% 105919ms 0.81avg 130549x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
4.7% 83971ms 0.46avg 181597x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
3.2% 57154ms 0.73avg 78329x -- INSERT INTO hive_posts_cache (post_id, author, permlink, category, depth, created_at, payout_at, updated_at, title, preview, body, img_url, is_nsfw, is_declined, is_full_power, is_
3.2% 56831ms 0.29avg 195299x -- UPDATE hive_accounts SET followers = followers + :mag WHERE id = :id
3.0% 54199ms 6022.15avg 9x -- SELECT name FROM hive_accounts ORDER BY cached_at LIMIT :limit
2.8% 50253ms 0.64avg 78336x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
1.5% 26211ms 0.43avg 61665x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
1.4% 24842ms 0.24avg 103149x -- UPDATE hive_accounts SET following = following + :mag WHERE id = :id
1.0% 18516ms 1.04avg 17795x -- INSERT INTO hive_post_tags (post_id, tag) VALUES (...) ON CONFLICT DO NOTHING
0.9% 16467ms 0.32avg 50759x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
0.7% 12156ms 0.51avg 23649x -- INSERT INTO hive_feed_cache (account_id, post_id, created_at) VALUES (...) ON CONFLICT (account_id, post_id) DO NOTHING
0.6% 10334ms 0.95avg 10897x -- SELECT post_id FROM hive_posts_cache WHERE is_paidout = '0' AND payout_at <= :date
0.3% 5483ms 0.50avg 10896x -- INSERT INTO hive_blocks (num, hash, prev, txs, ops, created_at) VALUES (...)
0.3% 5430ms 0.36avg 15098x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
0.3% 5047ms 0.46avg 10897x -- SELECT id, author, permlink FROM hive_posts WHERE id IN :ids
0.3% 4993ms 0.72avg 6961x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
0.3% 4891ms 0.35avg 13840x -- SELECT is_deleted FROM hive_posts WHERE id = :id
0.2% 3892ms 0.36avg 10883x -- SELECT id, author, permlink FROM hive_posts WHERE is_deleted = '0' AND id > :id ORDER BY id LIMIT :limit
0.2% 3741ms 0.34avg 10898x -- SELECT MAX(id) FROM hive_posts WHERE is_deleted = '0'
0.2% 3371ms 3371.97avg 1x -- SELECT name, id FROM hive_accounts
0.2% 3290ms 0.30avg 10997x -- START TRANSACTION
0.1% 2645ms 0.35avg 7611x -- SELECT depth FROM hive_posts WHERE id = :id
from hivemind.
roadscape
commented on August 18, 2024
url:https://api.steemitdev.com batch:500 workers:1 appbase:True
date: feb 8
activity: listen (12.5 hours)
[DEBUG] total STEEM time: ~6128s
52.5% 945,656ms 6.27avg 150822x -- get_content
24.3% 437,373ms 96.59avg 4528x -- get_block
20.2% 363,821ms 2.93avg 124372x -- get_accounts
1.4% 25,109ms 71.95avg 349x -- get_dynamic_global_properties
0.8% 14,311ms 65.05avg 220x -- get_feed_history
0.8% 13,754ms 62.52avg 220x -- get_order_book
[STEEM] Fastest call was 50.420ms
[MEM] peak memory usage: 512.89MB
[DEBUG] total SQL time: 1651s
19.7% 325054ms 0.71avg 456195x -- UPDATE hive_accounts SET proxy = :proxy, post_count = :post_count, reputation = :reputation, proxy_weight = :proxy_weight, vote_weight = :vote_weight, kb_used = :kb_used, active_at
12.6% 208367ms 0.80avg 262055x -- UPDATE hive_posts_cache SET payout = :payout, promoted = :promoted, rshares = :rshares, votes = :votes, sc_trend = :sc_trend, sc_hot = :sc_hot, flag_weight = :flag_weight, total_vo
11.7% 192930ms 1.00avg 192297x -- UPDATE hive_posts_cache SET created_at = :created_at, payout_at = :payout_at, updated_at = :updated_at, title = :title, preview = :preview, body = :body, img_url = :img_url, is_nsf
6.7% 110297ms 0.37avg 299532x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
6.6% 108752ms 7.22avg 15064x -- COMMIT
6.5% 106604ms 0.65avg 164248x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
6.1% 100382ms 0.67avg 149649x -- INSERT INTO hive_posts_cache (post_id, author, permlink, category, depth, created_at, payout_at, updated_at, title, preview, body, img_url, is_nsfw, is_declined, is_full_power, is_
4.8% 78601ms 0.34avg 229010x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
4.7% 77037ms 0.29avg 264835x -- UPDATE hive_accounts SET followers = followers + :mag WHERE id = :id
4.1% 67925ms 0.61avg 110754x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
2.7% 44330ms 2.99avg 14819x -- SELECT post_id FROM hive_posts_cache WHERE is_paidout = '0' AND payout_at <= :date
2.3% 37274ms 0.42avg 89476x -- SELECT tag FROM hive_post_tags WHERE post_id = :id
2.1% 34386ms 0.41avg 84506x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
1.9% 31497ms 0.25avg 124001x -- UPDATE hive_accounts SET following = following + :mag WHERE id = :id
1.6% 26474ms 0.73avg 36109x -- INSERT INTO hive_post_tags (post_id, tag) VALUES (...) ON CONFLICT DO NOTHING
1.4% 23580ms 0.33avg 72174x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
0.9% 14800ms 0.41avg 36512x -- INSERT INTO hive_feed_cache (account_id, post_id, created_at) VALUES (...) ON CONFLICT (account_id, post_id) DO NOTHING
0.8% 12564ms 0.29avg 42982x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
0.4% 7417ms 0.49avg 15106x -- INSERT INTO hive_blocks (num, hash, prev, txs, ops, created_at) VALUES (...)
0.4% 7291ms 0.37avg 19842x -- SELECT is_deleted FROM hive_posts WHERE id = :id
0.4% 7221ms 601.78avg 12x -- SELECT name FROM hive_accounts ORDER BY cached_at LIMIT :limit
0.4% 6603ms 0.45avg 14770x -- SELECT id, author, permlink FROM hive_posts WHERE id IN :ids
0.4% 5851ms 5851.25avg 1x -- SELECT name, id FROM hive_accounts
0.3% 5128ms 0.50avg 10241x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
0.3% 4383ms 0.29avg 15064x -- START TRANSACTION
0.2% 3457ms 0.30avg 11380x -- SELECT depth FROM hive_posts WHERE id = :id
0.1% 934ms 1.26avg 741x -- UPDATE hive_state SET block_num = :block_num, steem_per_mvest = :spm, usd_per_steem = :ups, sbd_per_steem = :sps, dgpo = :dgpo
0.1% 840ms 0.63avg 1334x -- DELETE FROM hive_post_tags WHERE post_id = :id AND tag IN :tags
0.0% 480ms 0.52avg 921x -- INSERT INTO hive_accounts (name, created_at) VALUES (...)
0.0% 445ms 0.39avg 1139x -- UPDATE hive_posts SET is_deleted = '1' WHERE id = :id
0.0% 441ms 0.39avg 1139x -- DELETE FROM hive_posts_cache WHERE post_id = :id
0.0% 348ms 0.39avg 885x -- SELECT name, id FROM hive_accounts WHERE name IN :names
0.0% 143ms 0.49avg 291x -- DELETE FROM hive_feed_cache WHERE post_id = :id
0.0% 53ms 53.33avg 1x -- SELECT id, author, permlink FROM hive_posts WHERE is_deleted = '0' AND id > :id ORDER BY id LIMIT :limit
0.0% 18ms 18.76avg 1x -- SELECT db_version FROM hive_state LIMIT 1
0.0% 11ms 0.50avg 23x -- UPDATE hive_posts SET is_valid = :is_valid, is_deleted = '0', parent_id = :parent_id, category = :category, community = :community, depth = :depth WHERE id = :id
0.0% 10ms 0.44avg 23x -- INSERT INTO hive_posts_cache (post_id, author, permlink) VALUES (...)
0.0% 5ms 0.84avg 6x -- SELECT num, created_at date, hash FROM hive_blocks ORDER BY num DESC LIMIT 1
0.0% 1ms 1.75avg 1x -- SELECT 1 FROM pg_catalog.pg_tables WHERE schemaname = 'public'
0.0% 1ms 0.61avg 2x -- SELECT MAX(id) FROM hive_posts WHERE is_deleted = '0'
from hivemind.
roadscape
commented on August 18, 2024
url:https://api.steemitstage.com batch:500 workers:1 appbase:False
date: feb 9 - feb 12
activity: listen (64 hours)
(note: bug w/ missing fields on insert)
STEEM (30-min sample)
48.9% 880,135ms 4.95avg 177643x -- get_content
27.9% 502,087ms 117.45avg 4275x -- get_block
20.8% 374,234ms 2.41avg 155523x -- get_accounts
1.0% 17,418ms 59.45avg 293x -- get_dynamic_global_properties
0.8% 13,624ms 65.19avg 209x -- get_feed_history
0.7% 12,658ms 60.57avg 209x -- get_order_book
peak memory usage: 830.85MB
SQL (30-min sample)
23.1% 415588ms 0.66avg 632467x -- UPDATE hive_accounts SET proxy = :proxy, post_count = :post_count, reputation = :reputation, proxy_weight = :proxy_weight, vote_weight = :vote_weight, kb_used = :kb_used, active_at
16.0% 287615ms 0.81avg 357273x -- UPDATE hive_posts_cache SET payout = :payout, promoted = :promoted, rshares = :rshares, votes = :votes, sc_trend = :sc_trend, sc_hot = :sc_hot, flag_weight = :flag_weight, total_vo
13.1% 236630ms 0.84avg 281686x -- UPDATE hive_posts_cache SET created_at = :created_at, updated_at = :updated_at, title = :title, payout_at = :payout_at, preview = :preview, body = :body, img_url = :img_url, is_nsf
7.4% 133053ms 8.16avg 16312x -- SELECT post_id FROM hive_posts_cache WHERE is_paidout = '0' AND payout_at <= :date
5.0% 90148ms 0.58avg 156308x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
4.4% 79016ms 0.31avg 253060x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
4.3% 77351ms 0.58avg 132551x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
3.8% 67517ms 0.51avg 132546x -- INSERT INTO hive_posts_cache (post_id, author, permlink, category, depth, payout, promoted, rshares, votes, sc_trend, sc_hot, flag_weight, total_votes, up_votes, is_hidden, is_gray
3.6% 65031ms 0.27avg 237657x -- UPDATE hive_accounts SET followers = followers + :mag WHERE id = :id
3.5% 63521ms 0.30avg 212164x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
2.5% 44110ms 0.44avg 99729x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
2.2% 39882ms 2.42avg 16454x -- COMMIT
2.1% 37450ms 0.26avg 143175x -- UPDATE hive_accounts SET following = following + :mag WHERE id = :id
1.9% 33702ms 0.44avg 76281x -- SELECT tag FROM hive_post_tags WHERE post_id = :id
1.6% 28969ms 0.34avg 85910x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
1.0% 18740ms 0.53avg 35083x -- INSERT INTO hive_post_tags (post_id, tag) VALUES (...) ON CONFLICT DO NOTHING
0.9% 16636ms 0.36avg 45845x -- INSERT INTO hive_feed_cache (account_id, post_id, created_at) VALUES (...) ON CONFLICT (account_id, post_id) DO NOTHING
0.7% 12527ms 963.68avg 13x -- SELECT name FROM hive_accounts ORDER BY cached_at LIMIT :limit
0.4% 8043ms 0.49avg 16311x -- INSERT INTO hive_blocks (num, hash, prev, txs, ops, created_at) VALUES (...)
0.4% 8024ms 0.30avg 26846x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
0.4% 7561ms 0.46avg 16312x -- SELECT id, author, permlink FROM hive_posts WHERE id IN :ids
0.4% 7402ms 0.39avg 18806x -- SELECT is_deleted FROM hive_posts WHERE id = :id
0.3% 5557ms 0.43avg 12980x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
0.3% 5091ms 0.31avg 16454x -- START TRANSACTION
0.3% 4733ms 0.34avg 14044x -- SELECT depth FROM hive_posts WHERE id = :id
0.1% 1792ms 0.41avg 4342x -- INSERT INTO hive_accounts (name, created_at) VALUES (...)
0.1% 1517ms 0.40avg 3765x -- SELECT name, id FROM hive_accounts WHERE name IN :names
0.1% 902ms 1.11avg 815x -- UPDATE hive_state SET block_num = :block_num, steem_per_mvest = :spm, usd_per_steem = :ups, sbd_per_steem = :sps, dgpo = :dgpo
0.0% 781ms 0.45avg 1751x -- DELETE FROM hive_post_tags WHERE post_id = :id AND tag IN :tags
0.0% 465ms 0.44avg 1064x -- DELETE FROM hive_posts_cache WHERE post_id = :id
0.0% 407ms 0.38avg 1064x -- UPDATE hive_posts SET is_deleted = '1' WHERE id = :id
0.0% 173ms 0.46avg 375x -- DELETE FROM hive_feed_cache WHERE post_id = :id
0.0% 28ms 0.66avg 43x -- INSERT INTO hive_posts_cache (post_id, author, permlink) VALUES (...)
0.0% 20ms 0.48avg 43x -- UPDATE hive_posts SET is_valid = :is_valid, is_deleted = '0', parent_id = :parent_id, category = :category, community = :community, depth = :depth WHERE id = :id
from hivemind.
roadscape
commented on August 18, 2024
url:https://api.steemitdev.com batch:500 workers:1 appbase:True
date: feb 12
activity: sync 1875 blocks (no post cache)
[DEBUG] total STEEM time: 11s
99.4% 11,029ms 5.88avg 1875x -- get_block
0.6% 61ms 61.63avg 1x -- get_dynamic_global_properties
[STEEM] Fastest call was 61.632ms
[MEM] peak memory usage: 486.02MB
[DEBUG] total SQL time: 63s
22.8% 14431ms 0.43avg 33630x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
22.4% 14178ms 0.67avg 21132x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
18.8% 11924ms 0.43avg 27716x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
12.3% 7794ms 0.54avg 14393x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
5.6% 3523ms 0.31avg 11449x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
3.8% 2379ms 0.26avg 9129x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
3.5% 2228ms 0.36avg 6151x -- UPDATE hive_accounts SET followers = followers + :mag WHERE id = :id
3.3% 2119ms 0.48avg 4408x -- INSERT INTO hive_feed_cache (account_id, post_id, created_at) VALUES (...) ON CONFLICT (account_id, post_id) DO NOTHING
2.3% 1480ms 0.28avg 5203x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
1.2% 774ms 0.53avg 1458x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
1.1% 697ms 697.26avg 1x -- SELECT name, id FROM hive_accounts
0.9% 592ms 0.32avg 1874x -- INSERT INTO hive_blocks (num, hash, prev, txs, ops, created_at) VALUES (...)
0.9% 559ms 0.28avg 2021x -- SELECT is_deleted FROM hive_posts WHERE id = :id
0.7% 433ms 0.28avg 1575x -- SELECT depth FROM hive_posts WHERE id = :id
0.1% 60ms 0.36avg 169x -- INSERT INTO hive_accounts (name, created_at) VALUES (...)
0.1% 50ms 0.43avg 117x -- DELETE FROM hive_posts_cache WHERE post_id = :id
0.1% 46ms 0.40avg 117x -- UPDATE hive_posts SET is_deleted = '1' WHERE id = :id
0.1% 42ms 0.26avg 163x -- SELECT name, id FROM hive_accounts WHERE name IN :names
0.0% 14ms 0.39avg 37x -- DELETE FROM hive_feed_cache WHERE post_id = :id
0.0% 3ms 1.59avg 2x -- SELECT num FROM hive_blocks ORDER BY num DESC LIMIT 1
0.0% 2ms 2.78avg 1x -- SELECT MAX(id) FROM hive_posts WHERE is_deleted = '0'
0.0% 2ms 0.44avg 6x -- UPDATE hive_posts SET is_valid = :is_valid, is_deleted = '0', parent_id = :parent_id, category = :category, community = :community, depth = :depth WHERE id = :id
activity: insert 14338 cached posts
[DEBUG] total STEEM time: 24s
94.6% 23,348ms 1.63avg 14338x -- get_content
5.1% 1,258ms 10.40avg 121x -- get_block
0.3% 62ms 62.77avg 1x -- get_dynamic_global_properties
[STEEM] Fastest call was 62.771ms
[MEM] peak memory usage: 304.70MB
[DEBUG] total SQL time: 16s
72.5% 12246ms 0.85avg 14333x -- INSERT INTO hive_posts_cache (post_id, author, permlink, category, depth, created_at, updated_at, title, payout_at, preview, body, img_url, is_nsfw, is_declined, is_full_power, is_
13.1% 2210ms 0.76avg 2927x -- INSERT INTO hive_post_tags (post_id, tag) VALUES (...) ON CONFLICT DO NOTHING
6.7% 1123ms 1123.74avg 1x -- SELECT name, id FROM hive_accounts
4.9% 832ms 0.28avg 2927x -- SELECT tag FROM hive_post_tags WHERE post_id = :id
0.7% 125ms 8.38avg 15x -- COMMIT
0.5% 80ms 0.58avg 138x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
0.4% 69ms 0.62avg 113x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
0.4% 63ms 0.91avg 70x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
0.2% 34ms 0.83avg 42x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
0.1% 20ms 20.14avg 1x -- SELECT id, author, permlink FROM hive_posts WHERE is_deleted = '0' AND id > :id ORDER BY id LIMIT :limit
0.1% 17ms 0.46avg 38x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
0.1% 12ms 12.91avg 1x -- SELECT db_version FROM hive_state LIMIT 1
0.1% 9ms 0.37avg 25x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
0.0% 7ms 0.26avg 28x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
0.0% 6ms 0.75avg 9x -- INSERT INTO hive_feed_cache (account_id, post_id, created_at) VALUES (...) ON CONFLICT (account_id, post_id) DO NOTHING
0.0% 5ms 1.02avg 5x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
0.0% 3ms 0.65avg 6x -- INSERT INTO hive_blocks (num, hash, prev, txs, ops, created_at) VALUES (...)
0.0% 3ms 0.23avg 16x -- START TRANSACTION
from hivemind.
roadscape
commented on August 18, 2024
url:https://api.steemitdev.com batch:500 workers:1 appbase:True
activity:listen, 68hrs
psql changes: #52 (comment)
sampled STEEM time: 1800s
54.2% 976,409ms 5.46avg 178674x -- get_content
23.3% 419,792ms 100.12avg 4193x -- get_block
19.9% 358,705ms 2.56avg 140351x -- get_accounts
1.1% 19,629ms 77.28avg 254x -- get_dynamic_global_properties
0.7% 12,848ms 62.07avg 207x -- get_feed_history
0.7% 12,805ms 61.86avg 207x -- get_order_book
[MEM] peak memory usage: 1005.98MB
sampled SQL time: 1800s
22.6% 407586ms 0.68avg 603342x -- UPDATE hive_accounts SET proxy = :proxy, post_count = :post_count, reputation = :reputation, proxy_weight = :proxy_weight, vote_weight = :vote_weight, kb_used = :kb_used, active_at
15.2% 274459ms 0.70avg 394545x -- UPDATE hive_posts_cache SET payout = :payout, rshares = :rshares, votes = :votes, sc_trend = :sc_trend, sc_hot = :sc_hot, flag_weight = :flag_weight, total_votes = :total_votes, up
8.7% 156058ms 0.89avg 174693x -- UPDATE hive_posts_cache SET created_at = :created_at, updated_at = :updated_at, title = :title, payout_at = :payout_at, preview = :preview, body = :body, img_url = :img_url, is_nsf
7.6% 135958ms 0.43avg 319433x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
6.4% 115616ms 0.74avg 157065x -- INSERT INTO hive_posts_cache (post_id, author, permlink, category, depth, created_at, updated_at, title, payout_at, preview, body, img_url, is_nsfw, is_declined, is_full_power, is_
6.1% 110020ms 0.62avg 176212x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
5.3% 95272ms 0.42avg 224655x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
5.0% 90471ms 0.58avg 157079x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
4.7% 84445ms 0.29avg 289840x -- UPDATE hive_accounts SET followers = followers + :mag WHERE id = :id
3.1% 56369ms 2.90avg 19470x -- SELECT post_id FROM hive_posts_cache WHERE is_paidout = '0' AND payout_at <= :date
2.3% 42217ms 0.34avg 123588x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
2.3% 41425ms 0.27avg 154478x -- UPDATE hive_accounts SET following = following + :mag WHERE id = :id
2.0% 35768ms 0.43avg 84047x -- SELECT tag FROM hive_post_tags WHERE post_id = :id
1.9% 34875ms 0.33avg 106636x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
1.3% 24265ms 0.36avg 66559x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
1.2% 21910ms 0.48avg 45797x -- INSERT INTO hive_feed_cache (account_id, post_id, created_at) VALUES (...) ON CONFLICT (account_id, post_id) DO NOTHING
1.2% 21668ms 0.60avg 35884x -- INSERT INTO hive_post_tags (post_id, tag) VALUES (...) ON CONFLICT DO NOTHING
0.5% 9589ms 0.49avg 19470x -- INSERT INTO hive_blocks (num, hash, prev, txs, ops, created_at) VALUES (...)
0.4% 8084ms 0.42avg 19449x -- SELECT id, author, permlink FROM hive_posts WHERE id IN :ids
0.4% 7085ms 0.34avg 20799x -- SELECT is_deleted FROM hive_posts WHERE id = :id
0.4% 6312ms 0.51avg 12265x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
0.3% 6174ms 0.31avg 19646x -- START TRANSACTION
0.2% 4229ms 0.22avg 19646x -- COMMIT
0.2% 4073ms 0.31avg 13302x -- SELECT depth FROM hive_posts WHERE id = :id
0.1% 908ms 0.42avg 2147x -- INSERT INTO hive_accounts (name, created_at) VALUES (...)
0.0% 867ms 0.46avg 1905x -- DELETE FROM hive_post_tags WHERE post_id = :id AND tag IN :tags
0.0% 743ms 0.40avg 1842x -- SELECT name, id FROM hive_accounts WHERE name IN :names
0.0% 597ms 37.37avg 16x -- SELECT name FROM hive_accounts ORDER BY cached_at LIMIT :limit
0.0% 471ms 0.48avg 973x -- UPDATE hive_state SET block_num = :block_num, steem_per_mvest = :spm, usd_per_steem = :ups, sbd_per_steem = :sps, dgpo = :dgpo
0.0% 460ms 0.55avg 839x -- UPDATE hive_posts_cache SET promoted = :promoted, payout = :payout, rshares = :rshares, votes = :votes, sc_trend = :sc_trend, sc_hot = :sc_hot, flag_weight = :flag_weight, total_vo
0.0% 419ms 0.40avg 1037x -- UPDATE hive_posts SET is_deleted = '1' WHERE id = :id
0.0% 416ms 0.50avg 839x -- INSERT INTO hive_payments (block_num, tx_idx, post_id, from_account, to_account, amount, token) VALUES (...)
0.0% 393ms 0.38avg 1037x -- DELETE FROM hive_posts_cache WHERE post_id = :id
0.0% 324ms 0.39avg 839x -- UPDATE hive_posts SET promoted = :val WHERE id = :id
0.0% 301ms 0.36avg 839x -- SELECT promoted FROM hive_posts WHERE id = :id
0.0% 121ms 0.36avg 337x -- DELETE FROM hive_feed_cache WHERE post_id = :id
0.0% 17ms 0.42avg 41x -- UPDATE hive_posts SET is_valid = :is_valid, is_deleted = '0', parent_id = :parent_id, category = :category, community = :community, depth = :depth WHERE id = :id
0.0% 15ms 0.39avg 41x -- INSERT INTO hive_posts_cache (post_id, author, permlink) VALUES (...)
from hivemind.
roadscape
commented on August 18, 2024
local init sync
init url:https://api.steemitdev.com batch:500 workers:1 appbase:True
[SYNC] Got block 2762000 @ 2016-06-29T13:45:45 (805/s, 1164rps, 2617wps) -- eta 359:07
[DEBUG] total STEEM time: 1800s
100.0% 1,799,836ms 0.78avg 2299000x -- get_block
0.0% 323ms 323.47avg 1x -- get_dynamic_global_properties
[STEEM] Fastest call was 323.475ms
[MEM] peak memory usage: 65.54MB
[SYNC] Got block 2998000 @ 2016-07-07T19:44:42 (805/s, 1360rps, 1971wps) -- eta 354:41
[SYNC] Got block 2999000 @ 2016-07-07T20:34:45 (719/s, 1081rps, 2146wps) -- eta 396:58
[SYNC] Got block 3000000 @ 2016-07-07T21:24:57 (866/s, 1567rps, 1935wps) -- eta 329:41
[SYNC] Got block 3999000 @ 2016-08-11T21:09:57 (313/s, 623rps, 629wps) -- eta 858:07
[DEBUG] post.id lookups: 1110000, hits: 587235 (52.9%), entries: 522765
[SYNC] Got block 4000000 @ 2016-08-11T22:00:06 (345/s, 769rps, 628wps) -- eta 777:05
[SYNC] Got block 4001000 @ 2016-08-11T22:50:12 (358/s, 788rps, 656wps) -- eta 750:20
[SYNC] Got block 4999000 @ 2016-09-15T18:54:48 (438/s, 927rps, 832wps) -- eta 574:50
[SYNC] Got block 5000000 @ 2016-09-15T19:47:21 (438/s, 1037rps, 760wps) -- eta 574:41
[SYNC] Got block 5001000 @ 2016-09-15T20:39:51 (352/s, 633rps, 793wps) -- eta 716:10
[SYNC] Got block 5754000 @ 2016-10-12T01:33:12 (482/s, 873rps, 1075wps) -- eta 497:07
[SYNC] Got block 5755000 @ 2016-10-12T02:23:15 (571/s, 1093rps, 1199wps) -- eta 419:00
^C
[STEEM] sampled STEEM time: 1801s
100.0% 1,800,720ms 1.10avg 1638000x -- get_block
0.0% 391ms 391.20avg 1x -- get_dynamic_global_properties
[STEEM] Fastest call was 391.196ms
[MEM] peak memory usage: 282.18MB
[DEBUG] sampled STEEM time: 88s
100.0% 88,460ms 1.04avg 85000x -- get_block
[STEEM] Fastest call was 391.196ms
[MEM] peak memory usage: 296.88MB
[DEBUG] sampled SQL time: 1632s
34.3% 560242ms 0.33avg 1723000x -- INSERT INTO hive_blocks (num, hash, prev, txs, ops, created_at) VALUES (...)
17.2% 280473ms 0.48avg 579496x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
11.4% 186361ms 0.31avg 592970x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
10.1% 164560ms 0.26avg 624364x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
7.6% 124716ms 0.24avg 517546x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
7.2% 117430ms 0.25avg 472175x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
5.4% 87420ms 0.27avg 329516x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
2.4% 38431ms 0.25avg 155654x -- SELECT is_deleted FROM hive_posts WHERE id = :id
1.6% 26140ms 0.26avg 100237x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
0.8% 13304ms 0.29avg 45311x -- INSERT INTO hive_accounts (name, created_at) VALUES (...)
0.7% 12127ms 0.27avg 44384x -- SELECT name, id FROM hive_accounts WHERE name IN :names
0.4% 6294ms 0.25avg 25280x -- SELECT depth FROM hive_posts WHERE id = :id
0.4% 6224ms 0.32avg 19736x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
0.1% 2164ms 0.34avg 6328x -- INSERT INTO hive_payments (block_num, tx_idx, post_id, from_account, to_account, amount, token) VALUES (...)
0.1% 1920ms 0.30avg 6328x -- UPDATE hive_posts SET promoted = :val WHERE id = :id
0.1% 1763ms 0.32avg 5542x -- UPDATE hive_posts SET is_deleted = '1' WHERE id = :id
0.1% 1614ms 0.26avg 6328x -- SELECT promoted FROM hive_posts WHERE id = :id
0.0% 547ms 0.32avg 1723x -- START TRANSACTION
0.0% 321ms 0.19avg 1723x -- COMMIT
0.0% 43ms 0.38avg 113x -- UPDATE hive_posts SET is_valid = :is_valid, is_deleted = '0', parent_id = :parent_id, category = :category, community = :community, depth = :depth WHERE id = :id
0.0% 22ms 22.92avg 1x -- SELECT name, id FROM hive_accounts
0.0% 1ms 0.60avg 2x -- SELECT num FROM hive_blocks ORDER BY num DESC LIMIT 1
0.0% 1ms 1.16avg 1x -- SELECT 1 FROM pg_catalog.pg_tables WHERE schemaname = 'public'
0.0% 0ms 0.40avg 1x -- SELECT db_version FROM hive_state LIMIT 1
0.0% 0ms 0.35avg 1x -- SELECT 1 FROM hive_feed_cache LIMIT 1
[SYNC] Got block 5999000 @ 2016-10-20T13:52:42 (471/s, 913rps, 972wps) -- eta 499:58
[SYNC] Got block 6000000 @ 2016-10-20T14:42:48 (505/s, 1095rps, 936wps) -- eta 466:19
[SYNC] Got block 6001000 @ 2016-10-20T15:32:51 (580/s, 1076rps, 1258wps) -- eta 405:58
[DEBUG] total STEEM time: 600s
100.0% 600,288ms 1.26avg 475000x -- get_block
0.0% 289ms 289.51avg 1x -- get_dynamic_global_properties
[STEEM] Fastest call was 289.508ms
[MEM] peak memory usage: 138.08MB
[DEBUG] total SQL time: 318s
46.0% 146303ms 0.31avg 475000x -- INSERT INTO hive_blocks (num, hash, prev, txs, ops, created_at) VALUES (...)
14.7% 46651ms 0.46avg 100568x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
9.7% 30726ms 0.30avg 103516x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
7.3% 23337ms 0.25avg 92252x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
6.0% 19088ms 0.24avg 79835x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
4.5% 14233ms 0.23avg 61174x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
4.3% 13618ms 0.26avg 53086x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
2.3% 7254ms 0.25avg 29244x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
2.1% 6653ms 0.23avg 28638x -- SELECT is_deleted FROM hive_posts WHERE id = :id
1.1% 3589ms 0.30avg 11986x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
1.0% 3037ms 0.23avg 12925x -- SELECT depth FROM hive_posts WHERE id = :id
0.3% 992ms 0.30avg 3309x -- INSERT INTO hive_accounts (name, created_at) VALUES (...)
0.3% 873ms 0.27avg 3276x -- SELECT name, id FROM hive_accounts WHERE name IN :names
0.1% 410ms 0.33avg 1261x -- INSERT INTO hive_payments (block_num, tx_idx, post_id, from_account, to_account, amount, token) VALUES (...)
0.1% 358ms 0.28avg 1261x -- UPDATE hive_posts SET promoted = :val WHERE id = :id
0.1% 297ms 0.32avg 939x -- UPDATE hive_posts SET is_deleted = '1' WHERE id = :id
0.1% 295ms 0.23avg 1261x -- SELECT promoted FROM hive_posts WHERE id = :id
0.1% 165ms 0.35avg 475x -- START TRANSACTION
0.0% 86ms 0.18avg 475x -- COMMIT
0.0% 47ms 47.68avg 1x -- SELECT name, id FROM hive_accounts
0.0% 3ms 0.37avg 9x -- UPDATE hive_posts SET is_valid = :is_valid, is_deleted = '0', parent_id = :parent_id, category = :category, community = :community, depth = :depth WHERE id = :id
0.0% 1ms 1.18avg 1x -- SELECT 1 FROM pg_catalog.pg_tables WHERE schemaname = 'public'
0.0% 0ms 0.50avg 2x -- SELECT num FROM hive_blocks ORDER BY num DESC LIMIT 1
0.0% 0ms 0.58avg 1x -- SELECT db_version FROM hive_state LIMIT 1
0.0% 0ms 0.36avg 1x -- SELECT 1 FROM hive_feed_cache LIMIT 1
[SYNC] Got block 6999000 @ 2016-11-24T08:18:36 (729/s, 1246rps, 1759wps) -- eta 299:57
[SYNC] Got block 7000000 @ 2016-11-24T09:08:39 (732/s, 1156rps, 2000wps) -- eta 298:43
[SYNC] Got block 7001000 @ 2016-11-24T09:58:39 (562/s, 812rps, 1829wps) -- eta 389:11
[SYNC] Got block 7999000 @ 2016-12-29T03:43:18 (529/s, 865rps, 1360wps) -- eta 382:12
[SYNC] Got block 8000000 @ 2016-12-29T04:33:21 (645/s, 1108rps, 1547wps) -- eta 313:08
[SYNC] Got block 8001000 @ 2016-12-29T05:23:21 (659/s, 1008rps, 1908wps) -- eta 306:29
[DEBUG] total STEEM time: 1800s
100.0% 1,800,315ms 0.96avg 1866000x -- get_block
0.0% 359ms 359.98avg 1x -- get_dynamic_global_properties
[STEEM] Fastest call was 359.984ms
[MEM] peak memory usage: 267.60MB
[SYNC] Got block 8999000 @ 2017-02-01T22:42:48 (452/s, 697rps, 1285wps) -- eta 410:17
[SYNC] Got block 9000000 @ 2017-02-01T23:32:48 (577/s, 1011rps, 1345wps) -- eta 321:20
[SYNC] Got block 9001000 @ 2017-02-02T00:22:51 (557/s, 945rps, 1359wps) -- eta 332:50
[SYNC] Got block 9318000 @ 2017-02-13T00:47:21 (593/s, 950rps, 1575wps) -- eta 303:58
[DEBUG] total SQL time: 1800s
42.9% 772204ms 0.25avg 3043703x -- INSERT INTO hive_blocks (num, hash, prev, txs, ops, created_at) VALUES (...)
17.5% 314280ms 0.45avg 692442x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
10.9% 196980ms 0.28avg 694618x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
7.3% 131776ms 0.23avg 565738x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
5.6% 101601ms 0.25avg 399983x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
5.3% 95915ms 0.25avg 382806x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
4.2% 75789ms 0.23avg 328878x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
1.9% 34011ms 0.23avg 149991x -- SELECT is_deleted FROM hive_posts WHERE id = :id
1.3% 22655ms 0.30avg 76624x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
1.0% 18539ms 0.23avg 81574x -- SELECT depth FROM hive_posts WHERE id = :id
0.8% 14876ms 0.25avg 59723x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
0.4% 7051ms 0.29avg 24397x -- INSERT INTO hive_accounts (name, created_at) VALUES (...)
0.4% 6534ms 0.27avg 24268x -- SELECT name, id FROM hive_accounts WHERE name IN :names
0.1% 1798ms 0.33avg 5432x -- INSERT INTO hive_payments (block_num, tx_idx, post_id, from_account, to_account, amount, token) VALUES (...)
0.1% 1559ms 0.29avg 5432x -- UPDATE hive_posts SET promoted = :val WHERE id = :id
0.1% 1530ms 0.31avg 4950x -- UPDATE hive_posts SET is_deleted = '1' WHERE id = :id
0.1% 1193ms 0.22avg 5432x -- SELECT promoted FROM hive_posts WHERE id = :id
0.1% 1080ms 0.35avg 3044x -- START TRANSACTION
0.0% 540ms 0.18avg 3043x -- COMMIT
0.0% 46ms 46.45avg 1x -- SELECT name, id FROM hive_accounts
0.0% 31ms 0.37avg 85x -- UPDATE hive_posts SET is_valid = :is_valid, is_deleted = '0', parent_id = :parent_id, category = :category, community = :community, depth = :depth WHERE id = :id
0.0% 1ms 0.63avg 2x -- SELECT num FROM hive_blocks ORDER BY num DESC LIMIT 1
0.0% 1ms 1.13avg 1x -- SELECT 1 FROM pg_catalog.pg_tables WHERE schemaname = 'public'
0.0% 0ms 0.38avg 1x -- SELECT 1 FROM hive_feed_cache LIMIT 1
0.0% 0ms 0.37avg 1x -- SELECT db_version FROM hive_state LIMIT 1
[SYNC] Got block 9846000 @ 2017-03-03T09:07:42 (608/s, 876rps, 1996wps) -- eta 281:36
[DEBUG] total STEEM time: 1800s
100.0% 1,800,037ms 1.06avg 1706000x -- get_block
[STEEM] Fastest call was 359.984ms
[MEM] peak memory usage: 396.30MB
[SYNC] Got block 9847000 @ 2017-03-03T09:57:51 (538/s, 822rps, 1562wps) -- eta 318:16
[DEBUG] post.id lookups: 1810000, hits: 968279 (53.5%), entries: 841720
[SYNC] Got block 9999000 @ 2017-03-08T16:44:24 (547/s, 939rps, 1312wps) -- eta 308:27
[SYNC] Got block 10000000 @ 2017-03-08T17:34:24 (467/s, 819rps, 1090wps) -- eta 361:08
[SYNC] Got block 10001000 @ 2017-03-08T18:24:27 (470/s, 750rps, 1260wps) -- eta 359:06
[SYNC] Got block 10477000 @ 2017-03-25T07:43:33 (633/s, 1213rps, 1324wps) -- eta 254:08
[DEBUG] post.id lookups: 2100000, hits: 1120681 (53.4%), entries: 979318
[SYNC] Got block 10999000 @ 2017-04-12T11:23:09 (558/s, 801rps, 1837wps) -- eta 272:44
[SYNC] Got block 11000000 @ 2017-04-12T12:13:12 (564/s, 990rps, 1313wps) -- eta 269:40
[SYNC] Got block 11001000 @ 2017-04-12T13:03:15 (625/s, 1114rps, 1423wps) -- eta 243:31
[SYNC] Got block 11396000 @ 2017-04-26T06:22:27 (605/s, 910rps, 1813wps) -- eta 240:20
[DEBUG] total STEEM time: 1800s
100.0% 1,800,488ms 1.16avg 1550000x -- get_block
[STEEM] Fastest call was 359.984ms
[MEM] peak memory usage: 525.37MB
[SYNC] Got block 11872000 @ 2017-05-12T19:25:21 (269/s, 934rps, 379wps) -- eta 510:19
[DEBUG] total SQL time: 1800s
37.6% 677328ms 0.27avg 2553779x -- INSERT INTO hive_blocks (num, hash, prev, txs, ops, created_at) VALUES (...)
18.9% 340313ms 0.47avg 729963x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
12.0% 216758ms 0.30avg 730712x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
7.9% 142399ms 0.24avg 585964x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
6.6% 118436ms 0.26avg 456621x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
5.6% 100664ms 0.26avg 385716x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
5.1% 91542ms 0.24avg 386897x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
1.9% 34165ms 0.24avg 140028x -- SELECT is_deleted FROM hive_posts WHERE id = :id
1.2% 22193ms 0.30avg 73866x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
1.0% 18731ms 0.24avg 78365x -- SELECT depth FROM hive_posts WHERE id = :id
0.9% 16188ms 0.25avg 64586x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
0.4% 7403ms 0.29avg 25101x -- INSERT INTO hive_accounts (name, created_at) VALUES (...)
0.4% 6853ms 0.28avg 24767x -- SELECT name, id FROM hive_accounts WHERE name IN :names
0.1% 1586ms 0.34avg 4684x -- INSERT INTO hive_payments (block_num, tx_idx, post_id, from_account, to_account, amount, token) VALUES (...)
0.1% 1552ms 0.35avg 4498x -- UPDATE hive_posts SET is_deleted = '1' WHERE id = :id
0.1% 1382ms 0.30avg 4684x -- UPDATE hive_posts SET promoted = :val WHERE id = :id
0.1% 1118ms 0.24avg 4684x -- SELECT promoted FROM hive_posts WHERE id = :id
0.0% 897ms 0.35avg 2554x -- START TRANSACTION
0.0% 456ms 0.18avg 2554x -- COMMIT
0.0% 25ms 0.36avg 69x -- UPDATE hive_posts SET is_valid = :is_valid, is_deleted = '0', parent_id = :parent_id, category = :category, community = :community, depth = :depth WHERE id = :id
[SYNC] Got block 11999000 @ 2017-05-17T05:17:36 (294/s, 661rps, 530wps) -- eta 460:36
[DEBUG] post.id lookups: 3250000, hits: 1721629 (53.0%), entries: 1000001
[SYNC] Got block 12000000 @ 2017-05-17T06:07:36 (292/s, 628rps, 546wps) -- eta 463:47
[SYNC] Got block 12001000 @ 2017-05-17T06:57:36 (266/s, 644rps, 454wps) -- eta 508:35
[SYNC] Got block 12621000 @ 2017-06-07T20:07:00 (138/s, 470rps, 196wps) -- eta 903:39
[SQL][138ms] SELECT * FROM hive_communities WHERE name = :name LIMIT 1
[DEBUG] total SQL time: 1800s
22.0% 396599ms 0.46avg 864306x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
16.4% 294802ms 0.25avg 1170414x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
13.8% 248774ms 0.29avg 867020x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
12.8% 230078ms 0.23avg 984459x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
10.8% 194319ms 0.26avg 749369x -- INSERT INTO hive_blocks (num, hash, prev, txs, ops, created_at) VALUES (...)
9.4% 169487ms 0.24avg 713523x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
7.0% 125272ms 0.26avg 482117x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
2.2% 39829ms 0.25avg 160107x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
1.7% 31333ms 0.23avg 133907x -- SELECT is_deleted FROM hive_posts WHERE id = :id
1.6% 28892ms 0.31avg 94526x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
1.2% 22008ms 0.23avg 97486x -- SELECT depth FROM hive_posts WHERE id = :id
0.5% 8158ms 0.31avg 26039x -- INSERT INTO hive_accounts (name, created_at) VALUES (...)
0.4% 6506ms 0.28avg 23636x -- SELECT name, id FROM hive_accounts WHERE name IN :names
0.1% 1000ms 0.33avg 3071x -- INSERT INTO hive_payments (block_num, tx_idx, post_id, from_account, to_account, amount, token) VALUES (...)
0.1% 925ms 0.31avg 2961x -- UPDATE hive_posts SET is_deleted = '1' WHERE id = :id
0.0% 878ms 0.29avg 3071x -- UPDATE hive_posts SET promoted = :val WHERE id = :id
0.0% 684ms 0.22avg 3071x -- SELECT promoted FROM hive_posts WHERE id = :id
0.0% 285ms 0.38avg 749x -- START TRANSACTION
0.0% 135ms 0.18avg 749x -- COMMIT
0.0% 26ms 0.37avg 70x -- UPDATE hive_posts SET is_valid = :is_valid, is_deleted = '0', parent_id = :parent_id, category = :category, community = :community, depth = :depth WHERE id = :id
[SYNC] Got block 12995000 @ 2017-06-20T20:07:36 (66/s, 276rps, 86wps) -- eta 1798:27
[DEBUG] post.id lookups: 6770000, hits: 3557689 (52.6%), entries: 1000001
[DEBUG] total SQL time: 1800s
23.5% 423346ms 0.46avg 917701x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
17.1% 306905ms 0.25avg 1223371x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
14.7% 265112ms 0.29avg 920960x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
13.4% 241800ms 0.23avg 1035842x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
10.5% 188471ms 0.24avg 783896x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
7.7% 138496ms 0.26avg 540509x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
5.3% 96277ms 0.26avg 373553x -- INSERT INTO hive_blocks (num, hash, prev, txs, ops, created_at) VALUES (...)
2.4% 43246ms 0.25avg 173338x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
1.7% 29786ms 0.24avg 125741x -- SELECT is_deleted FROM hive_posts WHERE id = :id
1.6% 28021ms 0.30avg 92488x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
1.2% 21228ms 0.22avg 95469x -- SELECT depth FROM hive_posts WHERE id = :id
0.4% 7490ms 0.29avg 25636x -- INSERT INTO hive_accounts (name, created_at) VALUES (...)
0.3% 6188ms 0.27avg 23297x -- SELECT name, id FROM hive_accounts WHERE name IN :names
0.1% 1021ms 0.37avg 2773x -- INSERT INTO hive_payments (block_num, tx_idx, post_id, from_account, to_account, amount, token) VALUES (...)
0.1% 951ms 0.32avg 2981x -- UPDATE hive_posts SET is_deleted = '1' WHERE id = :id
0.0% 798ms 0.29avg 2773x -- UPDATE hive_posts SET promoted = :val WHERE id = :id
0.0% 619ms 0.22avg 2773x -- SELECT promoted FROM hive_posts WHERE id = :id
0.0% 143ms 0.38avg 374x -- START TRANSACTION
0.0% 68ms 0.18avg 374x -- COMMIT
0.0% 25ms 0.38avg 67x -- UPDATE hive_posts SET is_valid = :is_valid, is_deleted = '0', parent_id = :parent_id, category = :category, community = :community, depth = :depth WHERE id = :id
[SYNC] Got block 12999000 @ 2017-06-20T23:29:21 (68/s, 307rps, 88wps) -- eta 1730:25
[DEBUG] post.id lookups: 6820000, hits: 3583457 (52.5%), entries: 1000001
[SYNC] Got block 13000000 @ 2017-06-21T00:19:42 (71/s, 301rps, 94wps) -- eta 1651:34
[SYNC] Got block 13001000 @ 2017-06-21T01:09:57 (79/s, 349rps, 103wps) -- eta 1492:44
[SYNC] Got block 13197000 @ 2017-06-27T20:39:45 (59/s, 296rps, 74wps) -- eta 1934:56
[DEBUG] total SQL time: 1800s
21.7% 391149ms 0.45avg 863889x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
21.3% 383269ms 0.24avg 1586513x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
17.1% 306976ms 0.23avg 1350799x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
13.4% 241819ms 0.28avg 868381x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
9.4% 168472ms 0.23avg 725156x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
7.0% 126865ms 0.25avg 513993x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
2.8% 49919ms 0.25avg 202032x -- INSERT INTO hive_blocks (num, hash, prev, txs, ops, created_at) VALUES (...)
2.7% 48154ms 0.25avg 195332x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
1.5% 27105ms 0.23avg 119429x -- SELECT is_deleted FROM hive_posts WHERE id = :id
1.3% 24164ms 0.30avg 80842x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
1.0% 18837ms 0.22avg 84336x -- SELECT depth FROM hive_posts WHERE id = :id
0.3% 5509ms 0.29avg 19235x -- INSERT INTO hive_accounts (name, created_at) VALUES (...)
0.2% 4496ms 0.26avg 17546x -- SELECT name, id FROM hive_accounts WHERE name IN :names
0.1% 1067ms 0.31avg 3494x -- UPDATE hive_posts SET is_deleted = '1' WHERE id = :id
0.0% 798ms 0.32avg 2496x -- INSERT INTO hive_payments (block_num, tx_idx, post_id, from_account, to_account, amount, token) VALUES (...)
0.0% 708ms 0.28avg 2496x -- UPDATE hive_posts SET promoted = :val WHERE id = :id
0.0% 544ms 0.22avg 2496x -- SELECT promoted FROM hive_posts WHERE id = :id
0.0% 78ms 0.39avg 202x -- START TRANSACTION
0.0% 35ms 0.18avg 202x -- COMMIT
0.0% 28ms 0.37avg 76x -- UPDATE hive_posts SET is_valid = :is_valid, is_deleted = '0', parent_id = :parent_id, category = :category, community = :community, depth = :depth WHERE id = :id
[SYNC] Got block 13276000 @ 2017-06-30T14:44:00 (70/s, 316rps, 90wps) -- eta 1618:08
[DEBUG] total STEEM time: 1801s
100.0% 1,801,466ms 2.66avg 677000x -- get_block
[STEEM] Fastest call was 359.984ms
[MEM] peak memory usage: 747.07MB
[DEBUG] post.id lookups: 9270000, hits: 4847805 (52.3%), entries: 1000001
[SYNC] Got block 13406000 @ 2017-07-05T03:07:45 (91/s, 451rps, 115wps) -- eta 1221:05
[SQL][197ms] INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
[DEBUG] total SQL time: 1800s
21.5% 387713ms 0.24avg 1603054x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
21.5% 387135ms 0.46avg 850665x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
15.9% 286328ms 0.23avg 1256327x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
13.3% 238864ms 0.28avg 856901x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
9.2% 166012ms 0.23avg 715798x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
7.1% 128151ms 0.25avg 518223x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
4.1% 73840ms 0.25avg 299364x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
2.9% 52212ms 0.25avg 209096x -- INSERT INTO hive_blocks (num, hash, prev, txs, ops, created_at) VALUES (...)
1.4% 25946ms 0.23avg 113350x -- SELECT is_deleted FROM hive_posts WHERE id = :id
1.3% 24215ms 0.30avg 81443x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
1.0% 18529ms 0.22avg 84839x -- SELECT depth FROM hive_posts WHERE id = :id
0.2% 4318ms 0.28avg 15528x -- INSERT INTO hive_accounts (name, created_at) VALUES (...)
0.2% 3719ms 0.25avg 14606x -- SELECT name, id FROM hive_accounts WHERE name IN :names
0.1% 1033ms 0.30avg 3396x -- UPDATE hive_posts SET is_deleted = '1' WHERE id = :id
0.0% 710ms 0.32avg 2225x -- INSERT INTO hive_payments (block_num, tx_idx, post_id, from_account, to_account, amount, token) VALUES (...)
0.0% 639ms 0.29avg 2225x -- UPDATE hive_posts SET promoted = :val WHERE id = :id
0.0% 488ms 0.22avg 2225x -- SELECT promoted FROM hive_posts WHERE id = :id
0.0% 74ms 0.35avg 209x -- START TRANSACTION
0.0% 37ms 0.18avg 209x -- COMMIT
0.0% 27ms 0.37avg 75x -- UPDATE hive_posts SET is_valid = :is_valid, is_deleted = '0', parent_id = :parent_id, category = :category, community = :community, depth = :depth WHERE id = :id
[SYNC] Got block 13641000 @ 2017-07-13T07:30:42 (91/s, 314rps, 128wps) -- eta 1188:41
[DEBUG] total SQL time: 1800s
21.5% 387228ms 0.45avg 852336x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
21.1% 379877ms 0.24avg 1563353x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
15.7% 282497ms 0.23avg 1235781x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
13.3% 239073ms 0.28avg 861700x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
9.2% 165314ms 0.23avg 715357x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
7.4% 132803ms 0.25avg 534409x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
4.1% 74547ms 0.25avg 303474x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
3.3% 58601ms 0.25avg 234742x -- INSERT INTO hive_blocks (num, hash, prev, txs, ops, created_at) VALUES (...)
1.4% 25152ms 0.23avg 110589x -- SELECT is_deleted FROM hive_posts WHERE id = :id
1.4% 24592ms 0.30avg 82995x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
1.1% 19611ms 0.22avg 87341x -- SELECT depth FROM hive_posts WHERE id = :id
0.2% 3685ms 0.28avg 13191x -- INSERT INTO hive_accounts (name, created_at) VALUES (...)
0.2% 3327ms 0.27avg 12140x -- SELECT name, id FROM hive_accounts WHERE name IN :names
0.1% 1312ms 0.30avg 4346x -- UPDATE hive_posts SET is_deleted = '1' WHERE id = :id
0.0% 839ms 0.32avg 2636x -- INSERT INTO hive_payments (block_num, tx_idx, post_id, from_account, to_account, amount, token) VALUES (...)
0.0% 748ms 0.28avg 2636x -- UPDATE hive_posts SET promoted = :val WHERE id = :id
0.0% 574ms 0.22avg 2636x -- SELECT promoted FROM hive_posts WHERE id = :id
0.0% 94ms 0.40avg 235x -- START TRANSACTION
0.0% 75ms 0.37avg 204x -- UPDATE hive_posts SET is_valid = :is_valid, is_deleted = '0', parent_id = :parent_id, category = :category, community = :community, depth = :depth WHERE id = :id
0.0% 42ms 0.18avg 235x -- COMMIT
[SYNC] Got block 13906000 @ 2017-07-22T12:33:18 (61/s, 201rps, 89wps) -- eta 1680:48
[DEBUG] total SQL time: 1800s
22.4% 403693ms 0.46avg 876855x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
19.8% 356609ms 0.25avg 1452387x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
15.7% 281941ms 0.23avg 1217017x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
13.9% 250740ms 0.28avg 886104x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
9.6% 173309ms 0.24avg 732680x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
7.7% 138139ms 0.25avg 553272x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
3.8% 68386ms 0.26avg 265071x -- INSERT INTO hive_blocks (num, hash, prev, txs, ops, created_at) VALUES (...)
2.4% 42303ms 0.25avg 169129x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
1.4% 25911ms 0.23avg 111081x -- SELECT is_deleted FROM hive_posts WHERE id = :id
1.4% 24734ms 0.30avg 82616x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
1.1% 19769ms 0.23avg 86833x -- SELECT depth FROM hive_posts WHERE id = :id
0.3% 5186ms 0.28avg 18349x -- INSERT INTO hive_accounts (name, created_at) VALUES (...)
0.2% 4394ms 0.26avg 16896x -- SELECT name, id FROM hive_accounts WHERE name IN :names
0.1% 1343ms 0.32avg 4217x -- UPDATE hive_posts SET is_deleted = '1' WHERE id = :id
0.1% 1278ms 0.32avg 3974x -- INSERT INTO hive_payments (block_num, tx_idx, post_id, from_account, to_account, amount, token) VALUES (...)
0.1% 1153ms 0.29avg 3974x -- UPDATE hive_posts SET promoted = :val WHERE id = :id
0.0% 882ms 0.22avg 3974x -- SELECT promoted FROM hive_posts WHERE id = :id
0.0% 98ms 0.37avg 265x -- START TRANSACTION
0.0% 74ms 0.38avg 199x -- UPDATE hive_posts SET is_valid = :is_valid, is_deleted = '0', parent_id = :parent_id, category = :category, community = :community, depth = :depth WHERE id = :id
0.0% 47ms 0.18avg 265x -- COMMIT
[SYNC] Got block 13999000 @ 2017-07-25T18:08:15 (54/s, 154rps, 84wps) -- eta 1873:25
[SYNC] Got block 14000000 @ 2017-07-25T18:58:15 (58/s, 184rps, 85wps) -- eta 1745:07
[DEBUG] post.id lookups: 14650000, hits: 7604113 (51.9%), entries: 1000001
[SYNC] Got block 14001000 @ 2017-07-25T19:48:18 (50/s, 242rps, 64wps) -- eta 2005:52
[SYNC] Got block 14150000 @ 2017-07-31T00:00:42 (96/s, 405rps, 126wps) -- eta 1033:02
[DEBUG] post.id lookups: 15680000, hits: 8125970 (51.8%), entries: 1000001
[SQL][174ms] INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
[DEBUG] total SQL time: 1800s
21.7% 391317ms 0.46avg 853516x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
20.7% 372626ms 0.25avg 1520244x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
16.3% 293244ms 0.23avg 1284312x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
13.6% 244190ms 0.28avg 869667x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
9.2% 165907ms 0.23avg 708979x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
7.5% 134792ms 0.25avg 540093x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
3.5% 62376ms 0.25avg 244627x -- INSERT INTO hive_blocks (num, hash, prev, txs, ops, created_at) VALUES (...)
2.8% 51059ms 0.25avg 205855x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
1.5% 26162ms 0.23avg 113573x -- SELECT is_deleted FROM hive_posts WHERE id = :id
1.4% 25258ms 0.30avg 84763x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
1.1% 19928ms 0.22avg 89095x -- SELECT depth FROM hive_posts WHERE id = :id
0.2% 3975ms 0.28avg 14147x -- INSERT INTO hive_accounts (name, created_at) VALUES (...)
0.2% 3366ms 0.26avg 13044x -- SELECT name, id FROM hive_accounts WHERE name IN :names
0.1% 1649ms 0.32avg 5179x -- INSERT INTO hive_payments (block_num, tx_idx, post_id, from_account, to_account, amount, token) VALUES (...)
0.1% 1485ms 0.29avg 5179x -- UPDATE hive_posts SET promoted = :val WHERE id = :id
0.1% 1321ms 0.30avg 4332x -- UPDATE hive_posts SET is_deleted = '1' WHERE id = :id
0.1% 1138ms 0.22avg 5179x -- SELECT promoted FROM hive_posts WHERE id = :id
0.0% 87ms 0.36avg 244x -- START TRANSACTION
0.0% 68ms 0.37avg 185x -- UPDATE hive_posts SET is_valid = :is_valid, is_deleted = '0', parent_id = :parent_id, category = :category, community = :community, depth = :depth WHERE id = :id
0.0% 43ms 0.18avg 244x -- COMMIT
[SYNC] Got block 14406000 @ 2017-08-08T21:42:09 (47/s, 205rps, 62wps) -- eta 2001:07
[DEBUG] post.id lookups: 17430000, hits: 9006189 (51.7%), entries: 1000001
[DEBUG] total SQL time: 1800s
21.5% 386630ms 0.46avg 842679x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
20.7% 372920ms 0.24avg 1526431x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
16.2% 291437ms 0.23avg 1254528x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
13.6% 244602ms 0.28avg 868336x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
9.1% 163828ms 0.23avg 701044x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
7.4% 133206ms 0.25avg 530807x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
3.6% 65055ms 0.25avg 255545x -- INSERT INTO hive_blocks (num, hash, prev, txs, ops, created_at) VALUES (...)
3.2% 58006ms 0.25avg 232498x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
1.4% 25396ms 0.31avg 83176x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
1.4% 24889ms 0.23avg 108816x -- SELECT is_deleted FROM hive_posts WHERE id = :id
1.1% 19631ms 0.22avg 87296x -- SELECT depth FROM hive_posts WHERE id = :id
0.2% 3862ms 0.28avg 13700x -- INSERT INTO hive_accounts (name, created_at) VALUES (...)
0.2% 3327ms 0.26avg 12869x -- SELECT name, id FROM hive_accounts WHERE name IN :names
0.1% 2203ms 0.32avg 6912x -- INSERT INTO hive_payments (block_num, tx_idx, post_id, from_account, to_account, amount, token) VALUES (...)
0.1% 2001ms 0.29avg 6912x -- UPDATE hive_posts SET promoted = :val WHERE id = :id
0.1% 1517ms 0.22avg 6912x -- SELECT promoted FROM hive_posts WHERE id = :id
0.1% 1262ms 0.31avg 4120x -- UPDATE hive_posts SET is_deleted = '1' WHERE id = :id
0.0% 94ms 0.37avg 256x -- START TRANSACTION
0.0% 78ms 0.37avg 214x -- UPDATE hive_posts SET is_valid = :is_valid, is_deleted = '0', parent_id = :parent_id, category = :category, community = :community, depth = :depth WHERE id = :id
0.0% 45ms 0.18avg 256x -- COMMIT
[SYNC] Got block 14650000 @ 2017-08-17T09:43:42 (86/s, 284rps, 124wps) -- eta 1057:37
[SQL][235ms] INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
[DEBUG] total SQL time: 1800s
24.1% 434327ms 0.24avg 1789495x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
19.3% 346932ms 0.46avg 747466x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
17.7% 319009ms 0.23avg 1390209x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
11.9% 214953ms 0.28avg 756255x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
7.9% 142001ms 0.23avg 613096x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
6.5% 116177ms 0.25avg 462782x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
4.8% 87222ms 0.25avg 351527x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
3.4% 60698ms 0.25avg 243547x -- INSERT INTO hive_blocks (num, hash, prev, txs, ops, created_at) VALUES (...)
1.3% 22838ms 0.30avg 76803x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
1.3% 22617ms 0.22avg 100781x -- SELECT is_deleted FROM hive_posts WHERE id = :id
1.0% 18047ms 0.22avg 80552x -- SELECT depth FROM hive_posts WHERE id = :id
0.2% 3804ms 0.30avg 12693x -- INSERT INTO hive_accounts (name, created_at) VALUES (...)
0.2% 3058ms 0.26avg 11929x -- SELECT name, id FROM hive_accounts WHERE name IN :names
0.1% 2691ms 0.32avg 8476x -- INSERT INTO hive_payments (block_num, tx_idx, post_id, from_account, to_account, amount, token) VALUES (...)
0.1% 2409ms 0.28avg 8476x -- UPDATE hive_posts SET promoted = :val WHERE id = :id
0.1% 2102ms 0.25avg 8476x -- SELECT promoted FROM hive_posts WHERE id = :id
0.1% 1135ms 0.30avg 3748x -- UPDATE hive_posts SET is_deleted = '1' WHERE id = :id
0.0% 84ms 0.35avg 244x -- START TRANSACTION
0.0% 61ms 0.37avg 164x -- UPDATE hive_posts SET is_valid = :is_valid, is_deleted = '0', parent_id = :parent_id, category = :category, community = :community, depth = :depth WHERE id = :id
0.0% 43ms 0.18avg 244x -- COMMIT
[SYNC] Got block 14913000 @ 2017-08-26T13:03:18 (73/s, 324rps, 94wps) -- eta 1187:06
[DEBUG] post.id lookups: 20550000, hits: 10599492 (51.6%), entries: 1000001
[DEBUG] total SQL time: 1800s
23.3% 419578ms 0.25avg 1701034x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
19.8% 355988ms 0.47avg 762753x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
19.0% 342128ms 0.23avg 1473776x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
12.4% 222378ms 0.29avg 770493x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
8.1% 144998ms 0.24avg 615923x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
6.6% 118782ms 0.25avg 473217x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
3.7% 67007ms 0.25avg 263933x -- INSERT INTO hive_blocks (num, hash, prev, txs, ops, created_at) VALUES (...)
2.7% 48238ms 0.25avg 191811x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
1.4% 24476ms 0.23avg 104428x -- SELECT is_deleted FROM hive_posts WHERE id = :id
1.3% 23776ms 0.30avg 79311x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
1.0% 18415ms 0.22avg 83533x -- SELECT depth FROM hive_posts WHERE id = :id
0.3% 5330ms 0.28avg 18789x -- INSERT INTO hive_accounts (name, created_at) VALUES (...)
0.3% 4702ms 0.27avg 17261x -- SELECT name, id FROM hive_accounts WHERE name IN :names
0.1% 1285ms 0.30avg 4222x -- UPDATE hive_posts SET is_deleted = '1' WHERE id = :id
0.1% 1037ms 0.32avg 3236x -- INSERT INTO hive_payments (block_num, tx_idx, post_id, from_account, to_account, amount, token) VALUES (...)
0.1% 940ms 0.29avg 3236x -- UPDATE hive_posts SET promoted = :val WHERE id = :id
0.0% 711ms 0.22avg 3236x -- SELECT promoted FROM hive_posts WHERE id = :id
0.0% 88ms 0.34avg 263x -- START TRANSACTION
0.0% 87ms 0.37avg 235x -- UPDATE hive_posts SET is_valid = :is_valid, is_deleted = '0', parent_id = :parent_id, category = :category, community = :community, depth = :depth WHERE id = :id
0.0% 47ms 0.18avg 263x -- COMMIT
[SYNC] Got block 14986000 @ 2017-08-29T01:54:21 (83/s, 338rps, 111wps) -- eta 1022:19
[DEBUG] total STEEM time: 1801s
100.0% 1,801,940ms 3.29avg 547000x -- get_block
[STEEM] Fastest call was 359.984ms
[MEM] peak memory usage: 802.31MB
[DEBUG] post.id lookups: 21000000, hits: 10830210 (51.6%), entries: 1000001
[SYNC] Got block 14999000 @ 2017-08-29T12:44:42 (75/s, 344rps, 96wps) -- eta 1134:05
[SQL][251ms] SELECT is_deleted FROM hive_posts WHERE id = :id
[DEBUG] post.id lookups: 21080000, hits: 10871029 (51.6%), entries: 1000001
[SYNC] Got block 15000000 @ 2017-08-29T13:34:42 (82/s, 330rps, 109wps) -- eta 1041:38
[DEBUG] post.id lookups: 21090000, hits: 10876098 (51.6%), entries: 1000001
[SYNC] Got block 15001000 @ 2017-08-29T14:24:45 (70/s, 225rps, 101wps) -- eta 1218:20
[SYNC] Got block 15166000 @ 2017-09-04T08:01:57 (68/s, 309rps, 88wps) -- eta 1202:12
[SQL][247ms] INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
[DEBUG] total SQL time: 1800s
22.8% 410967ms 0.24avg 1679270x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
20.2% 363838ms 0.47avg 781352x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
19.0% 342148ms 0.23avg 1471406x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
12.6% 227524ms 0.29avg 788830x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
8.2% 148295ms 0.23avg 634411x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
6.8% 122276ms 0.25avg 488470x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
3.5% 63316ms 0.25avg 252622x -- INSERT INTO hive_blocks (num, hash, prev, txs, ops, created_at) VALUES (...)
2.1% 38435ms 0.25avg 153205x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
1.4% 25280ms 0.30avg 84354x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
1.4% 24637ms 0.23avg 106529x -- SELECT is_deleted FROM hive_posts WHERE id = :id
1.1% 19606ms 0.22avg 88725x -- SELECT depth FROM hive_posts WHERE id = :id
0.3% 5018ms 0.30avg 16717x -- INSERT INTO hive_accounts (name, created_at) VALUES (...)
0.2% 4010ms 0.26avg 15504x -- SELECT name, id FROM hive_accounts WHERE name IN :names
0.1% 1334ms 0.31avg 4361x -- UPDATE hive_posts SET is_deleted = '1' WHERE id = :id
0.1% 1087ms 0.32avg 3359x -- INSERT INTO hive_payments (block_num, tx_idx, post_id, from_account, to_account, amount, token) VALUES (...)
0.1% 1000ms 0.30avg 3359x -- SELECT promoted FROM hive_posts WHERE id = :id
0.1% 993ms 0.30avg 3359x -- UPDATE hive_posts SET promoted = :val WHERE id = :id
0.0% 95ms 0.37avg 257x -- UPDATE hive_posts SET is_valid = :is_valid, is_deleted = '0', parent_id = :parent_id, category = :category, community = :community, depth = :depth WHERE id = :id
0.0% 84ms 0.34avg 253x -- START TRANSACTION
0.0% 44ms 0.18avg 253x -- COMMIT
[SYNC] Got block 15395000 @ 2017-09-12T06:57:09 (45/s, 299rps, 53wps) -- eta 1748:03
[DEBUG] total SQL time: 1800s
25.4% 458004ms 0.24avg 1872120x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
18.9% 339823ms 0.23avg 1460148x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
18.5% 332515ms 0.47avg 711144x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
11.5% 207435ms 0.29avg 718538x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
7.5% 135163ms 0.23avg 575885x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
6.1% 109566ms 0.25avg 441881x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
4.6% 83300ms 0.26avg 319561x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
3.2% 57357ms 0.25avg 228887x -- INSERT INTO hive_blocks (num, hash, prev, txs, ops, created_at) VALUES (...)
1.4% 24655ms 0.30avg 82151x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
1.2% 21767ms 0.23avg 96454x -- SELECT is_deleted FROM hive_posts WHERE id = :id
1.1% 19080ms 0.22avg 85897x -- SELECT depth FROM hive_posts WHERE id = :id
0.2% 3970ms 0.28avg 14141x -- INSERT INTO hive_accounts (name, created_at) VALUES (...)
0.2% 3403ms 0.26avg 13290x -- SELECT name, id FROM hive_accounts WHERE name IN :names
0.1% 1139ms 0.30avg 3746x -- UPDATE hive_posts SET is_deleted = '1' WHERE id = :id
0.1% 1008ms 0.32avg 3126x -- INSERT INTO hive_payments (block_num, tx_idx, post_id, from_account, to_account, amount, token) VALUES (...)
0.1% 935ms 0.30avg 3126x -- UPDATE hive_posts SET promoted = :val WHERE id = :id
0.0% 688ms 0.22avg 3126x -- SELECT promoted FROM hive_posts WHERE id = :id
0.0% 81ms 0.36avg 229x -- START TRANSACTION
0.0% 61ms 0.37avg 167x -- UPDATE hive_posts SET is_valid = :is_valid, is_deleted = '0', parent_id = :parent_id, category = :category, community = :community, depth = :depth WHERE id = :id
0.0% 40ms 0.18avg 229x -- COMMIT
[SYNC] Got block 15638000 @ 2017-09-20T17:32:30 (77/s, 285rps, 106wps) -- eta 969:13
[DEBUG] total SQL time: 1800s
25.1% 452660ms 0.24avg 1852503x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
18.7% 337014ms 0.47avg 718069x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
17.1% 308314ms 0.23avg 1316709x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
11.6% 209568ms 0.29avg 724904x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
7.5% 135301ms 0.23avg 580721x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
6.2% 111884ms 0.25avg 453048x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
5.6% 100478ms 0.25avg 398329x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
3.4% 61233ms 0.25avg 243094x -- INSERT INTO hive_blocks (num, hash, prev, txs, ops, created_at) VALUES (...)
1.7% 29834ms 0.31avg 97092x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
1.2% 22295ms 0.22avg 101010x -- SELECT depth FROM hive_posts WHERE id = :id
1.2% 21930ms 0.23avg 96943x -- SELECT is_deleted FROM hive_posts WHERE id = :id
0.2% 3240ms 0.28avg 11502x -- INSERT INTO hive_accounts (name, created_at) VALUES (...)
0.2% 2784ms 0.26avg 10834x -- SELECT name, id FROM hive_accounts WHERE name IN :names
0.1% 1191ms 0.30avg 3918x -- UPDATE hive_posts SET is_deleted = '1' WHERE id = :id
0.0% 793ms 0.32avg 2447x -- INSERT INTO hive_payments (block_num, tx_idx, post_id, from_account, to_account, amount, token) VALUES (...)
0.0% 722ms 0.30avg 2447x -- UPDATE hive_posts SET promoted = :val WHERE id = :id
0.0% 539ms 0.22avg 2447x -- SELECT promoted FROM hive_posts WHERE id = :id
0.0% 91ms 0.38avg 243x -- START TRANSACTION
0.0% 76ms 0.37avg 203x -- UPDATE hive_posts SET is_valid = :is_valid, is_deleted = '0', parent_id = :parent_id, category = :category, community = :community, depth = :depth WHERE id = :id
0.0% 42ms 0.18avg 243x -- COMMIT
[SYNC] Got block 15910000 @ 2017-09-30T04:16:15 (97/s, 301rps, 143wps) -- eta 725:17
[SQL][246ms] SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
[DEBUG] post.id lookups: 26780000, hits: 13797089 (51.5%), entries: 1000001
[DEBUG] total SQL time: 1800s
22.1% 398390ms 0.25avg 1594258x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
20.4% 367929ms 0.47avg 790700x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
15.9% 286445ms 0.24avg 1216342x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
13.1% 235138ms 0.29avg 799974x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
8.3% 149138ms 0.23avg 636257x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
6.9% 124531ms 0.25avg 499837x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
4.4% 78340ms 0.27avg 295580x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
3.9% 69624ms 0.26avg 271658x -- INSERT INTO hive_blocks (num, hash, prev, txs, ops, created_at) VALUES (...)
1.8% 31745ms 0.30avg 106040x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
1.4% 24598ms 0.22avg 110185x -- SELECT depth FROM hive_posts WHERE id = :id
1.3% 23840ms 0.23avg 104132x -- SELECT is_deleted FROM hive_posts WHERE id = :id
0.2% 3622ms 0.28avg 12730x -- INSERT INTO hive_accounts (name, created_at) VALUES (...)
0.2% 3116ms 0.26avg 12136x -- SELECT name, id FROM hive_accounts WHERE name IN :names
0.1% 1310ms 0.32avg 4145x -- UPDATE hive_posts SET is_deleted = '1' WHERE id = :id
0.0% 764ms 0.33avg 2325x -- INSERT INTO hive_payments (block_num, tx_idx, post_id, from_account, to_account, amount, token) VALUES (...)
0.0% 723ms 0.31avg 2325x -- UPDATE hive_posts SET promoted = :val WHERE id = :id
0.0% 515ms 0.22avg 2325x -- SELECT promoted FROM hive_posts WHERE id = :id
0.0% 91ms 0.34avg 272x -- START TRANSACTION
0.0% 83ms 0.39avg 213x -- UPDATE hive_posts SET is_valid = :is_valid, is_deleted = '0', parent_id = :parent_id, category = :category, community = :community, depth = :depth WHERE id = :id
0.0% 48ms 0.18avg 272x -- COMMIT
[SYNC] Got block 15999000 @ 2017-10-03T06:33:24 (77/s, 281rps, 106wps) -- eta 891:40
[DEBUG] post.id lookups: 27330000, hits: 14079132 (51.5%), entries: 1000001
[SYNC] Got block 16000000 @ 2017-10-03T07:23:27 (69/s, 242rps, 96wps) -- eta 994:33
[SYNC] Got block 16001000 @ 2017-10-03T08:13:27 (75/s, 388rps, 93wps) -- eta 916:37
[SYNC] Got block 16071000 @ 2017-10-05T18:34:33 (71/s, 207rps, 108wps) -- eta 947:58
[DEBUG] total STEEM time: 1802s
100.0% 1,802,338ms 3.28avg 549000x -- get_block
[STEEM] Fastest call was 359.984ms
[MEM] peak memory usage: 821.21MB
[SYNC] Got block 16203000 @ 2017-10-10T08:36:42 (71/s, 312rps, 92wps) -- eta 916:43
[DEBUG] total SQL time: 1800s
21.6% 389271ms 0.47avg 827414x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
21.3% 383995ms 0.25avg 1537750x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
14.8% 267176ms 0.24avg 1121959x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
13.6% 244583ms 0.29avg 835550x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
8.6% 155444ms 0.23avg 661655x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
7.4% 132510ms 0.25avg 525128x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
4.1% 73305ms 0.25avg 293415x -- INSERT INTO hive_blocks (num, hash, prev, txs, ops, created_at) VALUES (...)
3.5% 62919ms 0.25avg 247769x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
1.7% 30723ms 0.30avg 100778x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
1.4% 24606ms 0.23avg 108716x -- SELECT is_deleted FROM hive_posts WHERE id = :id
1.3% 23265ms 0.22avg 105562x -- SELECT depth FROM hive_posts WHERE id = :id
0.3% 4550ms 0.29avg 15823x -- INSERT INTO hive_accounts (name, created_at) VALUES (...)
0.2% 3863ms 0.26avg 14767x -- SELECT name, id FROM hive_accounts WHERE name IN :names
0.1% 1475ms 0.31avg 4773x -- UPDATE hive_posts SET is_deleted = '1' WHERE id = :id
0.0% 810ms 0.34avg 2414x -- INSERT INTO hive_payments (block_num, tx_idx, post_id, from_account, to_account, amount, token) VALUES (...)
0.0% 727ms 0.30avg 2414x -- UPDATE hive_posts SET promoted = :val WHERE id = :id
0.0% 542ms 0.22avg 2414x -- SELECT promoted FROM hive_posts WHERE id = :id
0.0% 99ms 0.34avg 293x -- START TRANSACTION
0.0% 77ms 0.38avg 207x -- UPDATE hive_posts SET is_valid = :is_valid, is_deleted = '0', parent_id = :parent_id, category = :category, community = :community, depth = :depth WHERE id = :id
0.0% 51ms 0.18avg 293x -- COMMIT
[SYNC] Got block 16487000 @ 2017-10-20T05:43:24 (55/s, 311rps, 66wps) -- eta 1103:23
[DEBUG] total SQL time: 1800s
26.2% 471396ms 0.24avg 1944764x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
19.2% 344721ms 0.47avg 740020x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
17.1% 308098ms 0.23avg 1320661x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
12.0% 215925ms 0.29avg 746247x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
7.5% 135458ms 0.23avg 581440x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
6.5% 116830ms 0.25avg 467066x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
4.0% 72125ms 0.25avg 284033x -- INSERT INTO hive_blocks (num, hash, prev, txs, ops, created_at) VALUES (...)
3.3% 59638ms 0.25avg 237744x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
1.4% 25788ms 0.30avg 85223x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
1.2% 21525ms 0.23avg 95619x -- SELECT is_deleted FROM hive_posts WHERE id = :id
1.1% 20063ms 0.22avg 89837x -- SELECT depth FROM hive_posts WHERE id = :id
0.1% 2625ms 0.29avg 9146x -- INSERT INTO hive_accounts (name, created_at) VALUES (...)
0.1% 2252ms 0.26avg 8731x -- SELECT name, id FROM hive_accounts WHERE name IN :names
0.1% 1463ms 0.32avg 4614x -- UPDATE hive_posts SET is_deleted = '1' WHERE id = :id
0.0% 716ms 0.33avg 2177x -- INSERT INTO hive_payments (block_num, tx_idx, post_id, from_account, to_account, amount, token) VALUES (...)
0.0% 660ms 0.30avg 2177x -- UPDATE hive_posts SET promoted = :val WHERE id = :id
0.0% 489ms 0.22avg 2177x -- SELECT promoted FROM hive_posts WHERE id = :id
0.0% 98ms 0.35avg 284x -- START TRANSACTION
0.0% 70ms 0.37avg 189x -- UPDATE hive_posts SET is_valid = :is_valid, is_deleted = '0', parent_id = :parent_id, category = :category, community = :community, depth = :depth WHERE id = :id
0.0% 50ms 0.18avg 284x -- COMMIT
[SYNC] Got block 16628000 @ 2017-10-25T03:17:18 (106/s, 434rps, 141wps) -- eta 546:12
[DEBUG] total STEEM time: 1800s
100.0% 1,800,337ms 3.23avg 557000x -- get_block
[STEEM] Fastest call was 359.984ms
[MEM] peak memory usage: 821.21MB
[SYNC] Got block 16772000 @ 2017-10-30T03:22:06 (114/s, 375rps, 165wps) -- eta 488:09
[DEBUG] post.id lookups: 31470000, hits: 16176636 (51.4%), entries: 1000001
[DEBUG] total SQL time: 1800s
27.5% 495898ms 0.25avg 2011322x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
19.0% 342461ms 0.47avg 723100x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
14.3% 256814ms 0.24avg 1089113x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
12.2% 218941ms 0.30avg 728571x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
7.4% 132335ms 0.24avg 556901x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
6.3% 113737ms 0.25avg 447915x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
4.6% 83362ms 0.26avg 323393x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
4.1% 72912ms 0.26avg 284952x -- INSERT INTO hive_blocks (num, hash, prev, txs, ops, created_at) VALUES (...)
1.4% 25295ms 0.31avg 81953x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
1.3% 23340ms 0.23avg 100423x -- SELECT is_deleted FROM hive_posts WHERE id = :id
1.2% 21390ms 0.23avg 92526x -- SELECT depth FROM hive_posts WHERE id = :id
0.3% 4512ms 0.30avg 14867x -- INSERT INTO hive_accounts (name, created_at) VALUES (...)
0.2% 3645ms 0.26avg 13905x -- SELECT name, id FROM hive_accounts WHERE name IN :names
0.2% 3376ms 0.32avg 10573x -- UPDATE hive_posts SET is_deleted = '1' WHERE id = :id
0.0% 663ms 0.34avg 1961x -- INSERT INTO hive_payments (block_num, tx_idx, post_id, from_account, to_account, amount, token) VALUES (...)
0.0% 605ms 0.31avg 1961x -- UPDATE hive_posts SET promoted = :val WHERE id = :id
0.0% 450ms 0.23avg 1961x -- SELECT promoted FROM hive_posts WHERE id = :id
0.0% 105ms 0.38avg 277x -- UPDATE hive_posts SET is_valid = :is_valid, is_deleted = '0', parent_id = :parent_id, category = :category, community = :community, depth = :depth WHERE id = :id
0.0% 96ms 0.34avg 285x -- START TRANSACTION
0.0% 51ms 0.18avg 285x -- COMMIT
[SYNC] Got block 16999000 @ 2017-11-07T00:35:06 (116/s, 289rps, 195wps) -- eta 448:29
[SYNC] Got block 17000000 @ 2017-11-07T01:25:09 (136/s, 354rps, 222wps) -- eta 382:13
[SYNC] Got block 17001000 @ 2017-11-07T02:15:12 (116/s, 253rps, 215wps) -- eta 448:48
[SYNC] Got block 17081000 @ 2017-11-09T21:01:36 (59/s, 219rps, 82wps) -- eta 851:42
[DEBUG] total SQL time: 1800s
22.1% 397226ms 0.47avg 850891x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
20.7% 372635ms 0.25avg 1508538x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
14.6% 262478ms 0.23avg 1120829x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
14.0% 251261ms 0.29avg 858136x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
8.5% 152814ms 0.23avg 656387x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
7.2% 130393ms 0.25avg 532122x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
4.3% 78058ms 0.25avg 308522x -- INSERT INTO hive_blocks (num, hash, prev, txs, ops, created_at) VALUES (...)
3.9% 70419ms 0.25avg 277686x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
1.7% 30210ms 0.30avg 100820x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
1.4% 25477ms 0.23avg 112956x -- SELECT is_deleted FROM hive_posts WHERE id = :id
1.3% 23360ms 0.22avg 105754x -- SELECT depth FROM hive_posts WHERE id = :id
0.1% 1502ms 0.30avg 4934x -- UPDATE hive_posts SET is_deleted = '1' WHERE id = :id
0.1% 1006ms 0.33avg 3057x -- INSERT INTO hive_payments (block_num, tx_idx, post_id, from_account, to_account, amount, token) VALUES (...)
0.1% 979ms 0.32avg 3057x -- UPDATE hive_posts SET promoted = :val WHERE id = :id
0.0% 722ms 0.24avg 3057x -- SELECT promoted FROM hive_posts WHERE id = :id
0.0% 641ms 0.28avg 2283x -- INSERT INTO hive_accounts (name, created_at) VALUES (...)
0.0% 569ms 0.25avg 2274x -- SELECT name, id FROM hive_accounts WHERE name IN :names
0.0% 104ms 0.34avg 309x -- START TRANSACTION
0.0% 81ms 0.37avg 219x -- UPDATE hive_posts SET is_valid = :is_valid, is_deleted = '0', parent_id = :parent_id, category = :category, community = :community, depth = :depth WHERE id = :id
0.0% 54ms 0.18avg 309x -- COMMIT
[SYNC] Got block 17142000 @ 2017-11-11T23:52:48 (78/s, 442rps, 95wps) -- eta 632:13
[DEBUG] total STEEM time: 1800s
100.0% 1,800,916ms 3.50avg 514000x -- get_block
[STEEM] Fastest call was 359.984ms
[MEM] peak memory usage: 844.12MB
[SYNC] Got block 17349000 @ 2017-11-19T04:24:06 (110/s, 317rps, 168wps) -- eta 421:49
[DEBUG] total SQL time: 1800s
21.7% 390781ms 0.47avg 829723x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
20.6% 369982ms 0.25avg 1481021x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
16.2% 291334ms 0.24avg 1220357x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
14.1% 253312ms 0.30avg 836872x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
8.4% 150365ms 0.24avg 626436x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
7.2% 129424ms 0.25avg 513952x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
3.8% 67897ms 0.25avg 267906x -- INSERT INTO hive_blocks (num, hash, prev, txs, ops, created_at) VALUES (...)
3.3% 60263ms 0.26avg 235884x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
1.4% 25632ms 0.31avg 83357x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
1.4% 25583ms 0.23avg 109203x -- SELECT is_deleted FROM hive_posts WHERE id = :id
1.1% 19720ms 0.22avg 87975x -- SELECT depth FROM hive_posts WHERE id = :id
0.4% 6825ms 0.30avg 22439x -- INSERT INTO hive_accounts (name, created_at) VALUES (...)
0.3% 5425ms 0.26avg 20552x -- SELECT name, id FROM hive_accounts WHERE name IN :names
0.1% 1446ms 0.31avg 4618x -- UPDATE hive_posts SET is_deleted = '1' WHERE id = :id
0.0% 688ms 0.34avg 2004x -- INSERT INTO hive_payments (block_num, tx_idx, post_id, from_account, to_account, amount, token) VALUES (...)
0.0% 622ms 0.31avg 2004x -- UPDATE hive_posts SET promoted = :val WHERE id = :id
0.0% 465ms 0.23avg 2004x -- SELECT promoted FROM hive_posts WHERE id = :id
0.0% 91ms 0.34avg 268x -- START TRANSACTION
0.0% 88ms 0.37avg 236x -- UPDATE hive_posts SET is_valid = :is_valid, is_deleted = '0', parent_id = :parent_id, category = :category, community = :community, depth = :depth WHERE id = :id
0.0% 48ms 0.18avg 268x -- COMMIT
[SYNC] Got block 17616000 @ 2017-11-28T11:01:27 (65/s, 255rps, 88wps) -- eta 641:04
[SQL][243ms] SELECT * FROM hive_communities WHERE name = :name LIMIT 1
[DEBUG] total SQL time: 1800s
21.6% 388332ms 0.47avg 828235x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
21.2% 381490ms 0.25avg 1542158x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
14.4% 260096ms 0.24avg 1089106x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
13.8% 247999ms 0.30avg 836345x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
8.1% 145612ms 0.23avg 620255x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
7.2% 128829ms 0.25avg 519275x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
5.5% 98906ms 0.25avg 394193x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
3.8% 67933ms 0.25avg 267846x -- INSERT INTO hive_blocks (num, hash, prev, txs, ops, created_at) VALUES (...)
1.4% 25762ms 0.31avg 83850x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
1.3% 23938ms 0.23avg 104253x -- SELECT is_deleted FROM hive_posts WHERE id = :id
1.1% 20663ms 0.23avg 88309x -- SELECT depth FROM hive_posts WHERE id = :id
0.2% 3472ms 0.29avg 12042x -- INSERT INTO hive_accounts (name, created_at) VALUES (...)
0.2% 2938ms 0.26avg 11329x -- SELECT name, id FROM hive_accounts WHERE name IN :names
0.1% 1362ms 0.31avg 4459x -- UPDATE hive_posts SET is_deleted = '1' WHERE id = :id
0.1% 915ms 0.34avg 2719x -- INSERT INTO hive_payments (block_num, tx_idx, post_id, from_account, to_account, amount, token) VALUES (...)
0.0% 881ms 0.32avg 2719x -- UPDATE hive_posts SET promoted = :val WHERE id = :id
0.0% 652ms 0.24avg 2719x -- SELECT promoted FROM hive_posts WHERE id = :id
0.0% 91ms 0.34avg 267x -- START TRANSACTION
0.0% 74ms 0.37avg 198x -- UPDATE hive_posts SET is_valid = :is_valid, is_deleted = '0', parent_id = :parent_id, category = :category, community = :community, depth = :depth WHERE id = :id
0.0% 47ms 0.18avg 267x -- COMMIT
[SYNC] Got block 17675000 @ 2017-11-30T12:12:03 (75/s, 254rps, 107wps) -- eta 542:53
[DEBUG] total STEEM time: 1800s
100.0% 1,800,189ms 3.38avg 533000x -- get_block
[STEEM] Fastest call was 359.984ms
[MEM] peak memory usage: 844.12MB
[SYNC] Got block 17862000 @ 2017-12-07T00:07:00 (64/s, 267rps, 84wps) -- eta 590:06
[DEBUG] total SQL time: 1800s
24.2% 435671ms 0.25avg 1740987x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
19.6% 352701ms 0.47avg 743064x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
14.2% 255757ms 0.24avg 1065546x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
12.6% 226991ms 0.30avg 749285x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
8.4% 151381ms 0.26avg 573495x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
7.2% 129381ms 0.24avg 544263x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
6.2% 111717ms 0.25avg 450131x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
3.5% 62205ms 0.25avg 245405x -- INSERT INTO hive_blocks (num, hash, prev, txs, ops, created_at) VALUES (...)
1.3% 23015ms 0.23avg 98089x -- SELECT is_deleted FROM hive_posts WHERE id = :id
1.3% 22637ms 0.31avg 73775x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
1.0% 17139ms 0.22avg 77651x -- SELECT depth FROM hive_posts WHERE id = :id
0.2% 4127ms 0.29avg 14011x -- INSERT INTO hive_accounts (name, created_at) VALUES (...)
0.2% 3401ms 0.26avg 13135x -- SELECT name, id FROM hive_accounts WHERE name IN :names
0.1% 1191ms 0.31avg 3876x -- UPDATE hive_posts SET is_deleted = '1' WHERE id = :id
0.1% 919ms 0.34avg 2670x -- UPDATE hive_posts SET promoted = :val WHERE id = :id
0.0% 898ms 0.34avg 2670x -- INSERT INTO hive_payments (block_num, tx_idx, post_id, from_account, to_account, amount, token) VALUES (...)
0.0% 667ms 0.25avg 2670x -- SELECT promoted FROM hive_posts WHERE id = :id
0.0% 83ms 0.34avg 246x -- START TRANSACTION
0.0% 68ms 0.37avg 184x -- UPDATE hive_posts SET is_valid = :is_valid, is_deleted = '0', parent_id = :parent_id, category = :category, community = :community, depth = :depth WHERE id = :id
0.0% 44ms 0.18avg 246x -- COMMIT
[SYNC] Got block 17999000 @ 2017-12-11T18:20:18 (72/s, 289rps, 96wps) -- eta 492:40
[SYNC] Got block 18000000 @ 2017-12-11T19:10:18 (77/s, 316rps, 102wps) -- eta 459:43
[SYNC] Got block 18001000 @ 2017-12-11T20:00:24 (65/s, 311rps, 82wps) -- eta 543:22
[SYNC] Got block 18104000 @ 2017-12-15T09:52:27 (57/s, 331rps, 69wps) -- eta 586:49
[SQL][259ms] INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
[DEBUG] total SQL time: 1800s
22.8% 409879ms 0.47avg 864338x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
19.8% 356981ms 0.25avg 1429766x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
14.9% 267601ms 0.31avg 870992x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
13.0% 233787ms 0.24avg 961980x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
8.4% 151885ms 0.24avg 642288x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
7.4% 132711ms 0.25avg 528069x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
5.5% 99277ms 0.26avg 387892x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
3.4% 61338ms 0.25avg 242209x -- INSERT INTO hive_blocks (num, hash, prev, txs, ops, created_at) VALUES (...)
1.6% 28858ms 0.23avg 126217x -- SELECT is_deleted FROM hive_posts WHERE id = :id
1.4% 25543ms 0.31avg 83071x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
1.1% 19484ms 0.22avg 87927x -- SELECT depth FROM hive_posts WHERE id = :id
0.3% 5181ms 0.29avg 17833x -- INSERT INTO hive_accounts (name, created_at) VALUES (...)
0.2% 4273ms 0.26avg 16151x -- SELECT name, id FROM hive_accounts WHERE name IN :names
0.1% 1497ms 0.31avg 4856x -- UPDATE hive_posts SET is_deleted = '1' WHERE id = :id
0.0% 595ms 0.36avg 1648x -- INSERT INTO hive_payments (block_num, tx_idx, post_id, from_account, to_account, amount, token) VALUES (...)
0.0% 520ms 0.32avg 1648x -- UPDATE hive_posts SET promoted = :val WHERE id = :id
0.0% 381ms 0.23avg 1648x -- SELECT promoted FROM hive_posts WHERE id = :id
0.0% 82ms 0.34avg 242x -- START TRANSACTION
0.0% 75ms 0.38avg 198x -- UPDATE hive_posts SET is_valid = :is_valid, is_deleted = '0', parent_id = :parent_id, category = :category, community = :community, depth = :depth WHERE id = :id
0.0% 43ms 0.18avg 242x -- COMMIT
[SYNC] Got block 18161000 @ 2017-12-17T09:22:51 (74/s, 258rps, 105wps) -- eta 439:54
[DEBUG] total STEEM time: 1804s
100.0% 1,804,534ms 3.71avg 486000x -- get_block
[STEEM] Fastest call was 359.984ms
[MEM] peak memory usage: 863.24MB
[SYNC] Got block 18286000 @ 2017-12-21T17:34:00 (46/s, 192rps, 61wps) -- eta 659:24
[DEBUG] post.id lookups: 41370000, hits: 21076030 (50.9%), entries: 1000001
[DEBUG] total SQL time: 1800s
22.1% 397675ms 0.47avg 842359x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
20.7% 373458ms 0.25avg 1497747x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
14.5% 260951ms 0.31avg 849564x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
13.4% 241974ms 0.25avg 984382x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
8.4% 151732ms 0.24avg 640327x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
7.3% 130836ms 0.25avg 523662x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
6.4% 115268ms 0.25avg 463921x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
2.6% 46157ms 0.25avg 182364x -- INSERT INTO hive_blocks (num, hash, prev, txs, ops, created_at) VALUES (...)
1.5% 27575ms 0.23avg 120003x -- SELECT is_deleted FROM hive_posts WHERE id = :id
1.3% 23421ms 0.31avg 75646x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
1.0% 17834ms 0.22avg 80504x -- SELECT depth FROM hive_posts WHERE id = :id
0.3% 5281ms 0.29avg 18444x -- INSERT INTO hive_accounts (name, created_at) VALUES (...)
0.2% 4365ms 0.26avg 16736x -- SELECT name, id FROM hive_accounts WHERE name IN :names
0.1% 1514ms 0.31avg 4858x -- UPDATE hive_posts SET is_deleted = '1' WHERE id = :id
0.0% 606ms 0.36avg 1676x -- INSERT INTO hive_payments (block_num, tx_idx, post_id, from_account, to_account, amount, token) VALUES (...)
0.0% 520ms 0.31avg 1676x -- UPDATE hive_posts SET promoted = :val WHERE id = :id
0.0% 381ms 0.23avg 1676x -- SELECT promoted FROM hive_posts WHERE id = :id
0.0% 347ms 1.59avg 218x -- UPDATE hive_posts SET is_valid = :is_valid, is_deleted = '0', parent_id = :parent_id, category = :category, community = :community, depth = :depth WHERE id = :id
0.0% 63ms 0.35avg 182x -- START TRANSACTION
0.0% 32ms 0.18avg 182x -- COMMIT
[SYNC] Got block 18450000 @ 2017-12-27T10:19:15 (40/s, 173rps, 52wps) -- eta 691:53
[SQL][318ms] INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
[DEBUG] total SQL time: 1800s
21.9% 394573ms 0.25avg 1602430x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
21.3% 382841ms 0.47avg 809064x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
15.8% 283646ms 0.24avg 1162567x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
13.9% 251059ms 0.31avg 816474x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
8.2% 147834ms 0.24avg 626145x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
7.1% 128355ms 0.25avg 517657x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
5.3% 95436ms 0.25avg 380621x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
2.3% 41286ms 0.25avg 163828x -- INSERT INTO hive_blocks (num, hash, prev, txs, ops, created_at) VALUES (...)
1.5% 26781ms 0.23avg 117658x -- SELECT is_deleted FROM hive_posts WHERE id = :id
1.2% 20873ms 0.31avg 67478x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
0.9% 15983ms 0.22avg 72457x -- SELECT depth FROM hive_posts WHERE id = :id
0.2% 4471ms 0.29avg 15386x -- INSERT INTO hive_accounts (name, created_at) VALUES (...)
0.2% 3623ms 0.26avg 13971x -- SELECT name, id FROM hive_accounts WHERE name IN :names
0.1% 1528ms 0.31avg 4979x -- UPDATE hive_posts SET is_deleted = '1' WHERE id = :id
0.0% 591ms 0.35avg 1670x -- INSERT INTO hive_payments (block_num, tx_idx, post_id, from_account, to_account, amount, token) VALUES (...)
0.0% 534ms 0.32avg 1670x -- UPDATE hive_posts SET promoted = :val WHERE id = :id
0.0% 397ms 0.24avg 1670x -- SELECT promoted FROM hive_posts WHERE id = :id
0.0% 94ms 0.38avg 252x -- UPDATE hive_posts SET is_valid = :is_valid, is_deleted = '0', parent_id = :parent_id, category = :category, community = :community, depth = :depth WHERE id = :id
0.0% 55ms 0.34avg 164x -- START TRANSACTION
0.0% 29ms 0.18avg 164x -- COMMIT
[SYNC] Got block 18605000 @ 2018-01-01T19:42:18 (44/s, 159rps, 61wps) -- eta 571:46
[STEEM][6124ms] get_blocks_batch[1000] -- 1.2x par (6/5)
[DEBUG] post.id lookups: 44660000, hits: 22725224 (50.9%), entries: 1000001
[SQL][172ms] INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
[DEBUG] total SQL time: 1800s
21.6% 389231ms 0.25avg 1570429x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
21.6% 387988ms 0.48avg 816744x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
16.9% 304694ms 0.25avg 1241483x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
14.1% 254101ms 0.31avg 825312x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
8.4% 150779ms 0.23avg 643982x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
7.3% 131204ms 0.25avg 532328x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
3.5% 62801ms 0.26avg 240930x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
2.1% 38405ms 0.25avg 154697x -- INSERT INTO hive_blocks (num, hash, prev, txs, ops, created_at) VALUES (...)
1.5% 26614ms 0.23avg 117796x -- SELECT is_deleted FROM hive_posts WHERE id = :id
1.4% 24354ms 0.31avg 79200x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
1.0% 18358ms 0.22avg 83921x -- SELECT depth FROM hive_posts WHERE id = :id
0.2% 3975ms 0.29avg 13764x -- INSERT INTO hive_accounts (name, created_at) VALUES (...)
0.2% 3216ms 0.26avg 12355x -- SELECT name, id FROM hive_accounts WHERE name IN :names
0.1% 1446ms 0.31avg 4721x -- UPDATE hive_posts SET is_deleted = '1' WHERE id = :id
0.1% 956ms 0.35avg 2768x -- INSERT INTO hive_payments (block_num, tx_idx, post_id, from_account, to_account, amount, token) VALUES (...)
0.1% 954ms 0.34avg 2768x -- UPDATE hive_posts SET promoted = :val WHERE id = :id
0.0% 702ms 0.25avg 2768x -- SELECT promoted FROM hive_posts WHERE id = :id
0.0% 95ms 0.37avg 255x -- UPDATE hive_posts SET is_valid = :is_valid, is_deleted = '0', parent_id = :parent_id, category = :category, community = :community, depth = :depth WHERE id = :id
0.0% 91ms 0.59avg 155x -- START TRANSACTION
0.0% 27ms 0.18avg 155x -- COMMIT
[SYNC] Got block 18727000 @ 2018-01-06T01:24:21 (42/s, 160rps, 57wps) -- eta 555:29
[DEBUG] total SQL time: 1800s
22.9% 411420ms 0.48avg 857601x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
19.5% 351052ms 0.25avg 1399834x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
16.3% 292745ms 0.25avg 1179923x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
15.3% 275880ms 0.32avg 869219x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
9.0% 161355ms 0.24avg 675925x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
7.7% 139084ms 0.25avg 556256x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
2.4% 43303ms 0.26avg 165149x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
1.7% 30209ms 0.25avg 121712x -- INSERT INTO hive_blocks (num, hash, prev, txs, ops, created_at) VALUES (...)
1.7% 29985ms 0.31avg 97354x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
1.6% 29362ms 0.23avg 127771x -- SELECT is_deleted FROM hive_posts WHERE id = :id
1.3% 22527ms 0.22avg 102538x -- SELECT depth FROM hive_posts WHERE id = :id
0.3% 5690ms 0.29avg 19869x -- INSERT INTO hive_accounts (name, created_at) VALUES (...)
0.2% 4221ms 0.26avg 16296x -- SELECT name, id FROM hive_accounts WHERE name IN :names
0.1% 1688ms 0.33avg 5184x -- UPDATE hive_posts SET is_deleted = '1' WHERE id = :id
0.0% 551ms 0.39avg 1402x -- INSERT INTO hive_payments (block_num, tx_idx, post_id, from_account, to_account, amount, token) VALUES (...)
0.0% 439ms 0.31avg 1402x -- UPDATE hive_posts SET promoted = :val WHERE id = :id
0.0% 311ms 0.22avg 1402x -- SELECT promoted FROM hive_posts WHERE id = :id
0.0% 106ms 0.38avg 280x -- UPDATE hive_posts SET is_valid = :is_valid, is_deleted = '0', parent_id = :parent_id, category = :category, community = :community, depth = :depth WHERE id = :id
0.0% 41ms 0.34avg 122x -- START TRANSACTION
0.0% 21ms 0.18avg 122x -- COMMIT
[SYNC] Got block 18784000 @ 2018-01-08T00:57:00 (35/s, 149rps, 46wps) -- eta 629:51
[STEEM][6569ms] get_blocks_batch[1000] -- 1.2x par (6/5)
[DEBUG] total STEEM time: 1802s
100.0% 1,802,677ms 7.48avg 241000x -- get_block
[STEEM] Fastest call was 359.984ms
[MEM] peak memory usage: 1006.09MB
[SYNC] Got block 18846000 @ 2018-01-10T04:40:57 (33/s, 178rps, 40wps) -- eta 646:04
[DEBUG] total SQL time: 1800s
23.1% 416260ms 0.48avg 860223x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
19.6% 352491ms 0.25avg 1390218x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
15.8% 284434ms 0.25avg 1146709x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
15.6% 280748ms 0.32avg 876577x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
8.9% 160781ms 0.24avg 669589x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
7.5% 135550ms 0.25avg 537280x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
2.5% 45565ms 0.26avg 173700x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
1.8% 32006ms 0.23avg 136921x -- SELECT is_deleted FROM hive_posts WHERE id = :id
1.7% 29805ms 0.25avg 118972x -- INSERT INTO hive_blocks (num, hash, prev, txs, ops, created_at) VALUES (...)
1.4% 25816ms 0.32avg 80759x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
1.1% 19388ms 0.22avg 87186x -- SELECT depth FROM hive_posts WHERE id = :id
0.5% 8435ms 0.33avg 25953x -- INSERT INTO hive_accounts (name, created_at) VALUES (...)
0.3% 5315ms 0.26avg 20290x -- SELECT name, id FROM hive_accounts WHERE name IN :names
0.1% 2005ms 0.31avg 6426x -- UPDATE hive_posts SET is_deleted = '1' WHERE id = :id
0.0% 510ms 0.39avg 1300x -- INSERT INTO hive_payments (block_num, tx_idx, post_id, from_account, to_account, amount, token) VALUES (...)
0.0% 389ms 0.30avg 1300x -- UPDATE hive_posts SET promoted = :val WHERE id = :id
0.0% 288ms 0.22avg 1300x -- SELECT promoted FROM hive_posts WHERE id = :id
0.0% 144ms 0.41avg 355x -- UPDATE hive_posts SET is_valid = :is_valid, is_deleted = '0', parent_id = :parent_id, category = :category, community = :community, depth = :depth WHERE id = :id
0.0% 40ms 0.34avg 119x -- START TRANSACTION
0.0% 21ms 0.18avg 119x -- COMMIT
[DEBUG] post.id lookups: 48190000, hits: 24504771 (50.9%), entries: 1000001
[SYNC] Got block 18952000 @ 2018-01-13T21:06:18 (34/s, 142rps, 44wps) -- eta 578:11
[STEEM][7130ms] get_blocks_batch[1000] -- 1.4x par (7/5)
[DEBUG] post.id lookups: 49780000, hits: 25299406 (50.8%), entries: 1000001
[SQL][692ms] INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
[DEBUG] total SQL time: 1800s
22.8% 410056ms 0.25avg 1645544x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
21.2% 381703ms 0.49avg 785152x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
18.4% 331457ms 0.25avg 1323491x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
14.1% 253967ms 0.32avg 801187x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
8.0% 144667ms 0.24avg 615576x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
6.9% 123745ms 0.25avg 499152x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
2.8% 50996ms 0.25avg 202120x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
1.6% 28464ms 0.23avg 125364x -- SELECT is_deleted FROM hive_posts WHERE id = :id
1.5% 27792ms 0.26avg 106748x -- INSERT INTO hive_blocks (num, hash, prev, txs, ops, created_at) VALUES (...)
1.2% 21526ms 0.31avg 68888x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
0.9% 16209ms 0.22avg 74233x -- SELECT depth FROM hive_posts WHERE id = :id
0.2% 3658ms 0.28avg 12843x -- INSERT INTO hive_accounts (name, created_at) VALUES (...)
0.2% 2865ms 0.26avg 11172x -- SELECT name, id FROM hive_accounts WHERE name IN :names
0.1% 1699ms 0.32avg 5346x -- UPDATE hive_posts SET is_deleted = '1' WHERE id = :id
0.0% 442ms 0.40avg 1115x -- INSERT INTO hive_payments (block_num, tx_idx, post_id, from_account, to_account, amount, token) VALUES (...)
0.0% 342ms 0.31avg 1115x -- UPDATE hive_posts SET promoted = :val WHERE id = :id
0.0% 244ms 0.22avg 1115x -- SELECT promoted FROM hive_posts WHERE id = :id
0.0% 104ms 0.38avg 276x -- UPDATE hive_posts SET is_valid = :is_valid, is_deleted = '0', parent_id = :parent_id, category = :category, community = :community, depth = :depth WHERE id = :id
0.0% 36ms 0.34avg 106x -- START TRANSACTION
0.0% 18ms 0.18avg 106x -- COMMIT
[SYNC] Got block 18999000 @ 2018-01-15T12:18:06 (36/s, 145rps, 48wps) -- eta 518:27
[SYNC] Got block 19000000 @ 2018-01-15T13:08:09 (32/s, 140rps, 42wps) -- eta 574:31
[SYNC] Got block 19001000 @ 2018-01-15T13:58:21 (34/s, 131rps, 46wps) -- eta 553:20
[SYNC] Got block 19071000 @ 2018-01-18T00:19:00 (43/s, 180rps, 57wps) -- eta 407:40
[DEBUG] total STEEM time: 1804s
100.0% 1,804,114ms 6.29avg 287000x -- get_block
[STEEM] Fastest call was 359.984ms
[MEM] peak memory usage: 1047.89MB
[DEBUG] post.id lookups: 51480000, hits: 26154266 (50.8%), entries: 1000001
[SYNC] Got block 19072000 @ 2018-01-18T01:09:00 (37/s, 169rps, 48wps) -- eta 472:48
[STEEM][6619ms] get_blocks_batch[1000] -- 1.2x par (6/5)
[DEBUG] post.id lookups: 51490000, hits: 26159395 (50.8%), entries: 1000001
[DEBUG] total SQL time: 1800s
22.2% 400429ms 0.48avg 835074x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
22.0% 396155ms 0.25avg 1593553x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
16.0% 287374ms 0.25avg 1170572x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
14.7% 263718ms 0.31avg 850023x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
8.4% 151944ms 0.23avg 656369x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
7.2% 130081ms 0.24avg 534216x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
3.5% 62710ms 0.25avg 246960x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
1.7% 30142ms 0.22avg 136672x -- SELECT is_deleted FROM hive_posts WHERE id = :id
1.6% 29659ms 0.25avg 119679x -- INSERT INTO hive_blocks (num, hash, prev, txs, ops, created_at) VALUES (...)
1.3% 23217ms 0.31avg 74711x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
1.0% 17508ms 0.22avg 80667x -- SELECT depth FROM hive_posts WHERE id = :id
0.1% 2681ms 0.66avg 4064x -- INSERT INTO hive_accounts (name, created_at) VALUES (...)
0.1% 1820ms 0.31avg 5956x -- UPDATE hive_posts SET is_deleted = '1' WHERE id = :id
0.1% 1008ms 0.25avg 3992x -- SELECT name, id FROM hive_accounts WHERE name IN :names
0.0% 614ms 0.41avg 1493x -- INSERT INTO hive_payments (block_num, tx_idx, post_id, from_account, to_account, amount, token) VALUES (...)
0.0% 446ms 0.30avg 1493x -- UPDATE hive_posts SET promoted = :val WHERE id = :id
0.0% 327ms 0.22avg 1493x -- SELECT promoted FROM hive_posts WHERE id = :id
0.0% 96ms 0.37avg 258x -- UPDATE hive_posts SET is_valid = :is_valid, is_deleted = '0', parent_id = :parent_id, category = :category, community = :community, depth = :depth WHERE id = :id
0.0% 40ms 0.34avg 120x -- START TRANSACTION
0.0% 20ms 0.17avg 120x -- COMMIT
[SYNC] Got block 19180000 @ 2018-01-21T19:12:03 (31/s, 146rps, 40wps) -- eta 500:29
[STEEM][6912ms] get_blocks_batch[1000] -- 1.2x par (6/5)
[DEBUG] post.id lookups: 53060000, hits: 26943720 (50.8%), entries: 1000001
[SQL][1173ms] INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
[DEBUG] total SQL time: 1800s
21.7% 390264ms 0.25avg 1539342x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
21.4% 385941ms 0.50avg 771212x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
16.5% 296694ms 0.25avg 1175892x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
14.9% 268271ms 0.34avg 786066x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
8.1% 145861ms 0.24avg 598646x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
7.0% 126162ms 0.26avg 494063x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
4.0% 71342ms 0.27avg 266648x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
1.6% 28363ms 0.24avg 119339x -- SELECT is_deleted FROM hive_posts WHERE id = :id
1.5% 27647ms 0.26avg 107958x -- INSERT INTO hive_blocks (num, hash, prev, txs, ops, created_at) VALUES (...)
1.3% 23611ms 0.32avg 74296x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
1.0% 17799ms 0.22avg 79918x -- SELECT depth FROM hive_posts WHERE id = :id
0.5% 8792ms 0.32avg 27885x -- INSERT INTO hive_accounts (name, created_at) VALUES (...)
0.3% 5914ms 0.26avg 22748x -- SELECT name, id FROM hive_accounts WHERE name IN :names
0.1% 1763ms 0.31avg 5622x -- UPDATE hive_posts SET is_deleted = '1' WHERE id = :id
0.0% 599ms 0.38avg 1590x -- INSERT INTO hive_payments (block_num, tx_idx, post_id, from_account, to_account, amount, token) VALUES (...)
0.0% 513ms 0.32avg 1590x -- UPDATE hive_posts SET promoted = :val WHERE id = :id
0.0% 360ms 0.23avg 1590x -- SELECT promoted FROM hive_posts WHERE id = :id
0.0% 81ms 0.39avg 209x -- UPDATE hive_posts SET is_valid = :is_valid, is_deleted = '0', parent_id = :parent_id, category = :category, community = :community, depth = :depth WHERE id = :id
0.0% 36ms 0.34avg 108x -- START TRANSACTION
0.0% 19ms 0.18avg 108x -- COMMIT
[SYNC] Got block 19280000 @ 2018-01-25T06:34:00 (28/s, 154rps, 35wps) -- eta 497:16
[STEEM][6517ms] get_blocks_batch[1000] -- 1.2x par (6/5)
[DEBUG] post.id lookups: 54720000, hits: 27768086 (50.7%), entries: 1000001
[DEBUG] total SQL time: 1800s
22.6% 407624ms 0.50avg 819241x -- INSERT INTO hive_posts (is_valid, parent_id, author, permlink, category, community, depth, created_at) VALUES (...);SELECT currval(pg_get_serial_sequence('hive_posts','id'))
20.1% 361580ms 0.25avg 1440164x -- SELECT state FROM hive_follows WHERE follower = :follower AND following = :following
15.8% 284393ms 0.25avg 1126464x -- INSERT INTO hive_follows (follower, following, created_at, state) VALUES (...)
15.6% 281577ms 0.34avg 833759x -- SELECT id FROM hive_posts WHERE author = :a AND permlink = :p
8.6% 154576ms 0.24avg 635976x -- SELECT depth,category,community FROM hive_posts WHERE id=:id
7.4% 134048ms 0.25avg 527766x -- SELECT * FROM hive_communities WHERE name = :name LIMIT 1
3.5% 63656ms 0.26avg 245214x -- UPDATE hive_follows SET state = :state WHERE follower = :flr AND following = :flg
1.6% 28821ms 0.24avg 122376x -- SELECT is_deleted FROM hive_posts WHERE id = :id
1.4% 25085ms 0.25avg 99776x -- INSERT INTO hive_blocks (num, hash, prev, txs, ops, created_at) VALUES (...)
1.3% 23559ms 0.33avg 70792x -- INSERT INTO hive_reblogs (account, post_id, created_at) VALUES (...) ON CONFLICT (account, post_id) DO NOTHING
1.0% 17136ms 0.22avg 77170x -- SELECT depth FROM hive_posts WHERE id = :id
0.4% 7973ms 0.29avg 27789x -- INSERT INTO hive_accounts (name, created_at) VALUES (...)
0.3% 5613ms 0.26avg 21400x -- SELECT name, id FROM hive_accounts WHERE name IN :names
0.1% 2496ms 0.39avg 6378x -- UPDATE hive_posts SET is_deleted = '1' WHERE id = :id
0.0% 669ms 0.45avg 1482x -- SELECT promoted FROM hive_posts WHERE id = :id
0.0% 572ms 0.39avg 1482x -- INSERT INTO hive_payments (block_num, tx_idx, post_id, from_account, to_account, amount, token) VALUES (...)
0.0% 471ms 0.32avg 1482x -- UPDATE hive_posts SET promoted = :val WHERE id = :id
0.0% 92ms 0.39avg 239x -- UPDATE hive_posts SET is_valid = :is_valid, is_deleted = '0', parent_id = :parent_id, category = :category, community = :community, depth = :depth WHERE id = :id
0.0% 34ms 0.34avg 100x -- START TRANSACTION
0.0% 17ms 0.18avg 100x -- COMMIT
[SYNC] Got block 19285000 @ 2018-01-25T10:44:06 (26/s, 150rps, 32wps) -- eta 536:11
[STEEM][6844ms] get_blocks_batch[1000] -- 1.2x par (6/5)
[DEBUG] total STEEM time: 1802s
100.0% 1,802,020ms 8.42avg 214000x -- get_block
[STEEM] Fastest call was 359.984ms
[MEM] peak memory usage: 1077.37MB
[SYNC] Got block 19319000 @ 2018-01-26T15:04:54 (31/s, 145rps, 39wps) -- eta 434:56
(full disk crash)
[STEEM] Fastest call was 359.984ms
[MEM] peak memory usage: 1077.37MB
from hivemind.
Related Issues (20)
- clarify startup config output
- nsfw validation HOT 1
- resolve feed/blog inconsistency HOT 1
- schema changes
- openmic tag missing HOT 2
- standardize new vs. legacy mute logic
- notifs: mark read HOT 1
- iredeemables/blacklists issues
- additional community props HOT 5
- iredeemables spamming reply notifications
- get_community timings HOT 1
- Allow pagination for method 'list_subscribers'
- master merge prep
- Fat Node without market_history is apparently useless for hivemind
- I can't specify specialized endpoints
- Issue with the bridge.get_ranked_posts API
- The community title contains unexpected string HOT 1
- sqlalchemy.exc.DataError: (psycopg2.errors.StringDataRightTruncation) value too long for type character varying(100)
- Error: assert post['active_votes'] or int(post['net_rshares']) == 0 HOT 1
- reply page error
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from hivemind.