nlerror 19 & 18 on peer nodes when new node joins network or refresh key about authsae HOT 27 CLOSED

This is with debug 31:

Thu Dec 17 16:29:51 2015 recv'd COMMIT from 00:0c:42:18:d1:29 while in NOTHING
Thu Dec 17 16:29:51 2015 computing PWE on 256 bit curve number 19
Thu Dec 17 16:29:51 2015 it took 1 tries to find PWE: 19
Thu Dec 17 16:29:51 2015 H(00:0c:42:18:ee:54 | 00:0c:42:18:d1:29, 12345678901234567890 | 1)
Thu Dec 17 16:29:51 2015 95cca07c 88ccd02a 53df6b41 4ec37335 f69822f0 af2594bb b513fd1e a5678669
Thu Dec 17 16:29:51 2015 candidate x value:
Thu Dec 17 16:29:51 2015 c38aadd9 f7ad5179 48ef200c 9a67164b 8da61648 a604585a 5b23e954 8e738116
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 H(00:0c:42:18:ee:54 | 00:0c:42:18:d1:29, 12345678901234567890 | 2)
Thu Dec 17 16:29:51 2015 df16de3e 3e47c081 f1eef247 d8e56469 206bc81f 3c877369 5010a812 b863d279
Thu Dec 17 16:29:51 2015 candidate x value:
Thu Dec 17 16:29:51 2015 72609f45 e9fefc03 ba4607e7 0022170f 17835b0e 60d6f5ec 86ccbd52 fa52d927
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 H(00:0c:42:18:ee:54 | 00:0c:42:18:d1:29, 12345678901234567890 | 3)
Thu Dec 17 16:29:51 2015 c35bf07d 9a263690 045984da 963df4d8 13497cde 574dee5a 0451adac 233b859a
Thu Dec 17 16:29:51 2015 candidate x value:
Thu Dec 17 16:29:51 2015 999a2a52 5f7669ad f1031f60 eb983fda ae99c2c2 ca057c4c 2c46e46a fdbf390d
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 H(00:0c:42:18:ee:54 | 00:0c:42:18:d1:29, 12345678901234567890 | 4)
Thu Dec 17 16:29:51 2015 bb59b55b f3aa9cd8 82a274f2 b130bc31 02349b1f def1a232 4f4028a9 8363b447
Thu Dec 17 16:29:51 2015 candidate x value:
Thu Dec 17 16:29:51 2015 0c8ad657 6393dc94 babf20cc e8833c06 438e7f8b ad9bf49e 6dde2d01 43612422
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 H(00:0c:42:18:ee:54 | 00:0c:42:18:d1:29, 12345678901234567890 | 5)
Thu Dec 17 16:29:51 2015 c5b80204 aed8ed41 fad6d521 a632d63f 16fddc6d 3dfcc494 c5e07708 d6c39357
Thu Dec 17 16:29:51 2015 candidate x value:
Thu Dec 17 16:29:51 2015 c3a86b7b c276c5c1 46a9bf8c e45efa2a f7a1c1eb 75437d44 900d4c6c 5d695498
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 H(00:0c:42:18:ee:54 | 00:0c:42:18:d1:29, 12345678901234567890 | 6)
Thu Dec 17 16:29:51 2015 e82e3ec8 3cb92c65 1f8d0bf9 40269835 ba854376 cb4645a5 ad8e97a9 972e34bc
Thu Dec 17 16:29:51 2015 candidate x value:
Thu Dec 17 16:29:51 2015 933d1703 985f8c49 e2249df6 3a66be67 a493927a a00e4946 c001b0dc f2a7d5f5
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 H(00:0c:42:18:ee:54 | 00:0c:42:18:d1:29, 12345678901234567890 | 7)
Thu Dec 17 16:29:51 2015 3fce7891 2fcbe037 fe740ba9 071f761f 018256f2 d3ba2897 f4a15f77 dcac7219
Thu Dec 17 16:29:51 2015 candidate x value:
Thu Dec 17 16:29:51 2015 f0babb36 713d4153 7fd915bb 757853a2 2fe23205 2e50c5c1 1e414b7d fc1aad21
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 H(00:0c:42:18:ee:54 | 00:0c:42:18:d1:29, 12345678901234567890 | 8)
Thu Dec 17 16:29:51 2015 412cefe1 0d8d10b3 a5e42d64 2f5c19fa 7875b9a4 520c3a4d 2e9c9559 44711d2e
Thu Dec 17 16:29:51 2015 candidate x value:
Thu Dec 17 16:29:51 2015 07017312 5c83a871 11c8f94d 85444c34 76fbc242 8563d828 6c1f6f4c 06825dfb
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 H(00:0c:42:18:ee:54 | 00:0c:42:18:d1:29, 12345678901234567890 | 9)
Thu Dec 17 16:29:51 2015 cba47fe4 1b8b5007 750b9f2a 2a9f21bb 2d567d32 0b40bde2 96cb418e e9b0a039
Thu Dec 17 16:29:51 2015 candidate x value:
Thu Dec 17 16:29:51 2015 782a66cf ec0b48f5 b24acc6b ffe39602 eeddeb1f 62776927 f9a22ee8 d243d020
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 H(00:0c:42:18:ee:54 | 00:0c:42:18:d1:29, 12345678901234567890 | 10)
Thu Dec 17 16:29:51 2015 0cfc4a63 382089e7 fdd6214b 6ddc20bd d5421334 2e07d424 25a2439d eed56254
Thu Dec 17 16:29:51 2015 candidate x value:
Thu Dec 17 16:29:51 2015 8a7fec85 6ccb882e eaf8d7f4 67850460 1c05eb68 ebcc0db2 ec2cf4a4 96a2d88b
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 H(00:0c:42:18:ee:54 | 00:0c:42:18:d1:29, 12345678901234567890 | 11)
Thu Dec 17 16:29:51 2015 debdc87f b5122c7e beba9a39 ffe424e4 46b0b7cd 8764d983 62a80afd d1e7c885
Thu Dec 17 16:29:51 2015 candidate x value:
Thu Dec 17 16:29:51 2015 de381638 c14d9f7b d82e7254 b51f5e3e 4fc4aab1 dbaa107d 5e9ef68d 54bf0a40
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 H(00:0c:42:18:ee:54 | 00:0c:42:18:d1:29, 12345678901234567890 | 12)
Thu Dec 17 16:29:51 2015 084baa5d de8216bd 04b5b5dc 78722445 85a97e1d 8d113daf c7bec5ce bd44d38e
Thu Dec 17 16:29:51 2015 candidate x value:
Thu Dec 17 16:29:51 2015 46643664 bc0b96fa f1cd9656 ce2fcdbf 3feb2703 99d44b7b 04437dfa 2f5a814c
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 H(00:0c:42:18:ee:54 | 00:0c:42:18:d1:29, 12345678901234567890 | 13)
Thu Dec 17 16:29:51 2015 7cfdb256 fb48e63c 087bfb1f 554390d1 4d47b21f 34ddbb03 2d360504 aa556d9a
Thu Dec 17 16:29:51 2015 candidate x value:
Thu Dec 17 16:29:51 2015 09139bde aef82052 76626053 cb370ae9 0144dd0b db0a59a0 22162152 2f6d6832
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 H(00:0c:42:18:ee:54 | 00:0c:42:18:d1:29, 12345678901234567890 | 14)
Thu Dec 17 16:29:51 2015 317f192c b858d829 17469211 10afbe6c af79430d 6639180b 659155ab 056cf326
Thu Dec 17 16:29:51 2015 candidate x value:
Thu Dec 17 16:29:51 2015 8cf0b82b ca59a573 1c37be9d 8c594862 c28e05ea 087d02bc 0e260261 7eea33c1
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 H(00:0c:42:18:ee:54 | 00:0c:42:18:d1:29, 12345678901234567890 | 15)
Thu Dec 17 16:29:51 2015 dccf9c79 9a83f41d 1c28f514 315f2ab1 2ac2e0cf e8e3c3f7 2e610e49 01f5de34
Thu Dec 17 16:29:51 2015 candidate x value:
Thu Dec 17 16:29:51 2015 6ac218a2 9df9182a 3af2514b 5c84b109 be41fc7f 3b097dd7 3639ff48 d4ba7ddb
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 H(00:0c:42:18:ee:54 | 00:0c:42:18:d1:29, 12345678901234567890 | 16)
Thu Dec 17 16:29:51 2015 e27cdcc0 dcaa7cc1 73dfd805 de0fec16 6a12cb3d 3cc99906 a2205807 f94228f3
Thu Dec 17 16:29:51 2015 candidate x value:
Thu Dec 17 16:29:51 2015 ba26ccac d1c39f80 8af31107 5828511c f67868f5 48b71aef 6581cdbe bf30c0b4
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 H(00:0c:42:18:ee:54 | 00:0c:42:18:d1:29, 12345678901234567890 | 17)
Thu Dec 17 16:29:51 2015 ca10583f f0c07285 5f7a71c4 d5be174b b3014d3a a7941cb2 fa041edb a36a8928
Thu Dec 17 16:29:51 2015 candidate x value:
Thu Dec 17 16:29:51 2015 6fdf5124 342cf86d 35f1a8e3 732e7ee5 254c158e 7ba5f189 ff1b232b aa0a2292
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 H(00:0c:42:18:ee:54 | 00:0c:42:18:d1:29, 12345678901234567890 | 18)
Thu Dec 17 16:29:51 2015 904ade4d b1f49995 c85fe1f1 6242c39a 5e80eb72 01a21104 5615f94f 6afd7d62
Thu Dec 17 16:29:51 2015 candidate x value:
Thu Dec 17 16:29:51 2015 a6164d4a ea6a9ddf 9b849c4d 07a53b45 ded7916f e847be5f 3aad785c f57e8f70
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 H(00:0c:42:18:ee:54 | 00:0c:42:18:d1:29, 12345678901234567890 | 19)
Thu Dec 17 16:29:51 2015 3bbac123 a5b5953a 36eeefe9 891b46c8 de0e7d0c 63bd8c96 49ad4af9 8c99ac06
Thu Dec 17 16:29:51 2015 candidate x value:
Thu Dec 17 16:29:51 2015 85bc5835 3cd56f03 54181d3b 5c72b758 e35e97db 8bab4b20 0629fa4c 4adcd3e4
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 H(00:0c:42:18:ee:54 | 00:0c:42:18:d1:29, 12345678901234567890 | 20)
Thu Dec 17 16:29:51 2015 053de62f 32159ace 0a3bcbca 0abcfbe1 b2ec17ec a93474c9 254d17ef 2f0f1b5f
Thu Dec 17 16:29:51 2015 candidate x value:
Thu Dec 17 16:29:51 2015 c90c58a3 bf510068 4a06830c d188f247 b2057279 edb66c60 f9ec9420 501ee181
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 H(00:0c:42:18:ee:54 | 00:0c:42:18:d1:29, 12345678901234567890 | 21)
Thu Dec 17 16:29:51 2015 090537cd e91b23cc d2a2cc9a 77929946 ae0698d3 e43d689d e3b7e7e3 07b4f119
Thu Dec 17 16:29:51 2015 candidate x value:
Thu Dec 17 16:29:51 2015 2178abd5 0fec8eb0 563d819e 2fc8f5a8 b94a6ae6 71ee8a6d c763046f 19813387
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 H(00:0c:42:18:ee:54 | 00:0c:42:18:d1:29, 12345678901234567890 | 22)
Thu Dec 17 16:29:51 2015 844f4c72 99dfd95f 90648a1a 9718d95a 915fc560 2ca4a84a 230d0d75 aa611ad5
Thu Dec 17 16:29:51 2015 candidate x value:
Thu Dec 17 16:29:51 2015 86ce03e7 872fe917 b132349d 5f5749a3 d70e88f9 9c528212 4a13219d 872f8171
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 H(00:0c:42:18:ee:54 | 00:0c:42:18:d1:29, 12345678901234567890 | 23)
Thu Dec 17 16:29:51 2015 4ef98406 4a1b6f53 9a21b190 5c0681a3 46cbb234 250c7efa 753e3a97 ec834e3c
Thu Dec 17 16:29:51 2015 candidate x value:
Thu Dec 17 16:29:51 2015 bef6a42e ec5636fd 82daf680 6bc0ebc9 f4ea01d2 24a8e509 b8fd8ac0 482e188f
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 H(00:0c:42:18:ee:54 | 00:0c:42:18:d1:29, 12345678901234567890 | 24)
Thu Dec 17 16:29:51 2015 085836ca 254a22d7 60ef3ed6 b2285367 007a068a d7908162 feac1312 0288bd0d
Thu Dec 17 16:29:51 2015 candidate x value:
Thu Dec 17 16:29:51 2015 892afefc 6e89a7e6 ae485e8a 185ac9c2 216b1f57 0a9f4670 3d2339d8 1b460f4c
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 H(00:0c:42:18:ee:54 | 00:0c:42:18:d1:29, 12345678901234567890 | 25)
Thu Dec 17 16:29:51 2015 f4da873b 81b81a7b 16f2d896 f41038e5 b5b40cd4 b31d031c 18fec145 d03c3642
Thu Dec 17 16:29:51 2015 candidate x value:
Thu Dec 17 16:29:51 2015 006306c5 6968b337 3bfdab3c 6c5f5f8f 79a58550 d99cfc32 cc8a069f 6c58c2d3
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 H(00:0c:42:18:ee:54 | 00:0c:42:18:d1:29, 12345678901234567890 | 26)
Thu Dec 17 16:29:51 2015 589aad2e 86c577cb 16e64598 5acf9d41 3483dc87 3dba77ee 8ee895ec a54d71b0
Thu Dec 17 16:29:51 2015 candidate x value:
Thu Dec 17 16:29:51 2015 855b9eac a875f8ca 0ea64dd8 c5462994 92177e1d 6e775251 0d50057c 2638a991
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 H(00:0c:42:18:ee:54 | 00:0c:42:18:d1:29, 12345678901234567890 | 27)
Thu Dec 17 16:29:51 2015 ab83629e 18a6d67c edb43179 261c1e09 d3f79f4b 6b422683 69d9383a c0c4c13a
Thu Dec 17 16:29:51 2015 candidate x value:
Thu Dec 17 16:29:51 2015 0cb50d81 ce9ada04 031b5154 8ec558fe 3baee5e8 98da2091 468ea604 20fc1abe
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 H(00:0c:42:18:ee:54 | 00:0c:42:18:d1:29, 12345678901234567890 | 28)
Thu Dec 17 16:29:51 2015 cc7d78b9 10e3e70b 70fbfa32 2dadf46c f39ae21c 64084154 1d17a725 bd29dffe
Thu Dec 17 16:29:51 2015 candidate x value:
Thu Dec 17 16:29:51 2015 6f72bc0d 643f7a13 aa65429c c329edd5 093aa215 c957770f d121eab6 565858d3
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 H(00:0c:42:18:ee:54 | 00:0c:42:18:d1:29, 12345678901234567890 | 29)
Thu Dec 17 16:29:51 2015 31c4785a 66e5cf89 45030bbf 8522e0b1 672feb10 43af8b98 44653042 84a90c90
Thu Dec 17 16:29:51 2015 candidate x value:
Thu Dec 17 16:29:51 2015 732366bc cd0b8173 53463617 0a0563d8 7666a73c 39a3aa75 58a8b61f 8c3c456d
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 H(00:0c:42:18:ee:54 | 00:0c:42:18:d1:29, 12345678901234567890 | 30)
Thu Dec 17 16:29:51 2015 e7e96141 0edcce86 335e1f91 4a539518 23c08962 f3b8876a fb10663d c2a78741
Thu Dec 17 16:29:51 2015 candidate x value:
Thu Dec 17 16:29:51 2015 86991126 e446bb60 56e263a6 0c03d793 f3375649 e472a1c9 46ad6413 513e1456
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 H(00:0c:42:18:ee:54 | 00:0c:42:18:d1:29, 12345678901234567890 | 31)
Thu Dec 17 16:29:51 2015 b2d1be42 ef1c32f5 d37fb50f 22dc53ea 2d270309 ebee116c ed1449d4 a9abb2b6
Thu Dec 17 16:29:51 2015 candidate x value:
Thu Dec 17 16:29:51 2015 fcab2b04 b602c521 ff37cdbb 0153d4c0 8ae5d90f 294a2e0b 46f72a34 5907b6fd
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 H(00:0c:42:18:ee:54 | 00:0c:42:18:d1:29, 12345678901234567890 | 32)
Thu Dec 17 16:29:51 2015 b2beca92 698dd443 8956948e 08181e6e f69d9049 c85886d5 32ecd4c2 7ba85c4f
Thu Dec 17 16:29:51 2015 candidate x value:
Thu Dec 17 16:29:51 2015 99579df7 aa7e3c80 128e429c 2b51a710 60874dab 929c81cd eb70a626 be2b20c6
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 H(00:0c:42:18:ee:54 | 00:0c:42:18:d1:29, 12345678901234567890 | 33)
Thu Dec 17 16:29:51 2015 39cbbe90 365b1628 3a1d2b63 9522b100 c6c2fdd2 b2b661d6 eb7d6a47 cebc1d3d
Thu Dec 17 16:29:51 2015 candidate x value:
Thu Dec 17 16:29:51 2015 c490cb2e ff0a4d3d 3aff70c8 ec2190e4 a7e40d27 6a5acdee c1e9bfc7 4b739fbb
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 H(00:0c:42:18:ee:54 | 00:0c:42:18:d1:29, 12345678901234567890 | 34)
Thu Dec 17 16:29:51 2015 e33dad8e 2debf4ca 2014b89f f2bfa735 0a649bf3 0c787fd8 ce9375be 51a19279
Thu Dec 17 16:29:51 2015 candidate x value:
Thu Dec 17 16:29:51 2015 b5d8aa10 16aa1578 37196a2d 69ac44b5 f10f7a2f 671c70b0 329e2ffd 4242a7eb
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 H(00:0c:42:18:ee:54 | 00:0c:42:18:d1:29, 12345678901234567890 | 35)
Thu Dec 17 16:29:51 2015 d9e92da1 1786115a a6b9f614 da4b872a c0fb8299 4d071d93 31a0002f 470472af
Thu Dec 17 16:29:51 2015 candidate x value:
Thu Dec 17 16:29:51 2015 e61f0fe7 005eea42 25fe84a3 198e6937 7176df86 612cbefe 1f0e1f2a 3045fb93
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 H(00:0c:42:18:ee:54 | 00:0c:42:18:d1:29, 12345678901234567890 | 36)
Thu Dec 17 16:29:51 2015 ad156d81 7991assigning group 19 to peer, the size of the prime is 32
Thu Dec 17 16:29:51 2015 COMMIT received for unknown peer, committing and confirming
Thu Dec 17 16:29:51 2015 in NOTHING, sending COMMIT (no token), len 128, group 19
Thu Dec 17 16:29:51 2015 in NOTHING, sending CONFIRM (sc=1), len 64
Thu Dec 17 16:29:51 2015 state of 00:0c:42:18:d1:29 is now (2) CONFIRMED
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 ef44 e612b7e8 29c3eae9 e3f8fea1 484ffece 12ae24ad 0fe24eb2
Thu Dec 17 16:29:51 2015 candidate x value:
Thu Dec 17 16:29:51 2015 96a74657 a01c146b b4c0e136 15cd799d a6b10064 0842fe8e 1abb3bbd fda60c25
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 H(00:0c:42:18:ee:54 | 00:0c:42:18:d1:29, 12345678901234567890 | 37)
Thu Dec 17 16:29:51 2015 dd2516c9 0ea4464f 2a7db749 6030504a af4898cb 055d7724 4ec5a750 dcb5c38d
Thu Dec 17 16:29:51 2015 candidate x value:
Thu Dec 17 16:29:51 2015 8f8c3d29 e94f5e96 3c2e7ad5 ab301326 68f5c946 12049a31 bee3cd49 46cd5695
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 H(00:0c:42:18:ee:54 | 00:0c:42:18:d1:29, 12345678901234567890 | 38)
Thu Dec 17 16:29:51 2015 b911b2a7 ffd25251 dcd1171d e6b81c13 cdf6c2d0 a0fcc34e 2a4f44f8 da159bef
Thu Dec 17 16:29:51 2015 candidate x value:
Thu Dec 17 16:29:51 2015 bf141d6d afe2b873 7598aba2 5325df58 9c0cef21 ed8def71 dcde78f9 6326d932
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 H(00:0c:42:18:ee:54 | 00:0c:42:18:d1:29, 12345678901234567890 | 39)
Thu Dec 17 16:29:51 2015 fb55b1e2 0812786f aebf07c3 4c2070fd 7d4b9787 2428ed6c ea207813 3487be3e
Thu Dec 17 16:29:51 2015 candidate x value:
Thu Dec 17 16:29:51 2015 066479b0 903e2fe8 396ac005 7bc79d74 84722ade 28fb578c d8871ece 0fbdeb0c
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 H(00:0c:42:18:ee:54 | 00:0c:42:18:d1:29, 12345678901234567890 | 40)
Thu Dec 17 16:29:51 2015 873006b5 bcc79a62 73345447 177b6022 ccd87b59 bee23c2b 74cfcce6 d5429165
Thu Dec 17 16:29:51 2015 candidate x value:
Thu Dec 17 16:29:51 2015 46fc5e12 4da8cb38 2b1d8c1a 59919c98 aea1de9c e7eb4193 14f7248b f1c0c972
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 PWE (x,y):
Thu Dec 17 16:29:51 2015 x:
Thu Dec 17 16:29:51 2015 c38aadd9 f7ad5179 48ef200c 9a67164b 8da61648 a604585a 5b23e954 8e738116
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 y:
Thu Dec 17 16:29:51 2015 9ff33e78 4fdf58e1 6f96cd1e 0eab3c51 758db660 d9ccbad9 96128004 b69a27e7
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 local private value:
Thu Dec 17 16:29:51 2015 516aaec4 317eab98 9eb9463c 1d3af516 2cd3845e 1b2c459a 1dc043d8 29c862cd
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 local mask value:
Thu Dec 17 16:29:51 2015 f5b6e1ad c2ebf38d ce9b31f4 62efe091 bbf3143b eef91a8a ffe291d0 59bfcab7
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 local commit:
Thu Dec 17 16:29:51 2015 my scalar:
Thu Dec 17 16:29:51 2015 47219072 f46a9f25 6d547830 802ad5a8 2bdf9dec 630dc1a0 29e90ae5 87250833
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 my element:
Thu Dec 17 16:29:51 2015 x:
Thu Dec 17 16:29:51 2015 cfc8156d 96ca6ea1 d3c2c40a cf2aec44 c4e19f28 c7f7bb97 fd8503d2 2a0a0b7b
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 y:
Thu Dec 17 16:29:51 2015 bb2311f8 f5c86495 a712b172 a529d1b4 6642fcb4 bdf3163c c3f47c4c 1c18112c
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 peer's commit:
Thu Dec 17 16:29:51 2015 peer's scalar:
Thu Dec 17 16:29:51 2015 e6cdef78 845e1d92 a796c5dc 49aa09d4 42781704 055fc816 fc30b56a 08c3ee44
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 peer's element:
Thu Dec 17 16:29:51 2015 x:
Thu Dec 17 16:29:51 2015 67dfd16b facc4cd4 0dccd303 6ff088c8 ee67b99c 07f344e7 82263815 e2b5d068
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 y:
Thu Dec 17 16:29:51 2015 c2424ec1 6bc3ea7f 5beb1279 27abceea e0448100 c3827248 1084fa00 1aa82f3b
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 k:
Thu Dec 17 16:29:51 2015 35e52ac2 d42c75ed 43881eb0 29f73f9c 4339cb35 bc1015b6 09bd6a29 2a6271b1
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 keyseed:
Thu Dec 17 16:29:51 2015 fe48f7d2 280dd31a 93e1523c 1afdafe5 8b98b441 df6ccc04 d2f40364 f2561fc2
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 KCK:
Thu Dec 17 16:29:51 2015 7fd9cf2a 962a5550 101e635d 45269776 d77910db e185c133 55bb9107 8ecaf29a
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 PMK:
Thu Dec 17 16:29:51 2015 9a8296d7 191ff800 0d44cd8f 56133800 9e98ffdb ae309620 87a24c6a 360ef658
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 local confirm:
Thu Dec 17 16:29:51 2015 01004cfe c59d8409 c3b4488e d42d946e 54f83071 4bb21d86 5581d420 4b58cb45
Thu Dec 17 16:29:51 2015 b4a9
Thu Dec 17 16:29:51 2015
Thu Dec 17 16:29:51 2015 nlerror, cmd 19, seq 1450369826: File exists
Thu Dec 17 16:29:52 2015 recv'd CONFIRM from 00:0c:42:18:d1:29 while in CONFIRMED
Thu Dec 17 16:29:52 2015 processing confirm (1)
Thu Dec 17 16:29:52 2015 peer in CONFIRMED has just ACCEPTED, found another in ACCEPTED, deleting
Thu Dec 17 16:29:52 2015 deleting peer at 00:0c:42:18:d1:29 in state ACCEPTED
Thu Dec 17 16:29:52 2015 setting reauth timer for 3600 seconds
Thu Dec 17 16:29:52 2015 state of 00:0c:42:18:d1:29 is now (3) ACCEPTED
Thu Dec 17 16:29:52 2015
Thu Dec 17 16:29:52 2015 peer's confirm:
Thu Dec 17 16:29:52 2015 0100fd98 3872e656 a9b8c7d3 303d85bf 40251536 62859698 025f18ad 194a50c6
Thu Dec 17 16:29:52 2015 599f
Thu Dec 17 16:29:52 2015
Thu Dec 17 16:29:52 2015 PMK:
Thu Dec 17 16:29:52 2015 9a8296d7 191ff800 0d44cd8f 56133800 9e98ffdb ae309620 87a24c6a 360ef658
Thu Dec 17 16:29:52 2015
Thu Dec 17 16:29:52 2015 nlerror, cmd 18, seq 1450369839: Invalid argument

from authsae.

The memory leak is in install_key.
I added a debug msg for each alloc and free in this function.
msg is not freed.

Mon Dec 21 12:05:37 2015 set plink state (seq num=1450699574)
Mon Dec 21 12:05:37 2015 estab with 00:0c:42:18:ee:54
Mon Dec 21 12:05:37 2015 set auth flag (seq num=1450699575)
Mon Dec 21 12:05:37 2015 nlmsg_alloc msg
Mon Dec 21 12:05:37 2015 nlmsg_alloc key
Mon Dec 21 12:05:37 2015 nlmsg_free key
Mon Dec 21 12:05:37 2015 nlmsg_alloc msg
Mon Dec 21 12:05:37 2015 nlmsg_alloc key
Mon Dec 21 12:05:37 2015 nlmsg_free key
Mon Dec 21 12:05:37 2015 nlmsg_alloc msg
Mon Dec 21 12:05:37 2015 nlmsg_alloc key
Mon Dec 21 12:05:37 2015 nlmsg_free key
Mon Dec 21 12:05:37 2015 nlerror, cmd 18, seq 1450699579: Invalid argument
Mon Dec 21 12:05:37 2015 NL80211_CMD_TX_STATUS (1450699537.301858)

from authsae.

On Mon, Dec 21, 2015 at 04:09:27AM -0800, tecoboot wrote:

The memory leak is in install_key.
I added a debug msg for each alloc and free in this function.
msg is not freed.

send_nlmsg() frees msg... not very intuitive, I'll grant you.

The error paths in install_key are a mess, but aside from this:

msg = nlmsg_alloc();
key = nlmsg_alloc();
if (!msg || !key)
    return -ENOMEM

...I'm not seeing any other leaks.

Bob Copeland %% http://bobcopeland.com/

from authsae.

I'm not even a C beginner.
But why has nla_put_failure a nlmsg_free(msg), while other return's have not?

from authsae.

Maybe get rid of the two warnings first, and see if leaks disappeared too?

from authsae.

Because nla_put_failure means send_nlmsg() was not called. Yes, it would be much cleaner if send_nlmsg didn't free msg and then the error and success path would look the same.

Anyway, this fixes that one leak:

0001-install_key-clean-up-error-handling.txt

from authsae.

Posted separate issue for memory leak, so this one is for the two nl errors.

from authsae.

I tried to find the reason for the nl errors. It looks to me the errors are responses on nl commands that were applied earlier, in separate thread. I guess the errors are not provided as return codes, but as asynchronous nl reply messages. Right?

Because the frequency of errors is influenced by key lifetime, it is related.

I added simple debug lines on various places, to verify where the errors come from. See attachment.

I think the error on cmd 19 (top of logfile) is from peer_created, timer initiated. I don't understand why this function is called for existing peers.

I think the error on cmd 18 (bottom of logfile) is from set_supported_rates. I don't understand why a key refresh would need adjusting rates.

authsae-issue22-details.txt

from authsae.

I believe 18 is NL80211_ATTR_STA_LISTEN_INTERVAL and 19 is NL80211_ATTR_STA_SUPPORTED_RATES. Pretty sure the code for those two calls has been added in 2011, and the following patch showed up in 2012 - http://marc.info/?l=linux-wireless&m=135712403121537&w=2 Essentially, mac80211 will refuse to accept those two commands if VIF is not in AP mode. Perhaps we should remove both of these calls.
Edit: oops, I must have been thinking of a different patch I came across earlier. Still, we should consider removing these calls, especially in light that they are called on existing stations.

from authsae.

There's also this patch that added them back to mac80211 for stations that have been created but not yet in associated state - it went in fairly recently. http://www.spinics.net/lists/linux-wireless/msg142702.html
Which kernel are you on?

from authsae.

For reference, running trunk of OpenWRT with mac80211 from early December I only get errors on 18 (NL80211_ATTR_STA_SUPPORTED_RATES) but not 19 as I would expect given the patch in October.

from authsae.

I currently use kernel 4.1.15 (latest longterm). 4.2.6 has same issue.

root@R-090:/authsae# uname -r
4.1.15-486
root@R-090:/authsae# dpkg -l | grep libnl
ii libnl-3-200:i386 3.2.24-2 i386 library for dealing with netlink sockets
ii libnl-genl-3-200:i386 3.2.24-2 i386 library for dealing with netlink sockets - generic netlink
ii libnl-route-3-200:i386 3.2.24-2 i386 library for dealing with netlink sockets - route interface

Are those two calls needed for fist creation of peers?

from authsae.

This patch (dec 2012) blocks updates of existing stations:
torvalds/linux@ba23d20

The cmd 18 error can be fixed with attached patch, removing the set_supported_rates functions and skip the call in estab_peer_link. No side effects seen yet.
solve-error-netlink-cmd-18.patch.txt

Fixing cmd 19 is harder, it looks like process_authentication_frame as "new peer" is called when a peer restarted the sae procedure (e.g. ifdown wlan0 ; ifup wlan0 ).
Maybe add a sae_reinit flag in candidate structure, so LISTEN_INTERVAL and SUPPORTED_RATES updates in peer_created function are suppressed?

from authsae.

I have no problem with solve-error-netlink-cmd-18.patch.txt patch. As far as 19, I guess your approach of having a flag doesn't sound too bad. We could also add another parameter for create_candidate() that indicates if it was called for an existing station, like for example in do_reauth, vs say handle_new_station (that parameter is then passed on to peer_created to suppress LISTEN_INTERVAL and SUPPORTED_RATES calls or not).

from authsae.

@alexgrin The recent patch you talk about is e4208427247ecc7306c8f71ab3c5c08e08cf9fda (in upstream Linux)

from authsae.

I've submitted PR #27 to fix netlink error 18

from authsae.

I'm not deep enough into the code to fix netlink error 19, I'll leave that up to you guys/gals

from authsae.

Tested the PR #27, results are great !!

Only error 19 left for improvement.

Edited: first see if memory leak is solved...

from authsae.

This is in essence what I was thinking about - it compiles, but I don't know if it works.

error-cmd-19-possible-fix.patch.txt

from authsae.

It is not working, I'll try to debug.

from authsae.

The flag works. I changed the debug line based on is_new.

The nl call in peer_created is the problem, in output below the call with seqno 1452242306 results in the error.

ret = send_nlmsg(nlcfg.nl_sock, msg);
if (is_new)
sae_debug(MESHD_DEBUG, "New peer candidate " MACSTR " (seq num=%d)\n",
    MAC2STR(peer),
        nlmsg_hdr(msg)->nlmsg_seq);
else
    sae_debug(MESHD_DEBUG, "Existing peer candidate " MACSTR " (seq num=%d)\n",
    MAC2STR(peer),
        nlmsg_hdr(msg)->nlmsg_seq);

Existing peer candidate 00:0c:42:18:d1:29 (seq num=1452242306)
recv'd COMMIT from 00:0c:42:18:d1:29 while in NOTHING
assigning group 19 to peer, the size of the prime is 32
COMMIT received for unknown peer 00:0c:42:18:d1:29, committing and confirming
peer 00:0c:42:18:d1:29 in NOTHING, sending COMMIT (no token), len 128, group 19
tx_frame(0x805f400, 0xbef1f640, 128)
tx frame (seq num=1452242307)
----------
tx frame hexdump
00000000  b0 00 00 00 00 0c 42 18 d1 29 4c 5e 0c 13 bd ca 
00000010  00 0c 42 18 d1 29 00 00 03 00 01 00 00 00 13 00 
00000020  0d 56 2a db f9 2d cf 2f 03 c3 ec 5c b2 7a 03 7c 
00000030  8b df 88 de 1c f1 a8 5c 8e 87 ac 03 c3 75 a6 6b 
00000040  1b fa 62 76 26 8a b6 44 18 e2 7a 31 bf 69 a9 7c 
00000050  2f 77 ee 1f 39 c3 14 6d a2 0a ce d7 f2 73 17 06 
00000060  2a 4d 3b 32 ca ea ba 34 84 a6 49 fa 07 b9 73 bc 
00000070  06 e8 a8 99 f6 69 2d 45 46 5f 4b a2 5b f9 21 d9 
----------
00:0c:42:18:d1:29 in NOTHING, sending CONFIRM (sc=1), len 64
tx_frame(0x805f400, 0xbef1f64c, 64)
tx frame (seq num=1452242308)
----------
tx frame hexdump
00000000  b0 00 00 00 00 0c 42 18 d1 29 4c 5e 0c 13 bd ca 
00000010  00 0c 42 18 d1 29 00 00 03 00 02 00 00 00 01 00 
00000020  4f 7b 42 90 3d db 8e 87 31 95 e2 1e 23 36 60 44 
00000030  dd 51 db 50 33 4b 74 29 ee 5c 45 4a 4c 65 04 3c 
----------
state of 00:0c:42:18:d1:29 is now (2) CONFIRMED
--4565-- REDIR: 0x42b6970 (libc.so.6:stpcpy) redirected to 0x402f170 (stpcpy)
nlerror, cmd 19, seq 1452242306: Invalid argument

from authsae.

I can't find the reason for the -EINVAL.
Why create a new per with NL80211_CMD_NEW_STATION in the first place? Skipping the nl command doesn't work.
Is there a description on kernel API for secured mesh, with details on how to update the key?

from authsae.

Here's what's going on - when we do reauth, or get a beacon and don't have a struct for that peer, we create a new candidate. Since we're not certain that we have perfect sync between kernel and meshd peer state, we blindly call CMD_NEW_STATION every time just in case. More likely than not it will return -EEXISTS for reauth. Failing to create new station when one exists appears to be harmless, though it generates an error -EEXIST for cmd 19 (CMD_NEW_STATION). It is possible to suppress the error by inserting "nlcfg.supress_error = -EEXIST;" right in front of send_nlmsg in peer_created(). Another way is to interrogate kernel of station existence before issuing CMD_NEW_STATION, but that seems like it will add unnecessary complexity. My previous patch is completely bogus, CMD_NEW_STATION will return -EINVALID if LISTEN_INTERVAL is not specified.

from authsae.

On Sat, Jan 09, 2016 at 03:54:37PM -0800, Alexis Green wrote:

Here's what's going on - when we do reauth, or get a beacon and don't
have a struct for that peer, we create a new candidate. Since we're
not certain that we have perfect sync between kernel and meshd peer
state, we blindly call CMD_NEW_STATION every time just in case. More
likely than not it will return -EEXISTS for reauth. Failing to create
new station when one exists appears to be harmless, though it
generates an error -EEXIST for cmd 19 (CMD_NEW_STATION). It is
possible to suppress the error by inserting "nlcfg.supress_error =
-EEXIST;" right in front of send_nlmsg in peer_created(). Another way
is to interrogate kernel of station existence before issuing
CMD_NEW_STATION, but that seems like it will add unnecessary
complexity. My previous patch is completely bogus, CMD_NEW_STATION
will return -EINVALID if LISTEN_INTERVAL is not specified.

Yes, just inserting the station and ignoring -EEXIST is the right
thing to do. Anything else is susceptible to races.

Bob Copeland %% http://bobcopeland.com/

from authsae.

OK, I better understand now.

Tested on single node. No repeating File exists anymore.

I have a single Fri Jan 15 07:42:43 2016 Unexpected error -22 (expected -17). Could have to do with peer that has a problem.

I have a node that has unidirectional link with two peers.
The peers are missing in kernel (debugfs, iw command).

I see repeating errors:
Fri Jan 15 09:13:15 2016 nlerror, cmd 19, seq 1452872444: Invalid argument
Fri Jan 15 09:13:16 2016 nlerror, cmd 18, seq 1452872447: No such file or directory
Fri Jan 15 09:13:16 2016 nlerror, cmd 18, seq 1452872448: No such file or directory
Fri Jan 15 09:13:16 2016 nlerror, cmd 18, seq 1452872450: No such file or directory
Fri Jan 15 09:13:16 2016 nlerror, cmd 18, seq 1452872452: No such file or directory
Fri Jan 15 09:13:16 2016 nlerror, cmd 18, seq 1452872453: No such file or directory
Fri Jan 15 09:13:16 2016 nlerror, cmd 0, seq 1452872454: No such file or directory
Fri Jan 15 09:13:16 2016 nlerror, cmd 0, seq 1452872455: No such file or directory
Fri Jan 15 09:13:16 2016 nlerror, cmd 0, seq 1452872456: No such file or directory
Fri Jan 15 09:13:17 2016 nlerror, cmd 18, seq 1452872457: No such file or directory
Fri Jan 15 09:13:18 2016 nlerror, cmd 18, seq 1452872458: No such file or directory
Fri Jan 15 09:13:22 2016 nlerror, cmd 18, seq 1452872459: No such file or directory

So something went wrong and adding the peer doesn't work.
I'll reboot all nodes and test again. I'll switch to ath5k nohwcrypt. I did see problems when I tries wpa_supplicant, disabling hwcrypt helped.

from authsae.

OK, much cleaner now. Not in stress test mode yet, lifetime is 3600000 (1000h).

Some messages, probably caused by out-of-sync (restart peers):

peer 1, ath5k:
Fri Jan 15 14:53:43 2016 meshd-nl80211 started
Fri Jan 15 14:53:50 2016 Unexpected error -22 (expected -17)
Fri Jan 15 14:53:50 2016 nlerror, cmd 18, seq 1452869675: Invalid argument
Fri Jan 15 14:53:51 2016 nlerror, cmd 18, seq 1452869678: Invalid argument
peer 2, ath5k:
Fri Jan 15 14:50:45 2016 meshd-nl80211 started
Fri Jan 15 14:50:53 2016 Unexpected error -22 (expected -17)
Fri Jan 15 14:50:53 2016 nlerror, cmd 18, seq 1452869469: Invalid argument
Fri Jan 15 14:50:54 2016 nlerror, cmd 18, seq 1452869472: Invalid argument
peer 3, ath5k:
Fri Jan 15 12:48:22 2016 meshd-nl80211 started
peer 4, ath5k:
Fri Jan 15 15:08:32 2016 meshd-nl80211 started
Fri Jan 15 15:08:36 2016 Unexpected error -22 (expected -17)
Fri Jan 15 15:08:36 2016 nlerror, cmd 18, seq 1452870547: Invalid argument
Fri Jan 15 15:08:36 2016 Unexpected error -22 (expected -17)

peer 5, ath9k:
Fri Jan 15 14:48:59 2016 meshd-nl80211 started
Fri Jan 15 14:48:59 2016 Unexpected error -22 (expected -17)
Fri Jan 15 14:48:59 2016 Unexpected error -22 (expected -17)

peer 6, ath9k:
Fri Jan 15 14:19:30 2016 meshd-nl80211 started

peer 7, ath9k:
Fri Jan 15 14:43:08 2016 meshd-nl80211 started
Fri Jan 15 14:43:11 2016 Unexpected error -22 (expected -17)
Fri Jan 15 14:43:13 2016 Unexpected error -22 (expected -17)

from authsae.

OK, no problems seen so far. The new error messages would have been there before, but were not detected due to the tons of cmd 18 & 19 messages.

Thank you guys !!

from authsae.