after prune the all parameter is 112422,when use huffman_encode,in change to 899388?? @mightydeveloper
--- After Retraining ---
fc1.weight | nonzeros = 107208 / 235200 ( 45.58%) | total_pruned = 127992 | shape = (300, 784)
fc1.bias | nonzeros = 300 / 300 (100.00%) | total_pruned = 0 | shape = (300,)
fc2.weight | nonzeros = 4338 / 30000 ( 14.46%) | total_pruned = 25662 | shape = (100, 300)
fc2.bias | nonzeros = 100 / 100 (100.00%) | total_pruned = 0 | shape = (100,)
fc3.weight | nonzeros = 466 / 1000 ( 46.60%) | total_pruned = 534 | shape = (10, 100)
fc3.bias | nonzeros = 10 / 10 (100.00%) | total_pruned = 0 | shape = (10,)
alive: 112422, pruned : 154188, total: 266610, Compression rate : 2.37x ( 57.83% pruned)
Layer | original compressed improvement percent
----------------------------------------------------------------------
fc1.weight | 858868 176999 4.85x 20.61%
fc1.bias | 1200 1200 1.00x 100.00%
fc2.weight | 35108 7696 4.56x 21.92%
fc2.bias | 400 400 1.00x 100.00%
fc3.weight | 3772 1102 3.42x 29.22%
fc3.bias | 40 40 1.00x 100.00%
----------------------------------------------------------------------
total | 899388 187437 4.80x 20.84%