Nameexact_genome_1542692703_186_6386_2
Workunit4100238
Created20 Nov 2018, 7:02:48 UTC
Sent20 Nov 2018, 7:18:48 UTC
Report deadline25 Mar 2019, 18:33:32 UTC
Received21 Nov 2018, 21:20:42 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID44167
Run time1 days 12 hours 53 min 59 sec
CPU time1 days 11 hours 55 min 14 sec
Validate stateValid
Credit31,367.14
Device peak FLOPS3.88 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size557.27 MB
Peak swap size577.14 MB
Peak disk usage12.20 MB

Stderr output

<core_client_version>7.8.3</core_client_version>
<![CDATA[
<stderr_txt>
0.0000000000, propagate_forward_time: 84.8075332642, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6924438477
validation[          , genome  6386] predictions:    5953/  10000 (59.53%), best:    6096/10000 (60.96%), error:     11625.74902, best error:     11349.41797 on epoch:    13, epoch:   15/100, mu: 0.8247587681, learning_rate: 0.0012049899, weight_decay: 0.0002258876

epoch time: 1150.5535888672s, input_fired_time: 22.2089786530, output_fired_time: 8.9949388504, propagate_forward_time: 417.3477478027, propagate_backward_time: 687.3984375000, weight_update_time: 0.4743043184, other_time: 14.6033935547
epoch time: 104.0908889771s, input_fired_time: 1.2141014338, output_fired_time: 0.0000000000, propagate_forward_time: 100.9707489014, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9060363770
validation[          , genome  6386] predictions:    5834/  10000 (58.34%), best:    6096/10000 (60.96%), error:     11935.29785, best error:     11349.41797 on epoch:    13, epoch:   16/100, mu: 0.8355137706, learning_rate: 0.0011313712, weight_decay: 0.0002155280

epoch time: 1240.6381835938s, input_fired_time: 27.4934234619, output_fired_time: 13.0301322937, propagate_forward_time: 442.2404174805, propagate_backward_time: 736.7457885742, weight_update_time: 0.6342380047, other_time: 21.1284179688
epoch time: 97.3779754639s, input_fired_time: 2.6036689281, output_fired_time: 0.0000000000, propagate_forward_time: 90.4224166870, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.3518905640
validation[          , genome  6386] predictions:    5978/  10000 (59.78%), best:    6096/10000 (60.96%), error:     11641.78613, best error:     11349.41797 on epoch:    13, epoch:   17/100, mu: 0.8455687761, learning_rate: 0.0010622503, weight_decay: 0.0002056434

epoch time: 1204.1252441406s, input_fired_time: 28.0802955627, output_fired_time: 13.1402397156, propagate_forward_time: 430.6032714844, propagate_backward_time: 708.4515380859, weight_update_time: 0.7434008718, other_time: 23.8498535156
epoch time: 91.6935272217s, input_fired_time: 2.4037377834, output_fired_time: 0.0000000000, propagate_forward_time: 84.7905120850, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.4992752075
validation[          , genome  6386] predictions:    6097/  10000 (60.97%), best:    6096/10000 (60.96%), error:     11394.20215, best error:     11349.41797 on epoch:    13, epoch:   18/100, mu: 0.8549693227, learning_rate: 0.0009973523, weight_decay: 0.0001962122

epoch time: 1178.3356933594s, input_fired_time: 27.2475280762, output_fired_time: 12.6042060852, propagate_forward_time: 423.3267822266, propagate_backward_time: 691.3027343750, weight_update_time: 0.7104458809, other_time: 23.8543701172
epoch time: 95.3014678955s, input_fired_time: 2.5759217739, output_fired_time: 0.0000000000, propagate_forward_time: 88.2936248779, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.4319229126
validation[          , genome  6386] predictions:    6038/  10000 (60.38%), best:    6096/10000 (60.96%), error:     11602.54492, best error:     11349.41797 on epoch:    13, epoch:   19/100, mu: 0.8637580276, learning_rate: 0.0009364192, weight_decay: 0.0001872135

epoch time: 1216.4239501953s, input_fired_time: 28.2473449707, output_fired_time: 13.7677936554, propagate_forward_time: 433.6312866211, propagate_backward_time: 716.5964355469, weight_update_time: 0.7397412658, other_time: 24.1810913086
epoch time: 89.6536788940s, input_fired_time: 2.1488649845, output_fired_time: 0.0000000000, propagate_forward_time: 83.2142868042, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.2905273438
validation[          , genome  6386] predictions:    6007/  10000 (60.07%), best:    6096/10000 (60.96%), error:     11601.68750, best error:     11349.41797 on epoch:    13, epoch:   20/100, mu: 0.8719747066, learning_rate: 0.0008792088, weight_decay: 0.0001786276

epoch time: 1157.1365966797s, input_fired_time: 26.6832809448, output_fired_time: 11.9745531082, propagate_forward_time: 417.3791198730, propagate_backward_time: 677.2487182617, weight_update_time: 0.7178604603, other_time: 23.8508911133
epoch time: 89.6279067993s, input_fired_time: 2.1412820816, output_fired_time: 0.0000000000, propagate_forward_time: 83.1969146729, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.2897109985
validation[          , genome  6386] predictions:    5783/  10000 (57.83%), best:    6096/10000 (60.96%), error:     12399.55469, best error:     11349.41797 on epoch:    13, epoch:   21/100, mu: 0.8796566129, learning_rate: 0.0008254937, weight_decay: 0.0001704354

epoch time: 1198.7408447266s, input_fired_time: 27.5342807770, output_fired_time: 12.5941915512, propagate_forward_time: 431.8870544434, propagate_backward_time: 703.1321411133, weight_update_time: 0.7304747105, other_time: 23.5930786133
epoch time: 94.5861282349s, input_fired_time: 2.4474532604, output_fired_time: 0.0000000000, propagate_forward_time: 87.8019485474, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.3367233276
validation[          , genome  6386] predictions:    6115/  10000 (61.15%), best:    6115/10000 (61.15%), error:     11266.74707, best error:     11266.74707 on epoch:    22, epoch:   22/100, mu: 0.8868384957, learning_rate: 0.0007750603, weight_decay: 0.0001626189

epoch time: 1226.6656494141s, input_fired_time: 28.4545516968, output_fired_time: 12.6561450958, propagate_forward_time: 438.3771972656, propagate_backward_time: 723.0486450195, weight_update_time: 0.7037838101, other_time: 24.1290893555
epoch time: 94.8867874146s, input_fired_time: 2.4599411488, output_fired_time: 0.0000000000, propagate_forward_time: 88.2521896362, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.1746597290
validation[          , genome  6386] predictions:    5992/  10000 (59.92%), best:    6115/10000 (61.15%), error:     11517.42578, best error:     11266.74707 on epoch:    22, epoch:   23/100, mu: 0.8935529590, learning_rate: 0.0007277082, weight_decay: 0.0001551608

epoch time: 1231.6374511719s, input_fired_time: 28.4417457581, output_fired_time: 13.3578290939, propagate_forward_time: 438.2966918945, propagate_backward_time: 727.4066162109, weight_update_time: 0.7278532386, other_time: 24.1345825195
epoch time: 92.4568023682s, input_fired_time: 2.4032251835, output_fired_time: 0.0000000000, propagate_forward_time: 85.6306686401, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.4229049683
validation[          , genome  6386] predictions:    6092/  10000 (60.92%), best:    6115/10000 (61.15%), error:     11268.66113, best error:     11266.74707 on epoch:    22, epoch:   24/100, mu: 0.8998304009, learning_rate: 0.0006832490, weight_decay: 0.0001480449

epoch time: 1177.7064208984s, input_fired_time: 27.3955879211, output_fired_time: 12.1327238083, propagate_forward_time: 423.9183654785, propagate_backward_time: 690.4763183594, weight_update_time: 0.7186911702, other_time: 23.7834472656
epoch time: 92.3616638184s, input_fired_time: 2.4170563221, output_fired_time: 0.0000000000, propagate_forward_time: 85.5138168335, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.4307937622
validation[          , genome  6386] predictions:    6272/  10000 (62.72%), best:    6272/10000 (62.72%), error:     10861.58008, best error:     10861.58008 on epoch:    25, epoch:   25/100, mu: 0.9056992531, learning_rate: 0.0006415060, weight_decay: 0.0001412552

epoch time: 1246.2872314453s, input_fired_time: 29.2364997864, output_fired_time: 13.7468910217, propagate_forward_time: 445.5046386719, propagate_backward_time: 733.8668823242, weight_update_time: 0.7145952582, other_time: 23.9323120117
epoch time: 96.0145263672s, input_fired_time: 2.6562263966, output_fired_time: 0.0000000000, propagate_forward_time: 88.9857330322, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.3725662231
validation[          , genome  6386] predictions:    6128/  10000 (61.28%), best:    6272/10000 (62.72%), error:     11106.71582, best error:     10861.58008 on epoch:    25, epoch:   26/100, mu: 0.9111860991, learning_rate: 0.0006023133, weight_decay: 0.0001347770

epoch time: 1181.2506103516s, input_fired_time: 27.4434032440, output_fired_time: 12.3428516388, propagate_forward_time: 424.4778747559, propagate_backward_time: 693.5081176758, weight_update_time: 0.7055340409, other_time: 23.4783325195
epoch time: 90.3026809692s, input_fired_time: 2.2080209255, output_fired_time: 0.0000000000, propagate_forward_time: 83.8480834961, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.2465744019
validation[          , genome  6386] predictions:    6218/  10000 (62.18%), best:    6272/10000 (62.72%), error:     10889.68750, best error:     10861.58008 on epoch:    25, epoch:   27/100, mu: 0.9163158536, learning_rate: 0.0005655151, weight_decay: 0.0001285959

epoch time: 1183.1621093750s, input_fired_time: 27.6791248322, output_fired_time: 12.3800792694, propagate_forward_time: 425.4642028809, propagate_backward_time: 694.0454101563, weight_update_time: 0.7223277688, other_time: 23.5932617188
epoch time: 94.6507644653s, input_fired_time: 2.5173878670, output_fired_time: 0.0000000000, propagate_forward_time: 87.8285446167, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.3048324585
validation[          , genome  6386] predictions:    6135/  10000 (61.35%), best:    6272/10000 (62.72%), error:     11284.02344, best error:     10861.58008 on epoch:    25, epoch:   28/100, mu: 0.9211117029, learning_rate: 0.0005309650, weight_decay: 0.0001226982

epoch time: 1226.5892333984s, input_fired_time: 28.3688526154, output_fired_time: 12.8126077652, propagate_forward_time: 438.7625122070, propagate_backward_time: 722.8703002930, weight_update_time: 0.7120581269, other_time: 23.7749023438
epoch time: 94.8513336182s, input_fired_time: 2.3864796162, output_fired_time: 0.0000000000, propagate_forward_time: 88.2602462769, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.2046051025
validation[          , genome  6386] predictions:    6129/  10000 (61.29%), best:    6272/10000 (62.72%), error:     11242.10254, best error:     10861.58008 on epoch:    25, epoch:   29/100, mu: 0.9255954027, learning_rate: 0.0004985259, weight_decay: 0.0001170710

epoch time: 1214.2088623047s, input_fired_time: 27.6566429138, output_fired_time: 11.8775072098, propagate_forward_time: 437.0483398438, propagate_backward_time: 714.1015625000, weight_update_time: 0.7171683908, other_time: 23.5247802734
epoch time: 94.4831619263s, input_fired_time: 2.3645715714, output_fired_time: 0.0000000000, propagate_forward_time: 87.8939666748, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.2246246338
validation[          , genome  6386] predictions:    6051/  10000 (60.51%), best:    6272/10000 (62.72%), error:     11420.33789, best error:     10861.58008 on epoch:    25, epoch:   30/100, mu: 0.9297872782, learning_rate: 0.0004680685, weight_decay: 0.0001117019

epoch time: 1182.5117187500s, input_fired_time: 25.2300262451, output_fired_time: 10.7266654968, propagate_forward_time: 427.8957824707, propagate_backward_time: 698.0877075195, weight_update_time: 0.6194249988, other_time: 20.5715942383
epoch time: 89.9601287842s, input_fired_time: 2.1706674099, output_fired_time: 0.0000000000, propagate_forward_time: 83.5508041382, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.2386550903
validation[          , genome  6386] predictions:    6201/  10000 (62.01%), best:    6272/10000 (62.72%), error:     10919.56836, best error:     10861.58008 on epoch:    25, epoch:   31/100, mu: 0.9337063432, learning_rate: 0.0004394720, weight_decay: 0.0001065790

epoch time: 1164.6351318359s, input_fired_time: 27.1403026581, output_fired_time: 12.1529788971, propagate_forward_time: 419.4830627441, propagate_backward_time: 682.1849975586, weight_update_time: 0.7177739739, other_time: 23.6738891602
epoch time: 91.2901077271s, input_fired_time: 2.1717696190, output_fired_time: 0.0000000000, propagate_forward_time: 84.8159942627, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.3023452759
validation[          , genome  6386] predictions:    6247/  10000 (62.47%), best:    6272/10000 (62.72%), error:     10965.04199, best error:     10861.58008 on epoch:    25, epoch:   32/100, mu: 0.9373703003, learning_rate: 0.0004126225, weight_decay: 0.0001016911

epoch time: 1190.7110595703s, input_fired_time: 28.1570892334, output_fired_time: 12.6321172714, propagate_forward_time: 426.9545593262, propagate_backward_time: 699.2716064453, weight_update_time: 0.7173701525, other_time: 23.6956787109
epoch time: 92.2614288330s, input_fired_time: 2.3995671272, output_fired_time: 0.0000000000, propagate_forward_time: 85.8663558960, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9955062866
validation[          , genome  6386] predictions:    6187/  10000 (61.87%), best:    6272/10000 (62.72%), error:     11118.47754, best error:     10861.58008 on epoch:    25, epoch:   33/100, mu: 0.9407957792, learning_rate: 0.0003874134, weight_decay: 0.0000970274

epoch time: 1191.7326660156s, input_fired_time: 27.7432785034, output_fired_time: 12.2313137054, propagate_forward_time: 428.7991333008, propagate_backward_time: 699.3887939453, weight_update_time: 0.7140006423, other_time: 23.5701293945
epoch time: 92.7851409912s, input_fired_time: 2.3546745777, output_fired_time: 0.0000000000, propagate_forward_time: 86.1149978638, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.3154678345
validation[          , genome  6386] predictions:    6105/  10000 (61.05%), best:    6272/10000 (62.72%), error:     11170.25977, best error:     10861.58008 on epoch:    25, epoch:   34/100, mu: 0.9439983368, learning_rate: 0.0003637445, weight_decay: 0.0000925775

epoch time: 1195.5764160156s, input_fired_time: 27.6347732544, output_fired_time: 12.0062904358, propagate_forward_time: 432.8602905273, propagate_backward_time: 699.5699462891, weight_update_time: 0.7286289930, other_time: 23.5050659180
epoch time: 95.1066513062s, input_fired_time: 2.4672219753, output_fired_time: 0.0000000000, propagate_forward_time: 88.4498443604, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.1895828247
validation[          , genome  6386] predictions:    6352/  10000 (63.52%), best:    6352/10000 (63.52%), error:     10630.91016, best error:     10630.91016 on epoch:    35, epoch:   35/100, mu: 0.9469924569, learning_rate: 0.0003415216, weight_decay: 0.0000883317

epoch time: 1211.6584472656s, input_fired_time: 28.5729312897, output_fired_time: 12.7611627579, propagate_forward_time: 439.6016540527, propagate_backward_time: 706.9429931641, weight_update_time: 0.7338181734, other_time: 23.7797851563
epoch time: 97.7970809937s, input_fired_time: 2.6551611423, output_fired_time: 0.0000000000, propagate_forward_time: 90.7465133667, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.3954086304
validation[          , genome  6386] predictions:    6232/  10000 (62.32%), best:    6352/10000 (63.52%), error:     10799.42480, best error:     10630.91016 on epoch:    35, epoch:   36/100, mu: 0.9497916698, learning_rate: 0.0003206564, weight_decay: 0.0000842807

epoch time: 1240.2349853516s, input_fired_time: 29.4208488464, output_fired_time: 13.7138729095, propagate_forward_time: 445.1048583984, propagate_backward_time: 728.2352294922, weight_update_time: 0.7239596844, other_time: 23.7601318359
epoch time: 94.8370590210s, input_fired_time: 2.5579431057, output_fired_time: 0.0000000000, propagate_forward_time: 88.0422668457, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.2368469238
validation[          , genome  6386] predictions:    6268/  10000 (62.68%), best:    6352/10000 (63.52%), error:     10899.57617, best error:     10630.91016 on epoch:    35, epoch:   37/100, mu: 0.9524087310, learning_rate: 0.0003010659, weight_decay: 0.0000804154

epoch time: 1258.6973876953s, input_fired_time: 29.5060787201, output_fired_time: 13.6356515884, propagate_forward_time: 453.3435974121, propagate_backward_time: 738.9027099609, weight_update_time: 0.7149344087, other_time: 23.3093261719
epoch time: 98.7755203247s, input_fired_time: 2.7874464989, output_fired_time: 0.0000000000, propagate_forward_time: 91.5340270996, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.4540481567
validation[          , genome  6386] predictions:    6214/  10000 (62.14%), best:    6352/10000 (63.52%), error:     10908.57324, best error:     10630.91016 on epoch:    35, epoch:   38/100, mu: 0.9548554420, learning_rate: 0.0002826724, weight_decay: 0.0000767274

epoch time: 1263.6638183594s, input_fired_time: 29.5977344513, output_fired_time: 13.4071063995, propagate_forward_time: 454.6411743164, propagate_backward_time: 742.0093383789, weight_update_time: 0.7261098623, other_time: 24.0084228516
epoch time: 96.5946655273s, input_fired_time: 2.5840768814, output_fired_time: 0.0000000000, propagate_forward_time: 89.8562927246, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.1542968750
validation[          , genome  6386] predictions:    6267/  10000 (62.67%), best:    6352/10000 (63.52%), error:     10863.33691, best error:     10630.91016 on epoch:    35, epoch:   39/100, mu: 0.9571428895, learning_rate: 0.0002654025, weight_decay: 0.0000732085

epoch time: 1235.8298339844s, input_fired_time: 28.6188850403, output_fired_time: 13.2731637955, propagate_forward_time: 439.4444274902, propagate_backward_time: 730.6975097656, weight_update_time: 0.7068237662, other_time: 23.7957763672
epoch time: 90.5004577637s, input_fired_time: 2.2177085876, output_fired_time: 0.0000000000, propagate_forward_time: 84.0760726929, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.2066726685
validation[          , genome  6386] predictions:    6337/  10000 (63.37%), best:    6337/10000 (63.37%), error:     10628.15234, best error:     10628.15234 on epoch:    40, epoch:   40/100, mu: 0.9592814445, learning_rate: 0.0002491878, weight_decay: 0.0000698510

epoch time: 1178.7617187500s, input_fired_time: 27.4202537537, output_fired_time: 12.1231584549, propagate_forward_time: 422.9984130859, propagate_backward_time: 692.2828369141, weight_update_time: 0.7212753296, other_time: 23.9370117188
epoch time: 90.5819931030s, input_fired_time: 2.2426481247, output_fired_time: 0.0000000000, propagate_forward_time: 84.1404113770, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.1989364624
validation[          , genome  6386] predictions:    6321/  10000 (63.21%), best:    6321/10000 (63.21%), error:     10500.37305, best error:     10500.37305 on epoch:    41, epoch:   41/100, mu: 0.9612808228, learning_rate: 0.0002339637, weight_decay: 0.0000666475

epoch time: 1222.8197021484s, input_fired_time: 29.2698287964, output_fired_time: 13.6455669403, propagate_forward_time: 435.8034667969, propagate_backward_time: 719.2325439453, weight_update_time: 0.7531126142, other_time: 24.8684082031
epoch time: 94.7248611450s, input_fired_time: 2.4230442047, output_fired_time: 0.0000000000, propagate_forward_time: 87.9308776855, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.3709411621
validation[          , genome  6386] predictions:    6137/  10000 (61.37%), best:    6321/10000 (63.21%), error:     11206.25586, best error:     10500.37305 on epoch:    41, epoch:   42/100, mu: 0.9631500840, learning_rate: 0.0002196698, weight_decay: 0.0000635909

epoch time: 1192.0484619141s, input_fired_time: 28.8064403534, output_fired_time: 13.1826934814, propagate_forward_time: 426.8701477051, propagate_backward_time: 697.7949829102, weight_update_time: 0.7771593332, other_time: 25.3942260742
epoch time: 93.6131668091s, input_fired_time: 2.4145376682, output_fired_time: 0.0000000000, propagate_forward_time: 86.5737609863, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.6248703003
validation[          , genome  6386] predictions:    6246/  10000 (62.46%), best:    6321/10000 (63.21%), error:     10759.70898, best error:     10500.37305 on epoch:    41, epoch:   43/100, mu: 0.9648976326, learning_rate: 0.0002062491, weight_decay: 0.0000606745

epoch time: 1209.8334960938s, input_fired_time: 29.5454196930, output_fired_time: 13.7410297394, propagate_forward_time: 431.9060058594, propagate_backward_time: 709.1417846680, weight_update_time: 0.7677961588, other_time: 25.4992065430
epoch time: 95.5031433105s, input_fired_time: 2.6955535412, output_fired_time: 0.0000000000, propagate_forward_time: 88.0853500366, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.7222366333
validation[          , genome  6386] predictions:    6310/  10000 (63.10%), best:    6321/10000 (63.21%), error:     10615.60840, best error:     10500.37305 on epoch:    41, epoch:   44/100, mu: 0.9665314555, learning_rate: 0.0001936483, weight_decay: 0.0000578919

epoch time: 1231.7141113281s, input_fired_time: 29.7123889923, output_fired_time: 13.9599571228, propagate_forward_time: 439.0576782227, propagate_backward_time: 723.1605224609, weight_update_time: 0.7753674388, other_time: 25.8235473633
epoch time: 92.3586425781s, input_fired_time: 2.5505826473, output_fired_time: 0.0000000000, propagate_forward_time: 85.1462402344, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.6618194580
validation[          , genome  6386] predictions:    6383/  10000 (63.83%), best:    6321/10000 (63.21%), error:     10525.87109, best error:     10500.37305 on epoch:    41, epoch:   45/100, mu: 0.9680589437, learning_rate: 0.0001818174, weight_decay: 0.0000552368

epoch time: 1201.3936767578s, input_fired_time: 28.9130973816, output_fired_time: 13.2661676407, propagate_forward_time: 428.0910949707, propagate_backward_time: 703.8555297852, weight_update_time: 0.8257622719, other_time: 27.2678833008
epoch time: 93.0502319336s, input_fired_time: 2.5690014362, output_fired_time: 0.0000000000, propagate_forward_time: 85.6552124023, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.8260192871
validation[          , genome  6386] predictions:    6371/  10000 (63.71%), best:    6321/10000 (63.21%), error:     10589.48828, best error:     10500.37305 on epoch:    41, epoch:   46/100, mu: 0.9694870114, learning_rate: 0.0001707093, weight_decay: 0.0000527036

epoch time: 1203.8127441406s, input_fired_time: 28.7502689362, output_fired_time: 13.3757228851, propagate_forward_time: 428.6239013672, propagate_backward_time: 706.0198974609, weight_update_time: 0.7938598990, other_time: 27.0429687500
epoch time: 93.0896606445s, input_fired_time: 2.4847052097, output_fired_time: 0.0000000000, propagate_forward_time: 85.7981033325, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.8068542480
validation[          , genome  6386] predictions:    6370/  10000 (63.70%), best:    6321/10000 (63.21%), error:     10638.32227, best error:     10500.37305 on epoch:    41, epoch:   47/100, mu: 0.9708221555, learning_rate: 0.0001602799, weight_decay: 0.0000502865

epoch time: 1204.1765136719s, input_fired_time: 27.8927841187, output_fired_time: 13.2440071106, propagate_forward_time: 428.6034851074, propagate_backward_time: 708.0151367188, weight_update_time: 0.7721642256, other_time: 26.4210205078
epoch time: 93.0194549561s, input_fired_time: 2.5121097565, output_fired_time: 0.0000000000, propagate_forward_time: 85.7171325684, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.7902145386
validation[          , genome  6386] predictions:    6367/  10000 (63.67%), best:    6321/10000 (63.21%), error:     10508.31641, best error:     10500.37305 on epoch:    41, epoch:   48/100, mu: 0.9720703959, learning_rate: 0.0001504876, weight_decay: 0.0000479803

epoch time: 1203.0302734375s, input_fired_time: 27.8824691772, output_fired_time: 13.3948535919, propagate_forward_time: 428.1964721680, propagate_backward_time: 706.8425903320, weight_update_time: 0.7675053477, other_time: 26.7138671875
epoch time: 93.2993392944s, input_fired_time: 2.4909837246, output_fired_time: 0.0000000000, propagate_forward_time: 85.9804916382, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.8278656006
validation[          , genome  6386] predictions:    6361/  10000 (63.61%), best:    6361/10000 (63.61%), error:     10477.68066, best error:     10477.68066 on epoch:    49, epoch:   49/100, mu: 0.9732373953, learning_rate: 0.0001412936, weight_decay: 0.0000457798

epoch time: 1202.2806396484s, input_fired_time: 28.0435066223, output_fired_time: 13.4879131317, propagate_forward_time: 428.0866394043, propagate_backward_time: 706.1004028320, weight_update_time: 0.7726485729, other_time: 26.5621948242
epoch time: 93.0256500244s, input_fired_time: 2.5511879921, output_fired_time: 0.0000000000, propagate_forward_time: 85.6315841675, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.8428802490
validation[          , genome  6386] predictions:    6357/  10000 (63.57%), best:    6361/10000 (63.61%), error:     10579.01660, best error:     10477.68066 on epoch:    49, epoch:   50/100, mu: 0.9743283987, learning_rate: 0.0001326613, weight_decay: 0.0000436802

epoch time: 1197.3891601563s, input_fired_time: 28.2260589600, output_fired_time: 12.9387302399, propagate_forward_time: 428.0855102539, propagate_backward_time: 701.9948120117, weight_update_time: 0.7647577524, other_time: 26.1440429688
epoch time: 80.7433471680s, input_fired_time: 1.1650912762, output_fired_time: 0.0000000000, propagate_forward_time: 77.8368530273, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7414016724
validation[          , genome  6386] predictions:    6424/  10000 (64.24%), best:    6424/10000 (64.24%), error:     10404.65527, best error:     10404.65527 on epoch:    51, epoch:   51/100, mu: 0.9753484130, learning_rate: 0.0001245563, weight_decay: 0.0000416770

epoch time: 1056.6318359375s, input_fired_time: 19.1203956604, output_fired_time: 6.7351922989, propagate_forward_time: 389.2412414551, propagate_backward_time: 631.1705932617, weight_update_time: 0.3310855627, other_time: 10.3644409180
epoch time: 80.6976242065s, input_fired_time: 1.1612393856, output_fired_time: 0.0000000000, propagate_forward_time: 77.8115463257, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7248382568
validation[          , genome  6386] predictions:    6367/  10000 (63.67%), best:    6424/10000 (64.24%), error:     10529.10938, best error:     10404.65527 on epoch:    51, epoch:   52/100, mu: 0.9763020277, learning_rate: 0.0001169466, weight_decay: 0.0000397656

epoch time: 1056.8432617188s, input_fired_time: 19.1214294434, output_fired_time: 6.7217478752, propagate_forward_time: 389.1235351563, propagate_backward_time: 631.5942993164, weight_update_time: 0.3290137649, other_time: 10.2821655273
epoch time: 81.0551300049s, input_fired_time: 1.1634181738, output_fired_time: 0.0000000000, propagate_forward_time: 78.1713027954, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.7204055786
validation[          , genome  6386] predictions:    6409/  10000 (64.09%), best:    6409/10000 (64.09%), error:     10355.43262, best error:     10355.43262 on epoch:    53, epoch:   53/100, mu: 0.9771935940, learning_rate: 0.0001098018, weight_decay: 0.0000379419

epoch time: 1055.2672119141s, input_fired_time: 19.0746440887, output_fired_time: 6.6905059814, propagate_forward_time: 388.8282165527, propagate_backward_time: 630.6983642578, weight_update_time: 0.3273795843, other_time: 9.9754638672
epoch time: 80.0782241821s, input_fired_time: 1.1586338282, output_fired_time: 0.0000000000, propagate_forward_time: 77.2654571533, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.6541366577
validation[          , genome  6386] predictions:    6488/  10000 (64.88%), best:    6488/10000 (64.88%), error:     10181.83691, best error:     10181.83691 on epoch:    54, epoch:   54/100, mu: 0.9780271053, learning_rate: 0.0001030935, weight_decay: 0.0000362018

epoch time: 1177.5433349609s, input_fired_time: 25.1230468750, output_fired_time: 10.6635942459, propagate_forward_time: 425.9744567871, propagate_backward_time: 696.4338989258, weight_update_time: 0.5860597491, other_time: 19.3483276367
epoch time: 94.9460067749s, input_fired_time: 2.4663350582, output_fired_time: 0.0000000000, propagate_forward_time: 88.2181167603, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.2615585327
validation[          , genome  6386] predictions:    6374/  10000 (63.74%), best:    6488/10000 (64.88%), error:     10469.81250, best error:     10181.83691 on epoch:    54, epoch:   55/100, mu: 0.9788063765, learning_rate: 0.0000967950, weight_decay: 0.0000345415

epoch time: 1221.2629394531s, input_fired_time: 28.3219490051, output_fired_time: 12.9725313187, propagate_forward_time: 437.3902587891, propagate_backward_time: 719.0112915039, weight_update_time: 0.7155107260, other_time: 23.5669555664
epoch time: 92.8807678223s, input_fired_time: 2.4436912537, output_fired_time: 0.0000000000, propagate_forward_time: 86.0190963745, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.4179763794
validation[          , genome  6386] predictions:    6380/  10000 (63.80%), best:    6488/10000 (64.88%), error:     10405.75586, best error:     10181.83691 on epoch:    54, epoch:   56/100, mu: 0.9795349240, learning_rate: 0.0000908813, weight_decay: 0.0000329573

epoch time: 1187.2302246094s, input_fired_time: 26.8387107849, output_fired_time: 12.5312252045, propagate_forward_time: 424.4258117676, propagate_backward_time: 700.2532958984, weight_update_time: 0.6844019890, other_time: 23.1811523438
epoch time: 91.2513504028s, input_fired_time: 2.1665666103, output_fired_time: 0.0000000000, propagate_forward_time: 84.9646530151, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.1201324463
validation[          , genome  6386] predictions:    6355/  10000 (63.55%), best:    6488/10000 (64.88%), error:     10463.27441, best error:     10181.83691 on epoch:    54, epoch:   57/100, mu: 0.9802160859, learning_rate: 0.0000853289, weight_decay: 0.0000314459

epoch time: 1197.4785156250s, input_fired_time: 27.0764636993, output_fired_time: 12.7547807693, propagate_forward_time: 428.5454711914, propagate_backward_time: 705.6929931641, weight_update_time: 0.6891227961, other_time: 23.4088745117
epoch time: 93.6690673828s, input_fired_time: 2.4550719261, output_fired_time: 0.0000000000, propagate_forward_time: 86.7331619263, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.4808349609
validation[          , genome  6386] predictions:    6412/  10000 (64.12%), best:    6488/10000 (64.88%), error:     10446.95898, best error:     10181.83691 on epoch:    54, epoch:   58/100, mu: 0.9808529019, learning_rate: 0.0000801158, weight_decay: 0.0000300037

epoch time: 1213.9501953125s, input_fired_time: 28.5524520874, output_fired_time: 13.4202795029, propagate_forward_time: 433.2084045410, propagate_backward_time: 714.0478515625, weight_update_time: 0.7424192429, other_time: 24.7211914063
epoch time: 94.0997009277s, input_fired_time: 2.4833419323, output_fired_time: 0.0000000000, propagate_forward_time: 87.2144088745, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.4019470215
validation[          , genome  6386] predictions:    6387/  10000 (63.87%), best:    6488/10000 (64.88%), error:     10344.77539, best error:     10181.83691 on epoch:    54, epoch:   59/100, mu: 0.9814482331, learning_rate: 0.0000752211, weight_decay: 0.0000286277

epoch time: 1216.9631347656s, input_fired_time: 28.0172538757, output_fired_time: 13.1742486954, propagate_forward_time: 434.7549743652, propagate_backward_time: 717.3853759766, weight_update_time: 0.7105959654, other_time: 23.6313476563
epoch time: 93.2959365845s, input_fired_time: 2.2952346802, output_fired_time: 0.0000000000, propagate_forward_time: 87.0831680298, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.9175338745
validation[          , genome  6386] predictions:    6500/  10000 (65.00%), best:    6488/10000 (64.88%), error:     10190.67676, best error:     10181.83691 on epoch:    54, epoch:   60/100, mu: 0.9820048213, learning_rate: 0.0000706255, weight_decay: 0.0000273147

epoch time: 1236.6022949219s, input_fired_time: 27.1803302765, output_fired_time: 13.0929231644, propagate_forward_time: 439.9795532227, propagate_backward_time: 733.6166381836, weight_update_time: 0.6579442620, other_time: 22.7329101563
epoch time: 97.2668075562s, input_fired_time: 2.6309216022, output_fired_time: 0.0000000000, propagate_forward_time: 90.3016281128, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.3342590332
validation[          , genome  6386] predictions:    6476/  10000 (64.76%), best:    6488/10000 (64.88%), error:     10232.09766, best error:     10181.83691 on epoch:    54, epoch:   61/100, mu: 0.9825252295, learning_rate: 0.0000663106, weight_decay: 0.0000260620

epoch time: 1277.8322753906s, input_fired_time: 30.1569271088, output_fired_time: 14.2196168900, propagate_forward_time: 453.6994628906, propagate_backward_time: 754.8380126953, weight_update_time: 0.7318727374, other_time: 24.9182128906
epoch time: 98.5509567261s, input_fired_time: 2.7721972466, output_fired_time: 0.0000000000, propagate_forward_time: 91.3955001831, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.3832626343
validation[          , genome  6386] predictions:    6464/  10000 (64.64%), best:    6488/10000 (64.88%), error:     10204.41699, best error:     10181.83691 on epoch:    54, epoch:   62/100, mu: 0.9830117226, learning_rate: 0.0000622594, weight_decay: 0.0000248668

epoch time: 1285.8293457031s, input_fired_time: 30.6028785706, output_fired_time: 14.4737443924, propagate_forward_time: 456.8783264160, propagate_backward_time: 758.6471557617, weight_update_time: 0.7651566267, other_time: 25.2272338867
epoch time: 99.6193237305s, input_fired_time: 2.9188375473, output_fired_time: 0.0000000000, propagate_forward_time: 91.8694305420, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.8310546875
validation[          , genome  6386] predictions:    6515/  10000 (65.15%), best:    6488/10000 (64.88%), error:     10189.26367, best error:     10181.83691 on epoch:    54, epoch:   63/100, mu: 0.9834665656, learning_rate: 0.0000584557, weight_decay: 0.0000237263

epoch time: 1288.2302246094s, input_fired_time: 31.9935550690, output_fired_time: 16.0710468292, propagate_forward_time: 454.0846557617, propagate_backward_time: 758.9688110352, weight_update_time: 0.8155847788, other_time: 27.1121826172
epoch time: 95.0196228027s, input_fired_time: 2.7860457897, output_fired_time: 0.0000000000, propagate_forward_time: 87.2718582153, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.9617156982
validation[          , genome  6386] predictions:    6430/  10000 (64.30%), best:    6488/10000 (64.88%), error:     10390.59570, best error:     10181.83691 on epoch:    54, epoch:   64/100, mu: 0.9838917851, learning_rate: 0.0000548843, weight_decay: 0.0000226382

epoch time: 1238.8176269531s, input_fired_time: 31.8314990997, output_fired_time: 15.5435943604, propagate_forward_time: 439.2005004883, propagate_backward_time: 724.5597534180, weight_update_time: 0.8408870697, other_time: 27.6822509766
epoch time: 95.5466308594s, input_fired_time: 2.8368108273, output_fired_time: 0.0000000000, propagate_forward_time: 87.5203170776, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.1895065308
validation[          , genome  6386] predictions:    6542/  10000 (65.42%), best:    6542/10000 (65.42%), error:     10065.90918, best error:     10065.90918 on epoch:    65, epoch:   65/100, mu: 0.9842893481, learning_rate: 0.0000515312, weight_decay: 0.0000216000

epoch time: 1221.9941406250s, input_fired_time: 30.5672397614, output_fired_time: 14.5231437683, propagate_forward_time: 436.4613952637, propagate_backward_time: 713.5326538086, weight_update_time: 0.8044835925, other_time: 26.9096069336
epoch time: 96.3785400391s, input_fired_time: 2.7762589455, output_fired_time: 0.0000000000, propagate_forward_time: 88.6699447632, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.9323348999
validation[          , genome  6386] predictions:    6444/  10000 (64.44%), best:    6542/10000 (65.42%), error:     10183.18652, best error:     10065.90918 on epoch:    65, epoch:   66/100, mu: 0.9846610427, learning_rate: 0.0000483829, weight_decay: 0.0000206094

epoch time: 1210.8823242188s, input_fired_time: 30.0754413605, output_fired_time: 14.2405023575, propagate_forward_time: 432.9452209473, propagate_backward_time: 707.3481445313, weight_update_time: 0.7914983630, other_time: 26.2730712891
epoch time: 93.3423233032s, input_fired_time: 2.6023526192, output_fired_time: 0.0000000000, propagate_forward_time: 85.9939575195, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.7460098267
validation[          , genome  6386] predictions:    6423/  10000 (64.23%), best:    6542/10000 (65.42%), error:     10293.64160, best error:     10065.90918 on epoch:    65, epoch:   67/100, mu: 0.9850085378, learning_rate: 0.0000454270, weight_decay: 0.0000196642

epoch time: 1204.2403564453s, input_fired_time: 29.2904586792, output_fired_time: 13.9620647430, propagate_forward_time: 429.9110107422, propagate_backward_time: 705.3533935547, weight_update_time: 0.7849529386, other_time: 25.7235107422
epoch time: 91.5559844971s, input_fired_time: 2.4098157883, output_fired_time: 0.0000000000, propagate_forward_time: 84.6756134033, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.4705581665
validation[          , genome  6386] predictions:    6467/  10000 (64.67%), best:    6542/10000 (65.42%), error:     10087.88379, best error:     10065.90918 on epoch:    65, epoch:   68/100, mu: 0.9853334427, learning_rate: 0.0000426516, weight_decay: 0.0000187623

epoch time: 1250.2451171875s, input_fired_time: 28.7335014343, output_fired_time: 13.9908533096, propagate_forward_time: 444.5414123535, propagate_backward_time: 738.6661376953, weight_update_time: 0.7019355893, other_time: 24.3132324219
epoch time: 98.1657867432s, input_fired_time: 2.3741214275, output_fired_time: 0.0000000000, propagate_forward_time: 91.7558898926, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.0357742310
validation[          , genome  6386] predictions:    6519/  10000 (65.19%), best:    6519/10000 (65.19%), error:     10020.53418, best error:     10020.53418 on epoch:    69, epoch:   69/100, mu: 0.9856371880, learning_rate: 0.0000400458, weight_decay: 0.0000179019

epoch time: 1324.2377929688s, input_fired_time: 31.4720344543, output_fired_time: 15.1332969666, propagate_forward_time: 466.8624572754, propagate_backward_time: 784.3638916016, weight_update_time: 0.7860048413, other_time: 26.4061279297
epoch time: 101.8170776367s, input_fired_time: 2.9830327034, output_fired_time: 0.0000000000, propagate_forward_time: 93.8633270264, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.9707183838
validation[          , genome  6386] predictions:    6513/  10000 (65.13%), best:    6519/10000 (65.19%), error:     10087.28613, best error:     10020.53418 on epoch:    69, epoch:   70/100, mu: 0.9859211445, learning_rate: 0.0000375992, weight_decay: 0.0000170808

epoch time: 1325.2135009766s, input_fired_time: 31.2546558380, output_fired_time: 15.1478662491, propagate_forward_time: 466.5104064941, propagate_backward_time: 786.2849731445, weight_update_time: 0.7666894197, other_time: 26.0156860352
epoch time: 100.3309249878s, input_fired_time: 2.8976764679, output_fired_time: 0.0000000000, propagate_forward_time: 92.6678085327, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.7654418945
validation[          , genome  6386] predictions:    6522/  10000 (65.22%), best:    6519/10000 (65.19%), error:     10141.33789, best error:     10020.53418 on epoch:    69, epoch:   71/100, mu: 0.9861866236, learning_rate: 0.0000353021, weight_decay: 0.0000162975

epoch time: 1275.0373535156s, input_fired_time: 31.0342807770, output_fired_time: 14.8328733444, propagate_forward_time: 451.4321289063, propagate_backward_time: 750.6952514648, weight_update_time: 0.8147416711, other_time: 27.0427856445
epoch time: 97.2523422241s, input_fired_time: 2.7834019661, output_fired_time: 0.0000000000, propagate_forward_time: 89.5053100586, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.9636306763
validation[          , genome  6386] predictions:    6530/  10000 (65.30%), best:    6519/10000 (65.19%), error:     10169.71777, best error:     10020.53418 on epoch:    69, epoch:   72/100, mu: 0.9864348173, learning_rate: 0.0000331453, weight_decay: 0.0000155500

epoch time: 1269.7094726563s, input_fired_time: 31.6773700714, output_fired_time: 15.5374832153, propagate_forward_time: 449.2340393066, propagate_backward_time: 745.4337158203, weight_update_time: 0.8369295001, other_time: 27.8269042969
epoch time: 97.1850357056s, input_fired_time: 2.7158238888, output_fired_time: 0.0000000000, propagate_forward_time: 89.7324523926, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.7367630005
validation[          , genome  6386] predictions:    6533/  10000 (65.33%), best:    6519/10000 (65.19%), error:     10099.72656, best error:     10020.53418 on epoch:    69, epoch:   73/100, mu: 0.9866668582, learning_rate: 0.0000311203, weight_decay: 0.0000148369

epoch time: 1283.0753173828s, input_fired_time: 30.0996856689, output_fired_time: 15.3674421310, propagate_forward_time: 452.2577819824, propagate_backward_time: 759.1618041992, weight_update_time: 0.7676422596, other_time: 26.1885375977
epoch time: 98.2900009155s, input_fired_time: 2.7008743286, output_fired_time: 0.0000000000, propagate_forward_time: 90.9547653198, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.6343612671
validation[          , genome  6386] predictions:    6522/  10000 (65.22%), best:    6519/10000 (65.19%), error:     10045.94727, best error:     10020.53418 on epoch:    69, epoch:   74/100, mu: 0.9868838191, learning_rate: 0.0000292190, weight_decay: 0.0000141564

epoch time: 1262.9825439453s, input_fired_time: 30.3978099823, output_fired_time: 14.7451372147, propagate_forward_time: 447.9421386719, propagate_backward_time: 743.4071044922, weight_update_time: 0.7815517783, other_time: 26.4903564453
epoch time: 96.4496459961s, input_fired_time: 2.7697229385, output_fired_time: 0.0000000000, propagate_forward_time: 88.7221298218, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.9577941895
validation[          , genome  6386] predictions:    6531/  10000 (65.31%), best:    6519/10000 (65.19%), error:     10038.50879, best error:     10020.53418 on epoch:    69, epoch:   75/100, mu: 0.9870866537, learning_rate: 0.0000274339, weight_decay: 0.0000135072

epoch time: 1218.0364990234s, input_fired_time: 29.8191967010, output_fired_time: 14.0733690262, propagate_forward_time: 434.6044006348, propagate_backward_time: 713.4479370117, weight_update_time: 0.7711354494, other_time: 26.0916137695
epoch time: 94.9674301147s, input_fired_time: 2.7177743912, output_fired_time: 0.0000000000, propagate_forward_time: 87.2886734009, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.9609832764
validation[          , genome  6386] predictions:    6549/  10000 (65.49%), best:    6549/10000 (65.49%), error:     10016.23340, best error:     10016.23340 on epoch:    76, epoch:   76/100, mu: 0.9872762561, learning_rate: 0.0000257578, weight_decay: 0.0000128877

epoch time: 1207.8560791016s, input_fired_time: 28.8148746490, output_fired_time: 13.7972621918, propagate_forward_time: 431.7438964844, propagate_backward_time: 708.8675537109, weight_update_time: 0.7357299924, other_time: 24.6325683594
epoch time: 93.3025588989s, input_fired_time: 2.4173111916, output_fired_time: 0.0000000000, propagate_forward_time: 86.4982833862, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.3869628906
validation[          , genome  6386] predictions:    6559/  10000 (65.59%), best:    6559/10000 (65.59%), error:      9972.04297, best error:      9972.04297 on epoch:    77, epoch:   77/100, mu: 0.9874535203, learning_rate: 0.0000241842, weight_decay: 0.0000122967

epoch time: 1215.6524658203s, input_fired_time: 28.4316902161, output_fired_time: 13.8795280457, propagate_forward_time: 431.8429870605, propagate_backward_time: 716.8685913086, weight_update_time: 0.7145233154, other_time: 24.6296997070
epoch time: 94.0550765991s, input_fired_time: 2.5715198517, output_fired_time: 0.0000000000, propagate_forward_time: 86.7018280029, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.7817306519
validation[          , genome  6386] predictions:    6573/  10000 (65.73%), best:    6573/10000 (65.73%), error:      9960.72266, best error:      9960.72266 on epoch:    78, epoch:   78/100, mu: 0.9876192808, learning_rate: 0.0000227066, weight_decay: 0.0000117327

epoch time: 1274.3980712891s, input_fired_time: 32.3310165405, output_fired_time: 15.7404232025, propagate_forward_time: 452.1872863770, propagate_backward_time: 746.8171386719, weight_update_time: 0.8129224777, other_time: 27.3221435547
epoch time: 97.4137496948s, input_fired_time: 3.1059198380, output_fired_time: 0.0000000000, propagate_forward_time: 88.9208221436, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.3870086670
validation[          , genome  6386] predictions:    6566/  10000 (65.66%), best:    6566/10000 (65.66%), error:      9935.80469, best error:      9935.80469 on epoch:    79, epoch:   79/100, mu: 0.9877742529, learning_rate: 0.0000213194, weight_decay: 0.0000111946

epoch time: 1238.3504638672s, input_fired_time: 32.4595146179, output_fired_time: 15.9082498550, propagate_forward_time: 439.5681762695, propagate_backward_time: 721.8118286133, weight_update_time: 0.8928743601, other_time: 28.6027832031
epoch time: 96.6615447998s, input_fired_time: 3.0189890862, output_fired_time: 0.0000000000, propagate_forward_time: 88.3153228760, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.3272323608
validation[          , genome  6386] predictions:    6526/  10000 (65.26%), best:    6566/10000 (65.66%), error:     10028.26758, best error:      9935.80469 on epoch:    79, epoch:   80/100, mu: 0.9879190922, learning_rate: 0.0000200169, weight_decay: 0.0000106812

epoch time: 1253.4080810547s, input_fired_time: 32.4500808716, output_fired_time: 16.0754375458, propagate_forward_time: 444.9672851563, propagate_backward_time: 731.6856079102, weight_update_time: 0.8620118499, other_time: 28.2296752930
epoch time: 101.7155761719s, input_fired_time: 3.2894904613, output_fired_time: 0.0000000000, propagate_forward_time: 93.0454330444, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.3806533813
validation[          , genome  6386] predictions:    6578/  10000 (65.78%), best:    6578/10000 (65.78%), error:      9889.69727, best error:      9889.69727 on epoch:    81, epoch:   81/100, mu: 0.9880545139, learning_rate: 0.0000187939, weight_decay: 0.0000101914

epoch time: 1339.4497070313s, input_fired_time: 33.8862228394, output_fired_time: 17.4492950439, propagate_forward_time: 470.9036560059, propagate_backward_time: 789.1444702148, weight_update_time: 0.8480877280, other_time: 28.0659790039
epoch time: 102.6781082153s, input_fired_time: 3.1409809589, output_fired_time: 0.0000000000, propagate_forward_time: 94.5223236084, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.0148010254
validation[          , genome  6386] predictions:    6543/  10000 (65.43%), best:    6578/10000 (65.78%), error:     10024.08496, best error:      9889.69727 on epoch:    81, epoch:   82/100, mu: 0.9881811142, learning_rate: 0.0000176457, weight_decay: 0.0000097240

epoch time: 1362.0784912109s, input_fired_time: 29.1236267090, output_fired_time: 13.0370321274, propagate_forward_time: 472.7682800293, propagate_backward_time: 825.7312011719, weight_update_time: 0.6151968837, other_time: 21.4183349609
epoch time: 90.1213150024s, input_fired_time: 1.3288166523, output_fired_time: 0.0000000000, propagate_forward_time: 86.7869949341, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0055007935
validation[          , genome  6386] predictions:    6595/  10000 (65.95%), best:    6578/10000 (65.78%), error:      9899.28613, best error:      9889.69727 on epoch:    81, epoch:   83/100, mu: 0.9882994890, learning_rate: 0.0000165677, weight_decay: 0.0000092780

epoch time: 1246.3270263672s, input_fired_time: 30.0368556976, output_fired_time: 14.3231401443, propagate_forward_time: 443.0680541992, propagate_backward_time: 733.7933959961, weight_update_time: 0.8143512607, other_time: 25.1055908203
epoch time: 94.3184585571s, input_fired_time: 2.8866767883, output_fired_time: 0.0000000000, propagate_forward_time: 86.1942596436, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.2375183105
validation[          , genome  6386] predictions:    6563/  10000 (65.63%), best:    6578/10000 (65.78%), error:      9920.59570, best error:      9889.69727 on epoch:    81, epoch:   84/100, mu: 0.9884101748, learning_rate: 0.0000155555, weight_decay: 0.0000088525

epoch time: 1210.2180175781s, input_fired_time: 31.0843124390, output_fired_time: 14.7562646866, propagate_forward_time: 431.6977539063, propagate_backward_time: 705.2086181641, weight_update_time: 0.8724731803, other_time: 27.4710693359
epoch time: 94.4587936401s, input_fired_time: 2.7328841686, output_fired_time: 0.0000000000, propagate_forward_time: 86.6915054321, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.0344009399
validation[          , genome  6386] predictions:    6512/  10000 (65.12%), best:    6578/10000 (65.78%), error:     10054.70508, best error:      9889.69727 on epoch:    81, epoch:   85/100, mu: 0.9885136485, learning_rate: 0.0000146051, weight_decay: 0.0000084465

epoch time: 1327.1297607422s, input_fired_time: 34.4271659851, output_fired_time: 16.6235580444, propagate_forward_time: 473.2925415039, propagate_backward_time: 772.4913330078, weight_update_time: 0.9174978733, other_time: 30.2952270508
epoch time: 92.6362457275s, input_fired_time: 2.8007616997, output_fired_time: 0.0000000000, propagate_forward_time: 84.7794113159, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.0560760498
validation[          , genome  6386] predictions:    6620/  10000 (66.20%), best:    6578/10000 (65.78%), error:      9892.96094, best error:      9889.69727 on epoch:    81, epoch:   86/100, mu: 0.9886103868, learning_rate: 0.0000137128, weight_decay: 0.0000080591

epoch time: 1239.0422363281s, input_fired_time: 31.7053604126, output_fired_time: 14.8431491852, propagate_forward_time: 441.5684204102, propagate_backward_time: 722.9503784180, weight_update_time: 0.8758483529, other_time: 27.9749755859
epoch time: 96.5523071289s, input_fired_time: 2.9972679615, output_fired_time: 0.0000000000, propagate_forward_time: 88.3860092163, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.1690292358
validation[          , genome  6386] predictions:    6609/  10000 (66.09%), best:    6609/10000 (66.09%), error:      9864.63965, best error:      9864.63965 on epoch:    87, epoch:   87/100, mu: 0.9887008071, learning_rate: 0.0000128750, weight_decay: 0.0000076895

epoch time: 1251.4658203125s, input_fired_time: 32.7888755798, output_fired_time: 15.8747606277, propagate_forward_time: 443.9074401855, propagate_backward_time: 730.1489257813, weight_update_time: 0.9013706446, other_time: 28.7458496094
epoch time: 100.7599105835s, input_fired_time: 3.2105085850, output_fired_time: 0.0000000000, propagate_forward_time: 92.0408630371, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.5085372925
validation[          , genome  6386] predictions:    6607/  10000 (66.07%), best:    6609/10000 (66.09%), error:      9864.83301, best error:      9864.63965 on epoch:    87, epoch:   88/100, mu: 0.9887853861, learning_rate: 0.0000120884, weight_decay: 0.0000073369

epoch time: 1345.4017333984s, input_fired_time: 34.9644393921, output_fired_time: 17.7529582977, propagate_forward_time: 471.2065124512, propagate_backward_time: 791.6258544922, weight_update_time: 0.8834263086, other_time: 29.8519287109
epoch time: 97.6390533447s, input_fired_time: 2.6321020126, output_fired_time: 0.0000000000, propagate_forward_time: 90.4653930664, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5415573120
validation[          , genome  6386] predictions:    6598/  10000 (65.98%), best:    6598/10000 (65.98%), error:      9854.08789, best error:      9854.08789 on epoch:    89, epoch:   89/100, mu: 0.9888644218, learning_rate: 0.0000113499, weight_decay: 0.0000070004

epoch time: 1255.3394775391s, input_fired_time: 31.3016071320, output_fired_time: 14.8939075470, propagate_forward_time: 446.6223144531, propagate_backward_time: 735.2193603516, weight_update_time: 0.8267210722, other_time: 27.3022460938
epoch time: 98.0364990234s, input_fired_time: 2.8143990040, output_fired_time: 0.0000000000, propagate_forward_time: 90.4691619873, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.7529373169
validation[          , genome  6386] predictions:    6599/  10000 (65.99%), best:    6598/10000 (65.98%), error:      9874.52344, best error:      9854.08789 on epoch:    89, epoch:   90/100, mu: 0.9889383316, learning_rate: 0.0000106565, weight_decay: 0.0000066793

epoch time: 1277.9154052734s, input_fired_time: 31.4754619598, output_fired_time: 15.0515832901, propagate_forward_time: 452.7767944336, propagate_backward_time: 751.8009033203, weight_update_time: 0.7859030366, other_time: 26.8106079102
epoch time: 103.4479370117s, input_fired_time: 2.8514523506, output_fired_time: 0.0000000000, propagate_forward_time: 95.6565322876, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.9399490356
validation[          , genome  6386] predictions:    6586/  10000 (65.86%), best:    6598/10000 (65.98%), error:      9915.93164, best error:      9854.08789 on epoch:    89, epoch:   91/100, mu: 0.9890074134, learning_rate: 0.0000100054, weight_decay: 0.0000063730

epoch time: 1255.8251953125s, input_fired_time: 30.0040340424, output_fired_time: 14.2835569382, propagate_forward_time: 445.6272583008, propagate_backward_time: 740.6895141602, weight_update_time: 0.7462180257, other_time: 25.2208251953
epoch time: 97.6003189087s, input_fired_time: 2.8101108074, output_fired_time: 0.0000000000, propagate_forward_time: 90.1716918945, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.6185150146
validation[          , genome  6386] predictions:    6621/  10000 (66.21%), best:    6621/10000 (66.21%), error:      9828.21094, best error:      9828.21094 on epoch:    92, epoch:   92/100, mu: 0.9890720248, learning_rate: 0.0000093941, weight_decay: 0.0000060807

epoch time: 1231.1416015625s, input_fired_time: 30.5503292084, output_fired_time: 14.6364355087, propagate_forward_time: 438.2771911621, propagate_backward_time: 721.2387084961, weight_update_time: 0.8086212277, other_time: 26.4389038086
epoch time: 96.3606643677s, input_fired_time: 2.8912777901, output_fired_time: 0.0000000000, propagate_forward_time: 88.3872070313, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.0821762085
validation[          , genome  6386] predictions:    6593/  10000 (65.93%), best:    6621/10000 (66.21%), error:      9880.35254, best error:      9828.21094 on epoch:    92, epoch:   93/100, mu: 0.9891324043, learning_rate: 0.0000088202, weight_decay: 0.0000058019

epoch time: 1237.0749511719s, input_fired_time: 33.2055015564, output_fired_time: 16.0575523376, propagate_forward_time: 438.8554687500, propagate_backward_time: 719.7743530273, weight_update_time: 0.8598808050, other_time: 29.1821899414
epoch time: 95.8212814331s, input_fired_time: 3.1084563732, output_fired_time: 0.0000000000, propagate_forward_time: 87.0906143188, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.6222076416
validation[          , genome  6386] predictions:    6611/  10000 (66.11%), best:    6621/10000 (66.21%), error:      9828.30273, best error:      9828.21094 on epoch:    92, epoch:   94/100, mu: 0.9891888499, learning_rate: 0.0000082813, weight_decay: 0.0000055358

epoch time: 1216.7285156250s, input_fired_time: 32.0498008728, output_fired_time: 15.4027595520, propagate_forward_time: 433.0802001953, propagate_backward_time: 707.6125488281, weight_update_time: 0.8780868053, other_time: 28.5832519531
epoch time: 94.6493453979s, input_fired_time: 2.7973222733, output_fired_time: 0.0000000000, propagate_forward_time: 86.6142654419, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.2377548218
validation[          , genome  6386] predictions:    6620/  10000 (66.20%), best:    6620/10000 (66.20%), error:      9792.31348, best error:      9792.31348 on epoch:    95, epoch:   95/100, mu: 0.9892416596, learning_rate: 0.0000077754, weight_decay: 0.0000052819

epoch time: 1206.9670410156s, input_fired_time: 31.5872955322, output_fired_time: 15.1973094940, propagate_forward_time: 430.3165893555, propagate_backward_time: 701.2731323242, weight_update_time: 0.8753680587, other_time: 28.5927734375
epoch time: 125.1116180420s, input_fired_time: 4.0057196617, output_fired_time: 0.0000000000, propagate_forward_time: 114.4390563965, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 6.6668395996
validation[          , genome  6386] predictions:    6626/  10000 (66.26%), best:    6620/10000 (66.20%), error:      9837.02539, best error:      9792.31348 on epoch:    95, epoch:   96/100, mu: 0.9892910123, learning_rate: 0.0000073004, weight_decay: 0.0000050397

epoch time: 1511.0721435547s, input_fired_time: 38.6153907776, output_fired_time: 19.0858078003, propagate_forward_time: 535.4030151367, propagate_backward_time: 882.8806152344, weight_update_time: 1.0802385807, other_time: 35.0873413086
epoch time: 94.5167465210s, input_fired_time: 3.0007977486, output_fired_time: 0.0000000000, propagate_forward_time: 86.1423492432, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.3735961914
validation[          , genome  6386] predictions:    6624/  10000 (66.24%), best:    6620/10000 (66.20%), error:      9825.94141, best error:      9792.31348 on epoch:    95, epoch:   97/100, mu: 0.9893371463, learning_rate: 0.0000068543, weight_decay: 0.0000048085

epoch time: 1210.4082031250s, input_fired_time: 29.5460681915, output_fired_time: 13.6058673859, propagate_forward_time: 433.5820617676, propagate_backward_time: 708.3002929688, weight_update_time: 0.7628048658, other_time: 25.3740234375
epoch time: 92.9277572632s, input_fired_time: 2.4766812325, output_fired_time: 0.0000000000, propagate_forward_time: 85.8782196045, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.5728530884
validation[          , genome  6386] predictions:    6611/  10000 (66.11%), best:    6620/10000 (66.20%), error:      9811.23047, best error:      9792.31348 on epoch:    95, epoch:   98/100, mu: 0.9893803000, learning_rate: 0.0000064356, weight_decay: 0.0000045880

epoch time: 1198.4190673828s, input_fired_time: 29.3743324280, output_fired_time: 13.6637439728, propagate_forward_time: 429.0440368652, propagate_backward_time: 701.1560668945, weight_update_time: 0.7575443387, other_time: 25.1808471680
epoch time: 92.9031295776s, input_fired_time: 2.6820297241, output_fired_time: 0.0000000000, propagate_forward_time: 85.3764343262, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.8446655273
validation[          , genome  6386] predictions:    6629/  10000 (66.29%), best:    6629/10000 (66.29%), error:      9790.20313, best error:      9790.20313 on epoch:    99, epoch:   99/100, mu: 0.9894206524, learning_rate: 0.0000060424, weight_decay: 0.0000043776

epoch time: 1198.0803222656s, input_fired_time: 31.0698356628, output_fired_time: 14.7649869919, propagate_forward_time: 427.4648437500, propagate_backward_time: 697.7144165039, weight_update_time: 0.8190030456, other_time: 27.0662231445
epoch time: 93.8280334473s, input_fired_time: 2.7578308582, output_fired_time: 0.0000000000, propagate_forward_time: 86.0184097290, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.0517959595
validation[          , genome  6386] predictions:    6623/  10000 (66.23%), best:    6629/10000 (66.29%), error:      9807.28320, best error:      9790.20313 on epoch:    99, epoch:  100/100, mu: 0.9894583821, learning_rate: 0.0000056732, weight_decay: 0.0000041768

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 469.6018981934s, input_fired_time: 13.9385070801, output_fired_time: 0.0000000000, propagate_forward_time: 430.2076110840, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 25.4557800293
best training[          , genome  6386] predictions:   38547/  50000 (77.09%), best:    6629/10000 (66.29%), error:     35719.57031, best error:      9790.20313 on epoch:    99, epoch:  101/100, mu: 0.9894936085, learning_rate: 0.0000053266, weight_decay: 0.0000039853
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 93.9047317505s, input_fired_time: 2.7504794598, output_fired_time: 0.0000000000, propagate_forward_time: 85.7446899414, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 5.4095611572
   testing[          , genome  6386] predictions:    6629/  10000 (66.29%), best:    6629/10000 (66.29%), error:      9790.20313, best error:      9790.20313 on epoch:    99, epoch:  101/100, mu: 0.9894936085, learning_rate: 0.0000053266, weight_decay: 0.0000039853
backpropagation finished successfully!
21:19:26 (5772): called boinc_finish(0)

</stderr_txt>
]]>