Nameexact_genome_1542069603_184_5787_1
Workunit4085994
Created13 Nov 2018, 11:54:58 UTC
Sent13 Nov 2018, 12:25:45 UTC
Report deadline16 Feb 2019, 16:25:09 UTC
Received17 Nov 2018, 9:27:02 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID75310
Run time1 days 11 hours 32 min 7 sec
CPU time1 days 11 hours 32 min 7 sec
Validate stateValid
Credit23,791.56
Device peak FLOPS3.28 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.33
Peak working set size513.61 MB
Peak swap size516.17 MB
Peak disk usage5.16 MB

Stderr output

<core_client_version>7.9.3</core_client_version>
<![CDATA[
<stderr_txt>
 epoch:    12, epoch:   14/100, mu: 0.7510393858, learning_rate: 0.0060959356, weight_decay: 0.0002438374

epoch time: 1164.8001708984s, input_fired_time: 10.1940870285, output_fired_time: 6.6148896217, propagate_forward_time: 442.2278442383, propagate_backward_time: 692.4367065430, weight_update_time: 1.1538882256, other_time: 13.3266601562
epoch time: 91.5022506714s, input_fired_time: 1.0792056322, output_fired_time: 0.0000000000, propagate_forward_time: 88.1105346680, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3125076294
validation[          , genome  5787] predictions:    5388/  10000 (53.88%), best:    5548/10000 (55.48%), error:     14374.84766, best error:     13782.43848 on epoch:    12, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 1161.7457275391s, input_fired_time: 10.1650733948, output_fired_time: 6.6063642502, propagate_forward_time: 441.5510864258, propagate_backward_time: 690.1435546875, weight_update_time: 1.1526178122, other_time: 13.2797241211
epoch time: 91.5243072510s, input_fired_time: 1.0727648735, output_fired_time: 0.0000000000, propagate_forward_time: 88.1471023560, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3044433594
validation[          , genome  5787] predictions:    5282/  10000 (52.82%), best:    5548/10000 (55.48%), error:     14971.88965, best error:     13782.43848 on epoch:    12, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 1164.5180664062s, input_fired_time: 10.2221240997, output_fired_time: 6.6324748993, propagate_forward_time: 442.9639587402, propagate_backward_time: 691.3731079102, weight_update_time: 1.1530206203, other_time: 13.3263549805
epoch time: 91.5940780640s, input_fired_time: 1.0857497454, output_fired_time: 0.0000000000, propagate_forward_time: 88.1998596191, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3084716797
validation[          , genome  5787] predictions:    5452/  10000 (54.52%), best:    5548/10000 (55.48%), error:     13928.15332, best error:     13782.43848 on epoch:    12, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 1164.0513916016s, input_fired_time: 10.2239847183, output_fired_time: 6.6129007339, propagate_forward_time: 442.6351318359, propagate_backward_time: 691.2503662109, weight_update_time: 1.1560624838, other_time: 13.3289794922
epoch time: 91.6199493408s, input_fired_time: 1.0920302868, output_fired_time: 0.0000000000, propagate_forward_time: 88.2221145630, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3058013916
validation[          , genome  5787] predictions:    5273/  10000 (52.73%), best:    5548/10000 (55.48%), error:     14902.17285, best error:     13782.43848 on epoch:    12, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 1162.2485351562s, input_fired_time: 10.2249860764, output_fired_time: 6.6089868546, propagate_forward_time: 442.0852966309, propagate_backward_time: 690.0595092773, weight_update_time: 1.1526814699, other_time: 13.2697143555
epoch time: 91.6031723022s, input_fired_time: 1.0857809782, output_fired_time: 0.0000000000, propagate_forward_time: 88.2157211304, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3016738892
validation[          , genome  5787] predictions:    5405/  10000 (54.05%), best:    5548/10000 (55.48%), error:     14111.18164, best error:     13782.43848 on epoch:    12, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 1163.4295654297s, input_fired_time: 10.2712554932, output_fired_time: 6.6119880676, propagate_forward_time: 441.9536132812, propagate_backward_time: 691.3033447266, weight_update_time: 1.1517521143, other_time: 13.2894287109
epoch time: 91.8205795288s, input_fired_time: 1.0897947550, output_fired_time: 0.0000000000, propagate_forward_time: 88.4182434082, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3125381470
validation[          , genome  5787] predictions:    5495/  10000 (54.95%), best:    5548/10000 (55.48%), error:     14227.17773, best error:     13782.43848 on epoch:    12, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 1164.6788330078s, input_fired_time: 10.2610368729, output_fired_time: 6.6398310661, propagate_forward_time: 442.8258056641, propagate_backward_time: 691.5637817383, weight_update_time: 1.1804821491, other_time: 13.3884887695
epoch time: 92.1619033813s, input_fired_time: 1.0984010696, output_fired_time: 0.0000000000, propagate_forward_time: 88.7351074219, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3283920288
validation[          , genome  5787] predictions:    5552/  10000 (55.52%), best:    5548/10000 (55.48%), error:     13783.41406, best error:     13782.43848 on epoch:    12, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 1164.7508544922s, input_fired_time: 10.2784891129, output_fired_time: 6.6375350952, propagate_forward_time: 443.1600341797, propagate_backward_time: 691.3178100586, weight_update_time: 1.1563036442, other_time: 13.3569946289
epoch time: 91.9411621094s, input_fired_time: 1.0929547548, output_fired_time: 0.0000000000, propagate_forward_time: 88.5309829712, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3172225952
validation[          , genome  5787] predictions:    5469/  10000 (54.69%), best:    5548/10000 (55.48%), error:     13904.36914, best error:     13782.43848 on epoch:    12, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 1165.7333984375s, input_fired_time: 10.3154697418, output_fired_time: 6.6339454651, propagate_forward_time: 444.2799072266, propagate_backward_time: 691.2069702148, weight_update_time: 1.1539539099, other_time: 13.2971801758
epoch time: 91.8954391479s, input_fired_time: 1.0958824158, output_fired_time: 0.0000000000, propagate_forward_time: 88.4771194458, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3224411011
validation[          , genome  5787] predictions:    5509/  10000 (55.09%), best:    5509/10000 (55.09%), error:     13579.93555, best error:     13579.93555 on epoch:    23, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 1165.7165527344s, input_fired_time: 10.3460359573, output_fired_time: 6.6556773186, propagate_forward_time: 443.7464294434, propagate_backward_time: 691.6027832031, weight_update_time: 1.1566393375, other_time: 13.3656005859
epoch time: 91.8121566772s, input_fired_time: 1.0996731520, output_fired_time: 0.0000000000, propagate_forward_time: 88.4083862305, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3041000366
validation[          , genome  5787] predictions:    5501/  10000 (55.01%), best:    5509/10000 (55.09%), error:     14120.51660, best error:     13579.93555 on epoch:    23, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 1166.7178955078s, input_fired_time: 10.3376731873, output_fired_time: 6.6205496788, propagate_forward_time: 443.1390075684, propagate_backward_time: 693.3013916016, weight_update_time: 1.1532609463, other_time: 13.3192138672
epoch time: 92.6171417236s, input_fired_time: 1.1109336615, output_fired_time: 0.0000000000, propagate_forward_time: 89.1757431030, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3304672241
validation[          , genome  5787] predictions:    5618/  10000 (56.18%), best:    5618/10000 (56.18%), error:     13482.31738, best error:     13482.31738 on epoch:    25, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 1168.5299072266s, input_fired_time: 10.3847036362, output_fired_time: 6.6427941322, propagate_forward_time: 444.0786437988, propagate_backward_time: 694.0579223633, weight_update_time: 1.1545840502, other_time: 13.3659057617
epoch time: 92.3891372681s, input_fired_time: 1.1065846682, output_fired_time: 0.0000000000, propagate_forward_time: 88.9621963501, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3203582764
validation[          , genome  5787] predictions:    5607/  10000 (56.07%), best:    5607/10000 (56.07%), error:     13480.90430, best error:     13480.90430 on epoch:    26, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 1167.1834716797s, input_fired_time: 10.3630914688, output_fired_time: 6.6307892799, propagate_forward_time: 443.6446533203, propagate_backward_time: 693.1423950195, weight_update_time: 1.1570123434, other_time: 13.4026489258
epoch time: 91.6319351196s, input_fired_time: 1.1072746515, output_fired_time: 0.0000000000, propagate_forward_time: 88.1485214233, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3761367798
validation[          , genome  5787] predictions:    5507/  10000 (55.07%), best:    5607/10000 (56.07%), error:     13938.23535, best error:     13480.90430 on epoch:    26, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 1163.0079345703s, input_fired_time: 10.3638525009, output_fired_time: 6.6449050903, propagate_forward_time: 442.0242004395, propagate_backward_time: 690.7016601562, weight_update_time: 1.1504393816, other_time: 13.2733154297
epoch time: 91.5911178589s, input_fired_time: 1.1190302372, output_fired_time: 0.0000000000, propagate_forward_time: 88.1687164307, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3033676147
validation[          , genome  5787] predictions:    5725/  10000 (57.25%), best:    5725/10000 (57.25%), error:     13229.44727, best error:     13229.44727 on epoch:    28, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 1164.0543212891s, input_fired_time: 10.3700532913, output_fired_time: 6.6235980988, propagate_forward_time: 442.2010192871, propagate_backward_time: 691.4892578125, weight_update_time: 1.1527898312, other_time: 13.3703613281
epoch time: 92.6312103271s, input_fired_time: 1.1271786690, output_fired_time: 0.0000000000, propagate_forward_time: 89.1832504272, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3207778931
validation[          , genome  5787] predictions:    5568/  10000 (55.68%), best:    5725/10000 (57.25%), error:     13629.01172, best error:     13229.44727 on epoch:    28, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 1168.9218750000s, input_fired_time: 10.4249839783, output_fired_time: 6.6417407990, propagate_forward_time: 444.9273071289, propagate_backward_time: 693.5481567383, weight_update_time: 1.1583131552, other_time: 13.3797607422
epoch time: 92.0589599609s, input_fired_time: 1.1222616434, output_fired_time: 0.0000000000, propagate_forward_time: 88.6193008423, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3173980713
validation[          , genome  5787] predictions:    5731/  10000 (57.31%), best:    5731/10000 (57.31%), error:     12976.14453, best error:     12976.14453 on epoch:    30, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 1164.9432373047s, input_fired_time: 10.4400491714, output_fired_time: 6.6229271889, propagate_forward_time: 443.1698303223, propagate_backward_time: 691.3157958984, weight_update_time: 1.1549476385, other_time: 13.3946533203
epoch time: 92.4709167480s, input_fired_time: 1.1232719421, output_fired_time: 0.0000000000, propagate_forward_time: 89.0278930664, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3197479248
validation[          , genome  5787] predictions:    5619/  10000 (56.19%), best:    5731/10000 (57.31%), error:     13645.52734, best error:     12976.14453 on epoch:    30, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 1168.7396240234s, input_fired_time: 10.4552335739, output_fired_time: 6.6263785362, propagate_forward_time: 444.2703857422, propagate_backward_time: 694.0107421875, weight_update_time: 1.1556060314, other_time: 13.3769531250
epoch time: 91.9981765747s, input_fired_time: 1.1261746883, output_fired_time: 0.0000000000, propagate_forward_time: 88.5616989136, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3103027344
validation[          , genome  5787] predictions:    5713/  10000 (57.13%), best:    5713/10000 (57.13%), error:     12868.21777, best error:     12868.21777 on epoch:    32, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 1165.8093261719s, input_fired_time: 10.4329643250, output_fired_time: 6.6364183426, propagate_forward_time: 442.9658203125, propagate_backward_time: 692.4137573242, weight_update_time: 1.1512910128, other_time: 13.3602905273
epoch time: 91.6944808960s, input_fired_time: 1.1242703199, output_fired_time: 0.0000000000, propagate_forward_time: 88.2646560669, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3055572510
validation[          , genome  5787] predictions:    5648/  10000 (56.48%), best:    5713/10000 (57.13%), error:     13367.81934, best error:     12868.21777 on epoch:    32, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 1164.3675537109s, input_fired_time: 10.5067682266, output_fired_time: 6.6446862221, propagate_forward_time: 443.0175170898, propagate_backward_time: 690.9048461914, weight_update_time: 1.1540418863, other_time: 13.2938232422
epoch time: 91.6080551147s, input_fired_time: 1.1373565197, output_fired_time: 0.0000000000, propagate_forward_time: 88.1648483276, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3058471680
validation[          , genome  5787] predictions:    5555/  10000 (55.55%), best:    5713/10000 (57.13%), error:     13354.43066, best error:     12868.21777 on epoch:    32, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 1162.2503662109s, input_fired_time: 10.4573717117, output_fired_time: 6.6081886292, propagate_forward_time: 441.7401123047, propagate_backward_time: 690.1545410156, weight_update_time: 1.1544811726, other_time: 13.2901611328
epoch time: 91.9235687256s, input_fired_time: 1.1329560280, output_fired_time: 0.0000000000, propagate_forward_time: 88.4463653564, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3442459106
validation[          , genome  5787] predictions:    5872/  10000 (58.72%), best:    5872/10000 (58.72%), error:     12331.96680, best error:     12331.96680 on epoch:    35, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 1166.3635253906s, input_fired_time: 10.4870586395, output_fired_time: 6.6329069138, propagate_forward_time: 444.0644531250, propagate_backward_time: 691.8396606445, weight_update_time: 1.1559026241, other_time: 13.3394165039
epoch time: 91.6937103271s, input_fired_time: 1.1352559328, output_fired_time: 0.0000000000, propagate_forward_time: 88.2482147217, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3102416992
validation[          , genome  5787] predictions:    5846/  10000 (58.46%), best:    5872/10000 (58.72%), error:     12539.21484, best error:     12331.96680 on epoch:    35, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 1166.0960693359s, input_fired_time: 10.5140609741, output_fired_time: 6.6324858665, propagate_forward_time: 442.7576599121, propagate_backward_time: 692.8500976562, weight_update_time: 1.1521263123, other_time: 13.3417968750
epoch time: 91.9930343628s, input_fired_time: 1.1344461441, output_fired_time: 0.0000000000, propagate_forward_time: 88.5408782959, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3177108765
validation[          , genome  5787] predictions:    5640/  10000 (56.40%), best:    5872/10000 (58.72%), error:     13217.54395, best error:     12331.96680 on epoch:    35, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 1164.5574951172s, input_fired_time: 10.5167989731, output_fired_time: 6.6407485008, propagate_forward_time: 442.3657836914, propagate_backward_time: 691.6505737305, weight_update_time: 1.1553381681, other_time: 13.3835449219
epoch time: 92.3777389526s, input_fired_time: 1.1500172615, output_fired_time: 0.0000000000, propagate_forward_time: 88.9180679321, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3096542358
validation[          , genome  5787] predictions:    5842/  10000 (58.42%), best:    5872/10000 (58.72%), error:     12336.28223, best error:     12331.96680 on epoch:    35, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 1166.5351562500s, input_fired_time: 10.5324583054, output_fired_time: 6.6503477097, propagate_forward_time: 443.2050781250, propagate_backward_time: 692.7903442383, weight_update_time: 1.1552965641, other_time: 13.3568725586
epoch time: 92.4146347046s, input_fired_time: 1.1503249407, output_fired_time: 0.0000000000, propagate_forward_time: 88.9509811401, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3133316040
validation[          , genome  5787] predictions:    5777/  10000 (57.77%), best:    5872/10000 (58.72%), error:     12980.77734, best error:     12331.96680 on epoch:    35, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 2335.8361816406s, input_fired_time: 10.5655345917, output_fired_time: 6.6126227379, propagate_forward_time: 1613.3822021484, propagate_backward_time: 691.9109497070, weight_update_time: 1.1550705433, other_time: 13.3650512695
epoch time: 91.7494201660s, input_fired_time: 1.1427314281, output_fired_time: 0.0000000000, propagate_forward_time: 88.3052062988, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3014831543
validation[          , genome  5787] predictions:    5853/  10000 (58.53%), best:    5872/10000 (58.72%), error:     12644.66699, best error:     12331.96680 on epoch:    35, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 1164.8077392578s, input_fired_time: 10.5684700012, output_fired_time: 6.6194849014, propagate_forward_time: 443.3803100586, propagate_backward_time: 690.9474487305, weight_update_time: 1.1512807608, other_time: 13.2919921875
epoch time: 92.0771484375s, input_fired_time: 1.1529350281, output_fired_time: 0.0000000000, propagate_forward_time: 88.6182937622, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3059158325
validation[          , genome  5787] predictions:    5836/  10000 (58.36%), best:    5872/10000 (58.72%), error:     12592.54492, best error:     12331.96680 on epoch:    35, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 1164.0634765625s, input_fired_time: 10.5510635376, output_fired_time: 6.6232490540, propagate_forward_time: 442.9984130859, propagate_backward_time: 690.5958862305, weight_update_time: 1.1530215740, other_time: 13.2948608398
epoch time: 91.6764755249s, input_fired_time: 1.1561980247, output_fired_time: 0.0000000000, propagate_forward_time: 88.2151107788, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3051681519
validation[          , genome  5787] predictions:    5844/  10000 (58.44%), best:    5872/10000 (58.72%), error:     12564.22559, best error:     12331.96680 on epoch:    35, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 1163.7564697266s, input_fired_time: 10.5706539154, output_fired_time: 6.6235790253, propagate_forward_time: 442.5194091797, propagate_backward_time: 690.7693481445, weight_update_time: 1.1536732912, other_time: 13.2734985352
epoch time: 92.3883590698s, input_fired_time: 1.1622909307, output_fired_time: 0.0000000000, propagate_forward_time: 88.9085769653, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3174896240
validation[          , genome  5787] predictions:    5959/  10000 (59.59%), best:    5959/10000 (59.59%), error:     12150.03711, best error:     12150.03711 on epoch:    43, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 1166.4764404297s, input_fired_time: 10.6268444061, output_fired_time: 6.6423807144, propagate_forward_time: 443.7332763672, propagate_backward_time: 692.0775146484, weight_update_time: 1.1552450657, other_time: 13.3964843750
epoch time: 91.7533950806s, input_fired_time: 1.1524945498, output_fired_time: 0.0000000000, propagate_forward_time: 88.2905197144, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3103790283
validation[          , genome  5787] predictions:    5832/  10000 (58.32%), best:    5959/10000 (59.59%), error:     12756.83496, best error:     12150.03711 on epoch:    43, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 1179.7243652344s, input_fired_time: 10.6648788452, output_fired_time: 6.6752605438, propagate_forward_time: 449.0072021484, propagate_backward_time: 699.9573364258, weight_update_time: 1.1609057188, other_time: 13.4196166992
epoch time: 91.5885086060s, input_fired_time: 1.1760183573, output_fired_time: 0.0000000000, propagate_forward_time: 88.1053619385, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3071289062
validation[          , genome  5787] predictions:    5833/  10000 (58.33%), best:    5959/10000 (59.59%), error:     13154.91797, best error:     12150.03711 on epoch:    43, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 1165.8851318359s, input_fired_time: 10.6485347748, output_fired_time: 6.6234211922, propagate_forward_time: 443.5373535156, propagate_backward_time: 691.6904907227, weight_update_time: 1.1533384323, other_time: 13.3853149414
epoch time: 91.5370864868s, input_fired_time: 1.1615988016, output_fired_time: 0.0000000000, propagate_forward_time: 88.0736999512, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3017883301
validation[          , genome  5787] predictions:    5988/  10000 (59.88%), best:    5959/10000 (59.59%), error:     12262.07910, best error:     12150.03711 on epoch:    43, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 3066.7333984375s, input_fired_time: 10.6315879822, output_fired_time: 6.6320662498, propagate_forward_time: 2345.1386718750, propagate_backward_time: 690.9676513672, weight_update_time: 1.1544418335, other_time: 13.3634033203
epoch time: 91.6651077271s, input_fired_time: 1.1604125500, output_fired_time: 0.0000000000, propagate_forward_time: 88.1954421997, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3092498779
validation[          , genome  5787] predictions:    5895/  10000 (58.95%), best:    5959/10000 (59.59%), error:     12470.66211, best error:     12150.03711 on epoch:    43, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 1166.1453857422s, input_fired_time: 10.6270847321, output_fired_time: 6.6605553627, propagate_forward_time: 443.6279602051, propagate_backward_time: 691.8836669922, weight_update_time: 1.1569812298, other_time: 13.3461914062
epoch time: 92.6898651123s, input_fired_time: 1.1731197834, output_fired_time: 0.0000000000, propagate_forward_time: 89.2072143555, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3095321655
validation[          , genome  5787] predictions:    5888/  10000 (58.88%), best:    5959/10000 (59.59%), error:     12430.51074, best error:     12150.03711 on epoch:    43, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 1164.4101562500s, input_fired_time: 10.6507797241, output_fired_time: 6.6103038788, propagate_forward_time: 442.7648620605, propagate_backward_time: 691.0840454102, weight_update_time: 1.1559551954, other_time: 13.3001098633
epoch time: 91.9889678955s, input_fired_time: 1.1711114645, output_fired_time: 0.0000000000, propagate_forward_time: 88.5067749023, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3110809326
validation[          , genome  5787] predictions:    6034/  10000 (60.34%), best:    6034/10000 (60.34%), error:     12076.21191, best error:     12076.21191 on epoch:    49, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 1169.2092285156s, input_fired_time: 10.7006034851, output_fired_time: 6.6549606323, propagate_forward_time: 445.3083801270, propagate_backward_time: 693.2022094727, weight_update_time: 1.1547940969, other_time: 13.3432006836
epoch time: 92.7872009277s, input_fired_time: 1.1817010641, output_fired_time: 0.0000000000, propagate_forward_time: 89.2718048096, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3336944580
validation[          , genome  5787] predictions:    5896/  10000 (58.96%), best:    6034/10000 (60.34%), error:     12505.12305, best error:     12076.21191 on epoch:    49, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 1164.8511962891s, input_fired_time: 10.6763858795, output_fired_time: 6.6178431511, propagate_forward_time: 443.1074829102, propagate_backward_time: 691.1265869141, weight_update_time: 1.1537249088, other_time: 13.3229370117
epoch time: 92.2218627930s, input_fired_time: 1.1781693697, output_fired_time: 0.0000000000, propagate_forward_time: 88.7283935547, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3152999878
validation[          , genome  5787] predictions:    5882/  10000 (58.82%), best:    6034/10000 (60.34%), error:     12418.34277, best error:     12076.21191 on epoch:    49, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 1182.3652343750s, input_fired_time: 10.7427701950, output_fired_time: 6.7114210129, propagate_forward_time: 450.7034912109, propagate_backward_time: 700.6741333008, weight_update_time: 1.1676272154, other_time: 13.5333862305
epoch time: 91.5273437500s, input_fired_time: 1.1726199389, output_fired_time: 0.0000000000, propagate_forward_time: 88.0545806885, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3001403809
validation[          , genome  5787] predictions:    6007/  10000 (60.07%), best:    6034/10000 (60.34%), error:     12133.58398, best error:     12076.21191 on epoch:    49, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 1164.8912353516s, input_fired_time: 10.6883344650, output_fired_time: 6.6301531792, propagate_forward_time: 443.5781860352, propagate_backward_time: 690.6203002930, weight_update_time: 1.1516436338, other_time: 13.3742675781
epoch time: 92.2434387207s, input_fired_time: 1.1797751188, output_fired_time: 0.0000000000, propagate_forward_time: 88.7545547485, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3091125488
validation[          , genome  5787] predictions:    6030/  10000 (60.30%), best:    6034/10000 (60.34%), error:     12171.10449, best error:     12076.21191 on epoch:    49, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 1168.2794189453s, input_fired_time: 10.6872138977, output_fired_time: 6.6148433685, propagate_forward_time: 447.1966247559, propagate_backward_time: 690.4871215820, weight_update_time: 1.1513447762, other_time: 13.2935180664
epoch time: 91.1739120483s, input_fired_time: 1.1692467928, output_fired_time: 0.0000000000, propagate_forward_time: 87.7062988281, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2983627319
validation[          , genome  5787] predictions:    5858/  10000 (58.58%), best:    6034/10000 (60.34%), error:     12654.88770, best error:     12076.21191 on epoch:    49, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 1163.6369628906s, input_fired_time: 10.6736679077, output_fired_time: 6.6098308563, propagate_forward_time: 442.5220642090, propagate_backward_time: 690.5375366211, weight_update_time: 1.1600061655, other_time: 13.2937622070
epoch time: 92.0038299561s, input_fired_time: 1.1892200708, output_fired_time: 0.0000000000, propagate_forward_time: 88.4502563477, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3643569946
validation[          , genome  5787] predictions:    5945/  10000 (59.45%), best:    6034/10000 (60.34%), error:     12370.17676, best error:     12076.21191 on epoch:    49, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 1160.5081787109s, input_fired_time: 10.7133655548, output_fired_time: 6.5928282738, propagate_forward_time: 440.9675598145, propagate_backward_time: 688.9253540039, weight_update_time: 1.1479400396, other_time: 13.3091430664
epoch time: 91.5319137573s, input_fired_time: 1.1771596670, output_fired_time: 0.0000000000, propagate_forward_time: 88.0547943115, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2999572754
validation[          , genome  5787] predictions:    6017/  10000 (60.17%), best:    6017/10000 (60.17%), error:     11962.80566, best error:     11962.80566 on epoch:    56, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 1159.3551025391s, input_fired_time: 10.7191371918, output_fired_time: 6.5929002762, propagate_forward_time: 440.5920104980, propagate_backward_time: 688.2333374023, weight_update_time: 1.1487588882, other_time: 13.2177124023
epoch time: 91.8136901855s, input_fired_time: 1.1835852861, output_fired_time: 0.0000000000, propagate_forward_time: 88.3273925781, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3027114868
validation[          , genome  5787] predictions:    6093/  10000 (60.93%), best:    6093/10000 (60.93%), error:     11740.79980, best error:     11740.79980 on epoch:    57, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 1160.8068847656s, input_fired_time: 10.6981697083, output_fired_time: 6.6055645943, propagate_forward_time: 441.3623657227, propagate_backward_time: 688.8753662109, weight_update_time: 1.1478072405, other_time: 13.2654418945
epoch time: 91.7619552612s, input_fired_time: 1.1866248846, output_fired_time: 0.0000000000, propagate_forward_time: 88.2777252197, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2976074219
validation[          , genome  5787] predictions:    5984/  10000 (59.84%), best:    6093/10000 (60.93%), error:     12257.23926, best error:     11740.79980 on epoch:    57, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 1162.0252685547s, input_fired_time: 10.7211437225, output_fired_time: 6.5955038071, propagate_forward_time: 441.9897766113, propagate_backward_time: 689.4392700195, weight_update_time: 1.1508888006, other_time: 13.2796020508
epoch time: 24445.0390625000s, input_fired_time: 1.2217571735, output_fired_time: 0.0000000000, propagate_forward_time: 24441.3769531250, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4394531250
validation[          , genome  5787] predictions:    6043/  10000 (60.43%), best:    6093/10000 (60.93%), error:     11837.22461, best error:     11740.79980 on epoch:    57, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 1139.1369628906s, input_fired_time: 10.5889329910, output_fired_time: 6.5324196815, propagate_forward_time: 432.5994567871, propagate_backward_time: 676.0958251953, weight_update_time: 1.1406685114, other_time: 13.3201904297
epoch time: 92.3142547607s, input_fired_time: 1.1994129419, output_fired_time: 0.0000000000, propagate_forward_time: 88.7520141602, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3628311157
validation[          , genome  5787] predictions:    5987/  10000 (59.87%), best:    6093/10000 (60.93%), error:     12156.87793, best error:     11740.79980 on epoch:    57, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 1166.6330566406s, input_fired_time: 10.7912330627, output_fired_time: 6.6400065422, propagate_forward_time: 443.8893432617, propagate_backward_time: 691.9703369141, weight_update_time: 1.1535896063, other_time: 13.3421020508
epoch time: 88.8131256104s, input_fired_time: 1.2212798595, output_fired_time: 0.0000000000, propagate_forward_time: 85.1438980103, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4479446411
validation[          , genome  5787] predictions:    5990/  10000 (59.90%), best:    6093/10000 (60.93%), error:     12156.49902, best error:     11740.79980 on epoch:    57, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 1152.9565429688s, input_fired_time: 10.7053403854, output_fired_time: 6.5861001015, propagate_forward_time: 437.8435058594, propagate_backward_time: 684.5394287109, weight_update_time: 1.1434603930, other_time: 13.2822265625
epoch time: 91.9623947144s, input_fired_time: 1.2041757107, output_fired_time: 0.0000000000, propagate_forward_time: 88.4483032227, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3099136353
validation[          , genome  5787] predictions:    6057/  10000 (60.57%), best:    6093/10000 (60.93%), error:     11972.02051, best error:     11740.79980 on epoch:    57, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 1163.5252685547s, input_fired_time: 10.8098144531, output_fired_time: 6.6314439774, propagate_forward_time: 442.2688293457, propagate_backward_time: 690.2176513672, weight_update_time: 1.1640863419, other_time: 13.5975341797
epoch time: 92.3592071533s, input_fired_time: 1.2119349241, output_fired_time: 0.0000000000, propagate_forward_time: 88.8231735229, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3240966797
validation[          , genome  5787] predictions:    6109/  10000 (61.09%), best:    6109/10000 (61.09%), error:     11630.13965, best error:     11630.13965 on epoch:    63, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 1164.1364746094s, input_fired_time: 10.8601455688, output_fired_time: 6.6822404861, propagate_forward_time: 442.1873474121, propagate_backward_time: 690.5347290039, weight_update_time: 1.1743761301, other_time: 13.8720092773
epoch time: 94.0686569214s, input_fired_time: 1.2240366936, output_fired_time: 0.0000000000, propagate_forward_time: 90.4855194092, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3591003418
validation[          , genome  5787] predictions:    6059/  10000 (60.59%), best:    6109/10000 (61.09%), error:     12242.08887, best error:     11630.13965 on epoch:    63, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 1153.9958496094s, input_fired_time: 10.7442598343, output_fired_time: 6.5876107216, propagate_forward_time: 438.7372741699, propagate_backward_time: 684.5974731445, weight_update_time: 1.1451153755, other_time: 13.3291625977
epoch time: 92.2526245117s, input_fired_time: 1.2078789473, output_fired_time: 0.0000000000, propagate_forward_time: 88.7371444702, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3076019287
validation[          , genome  5787] predictions:    5923/  10000 (59.23%), best:    6109/10000 (61.09%), error:     12744.07715, best error:     11630.13965 on epoch:    63, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 1163.0216064453s, input_fired_time: 10.8184452057, output_fired_time: 6.6262936592, propagate_forward_time: 441.6435241699, propagate_backward_time: 690.4832153320, weight_update_time: 1.1520745754, other_time: 13.4500122070
epoch time: 92.2363433838s, input_fired_time: 1.2198141813, output_fired_time: 0.0000000000, propagate_forward_time: 88.6970977783, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3194351196
validation[          , genome  5787] predictions:    6123/  10000 (61.23%), best:    6109/10000 (61.09%), error:     11777.46191, best error:     11630.13965 on epoch:    63, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 1163.3261718750s, input_fired_time: 10.8591833115, output_fired_time: 6.6566038132, propagate_forward_time: 441.5884399414, propagate_backward_time: 690.5898437500, weight_update_time: 1.1630905867, other_time: 13.6321411133
epoch time: 92.7576141357s, input_fired_time: 1.2217983007, output_fired_time: 0.0000000000, propagate_forward_time: 89.1752700806, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3605422974
validation[          , genome  5787] predictions:    6069/  10000 (60.69%), best:    6109/10000 (61.09%), error:     12087.59375, best error:     11630.13965 on epoch:    63, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 1166.2626953125s, input_fired_time: 10.8539390564, output_fired_time: 6.6588535309, propagate_forward_time: 442.8749694824, propagate_backward_time: 692.0853881836, weight_update_time: 1.1724746227, other_time: 13.7896118164
epoch time: 92.5111083984s, input_fired_time: 1.2180320024, output_fired_time: 0.0000000000, propagate_forward_time: 88.9507751465, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3423004150
validation[          , genome  5787] predictions:    5954/  10000 (59.54%), best:    6109/10000 (61.09%), error:     12463.02539, best error:     11630.13965 on epoch:    63, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 1171.1832275391s, input_fired_time: 10.8935775757, output_fired_time: 6.7093877792, propagate_forward_time: 444.9840393066, propagate_backward_time: 694.9992675781, weight_update_time: 1.1645921469, other_time: 13.5970458984
epoch time: 88.5155639648s, input_fired_time: 1.1916203499, output_fired_time: 0.0000000000, propagate_forward_time: 84.9892425537, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3347015381
validation[          , genome  5787] predictions:    6080/  10000 (60.80%), best:    6109/10000 (61.09%), error:     11982.80273, best error:     11630.13965 on epoch:    63, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 1163.9770507812s, input_fired_time: 10.8287696838, output_fired_time: 6.6374583244, propagate_forward_time: 442.7751159668, propagate_backward_time: 690.3384399414, weight_update_time: 1.1557077169, other_time: 13.3972778320
epoch time: 91.4429321289s, input_fired_time: 1.2090383768, output_fired_time: 0.0000000000, propagate_forward_time: 87.9287185669, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3051757812
validation[          , genome  5787] predictions:    6051/  10000 (60.51%), best:    6109/10000 (61.09%), error:     11907.91309, best error:     11630.13965 on epoch:    63, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 1156.4433593750s, input_fired_time: 10.8006019592, output_fired_time: 6.6024594307, propagate_forward_time: 439.4546508789, propagate_backward_time: 686.2365722656, weight_update_time: 1.1470752954, other_time: 13.3490600586
epoch time: 1996.7625732422s, input_fired_time: 1906.3840332031, output_fired_time: 0.0000000000, propagate_forward_time: 88.0626602173, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3158798218
validation[          , genome  5787] predictions:    6049/  10000 (60.49%), best:    6109/10000 (61.09%), error:     12043.97852, best error:     11630.13965 on epoch:    63, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 1166.6657714844s, input_fired_time: 10.9277830124, output_fired_time: 6.6450595856, propagate_forward_time: 443.3491821289, propagate_backward_time: 692.1580810547, weight_update_time: 1.1603060961, other_time: 13.5857543945
epoch time: 90.5764007568s, input_fired_time: 1.2119169235, output_fired_time: 0.0000000000, propagate_forward_time: 87.0365066528, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3279800415
validation[          , genome  5787] predictions:    6066/  10000 (60.66%), best:    6109/10000 (61.09%), error:     12019.48438, best error:     11630.13965 on epoch:    63, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 1166.7028808594s, input_fired_time: 10.9134025574, output_fired_time: 6.7087631226, propagate_forward_time: 443.4443664551, propagate_backward_time: 691.9447631836, weight_update_time: 1.1679806709, other_time: 13.6915893555
epoch time: 94.0107269287s, input_fired_time: 1.2439616919, output_fired_time: 0.0000000000, propagate_forward_time: 90.4036254883, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3631362915
validation[          , genome  5787] predictions:    6116/  10000 (61.16%), best:    6109/10000 (61.09%), error:     11819.74219, best error:     11630.13965 on epoch:    63, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 1156.0895996094s, input_fired_time: 10.8036327362, output_fired_time: 6.5887117386, propagate_forward_time: 439.1632690430, propagate_backward_time: 685.8739624023, weight_update_time: 1.1603144407, other_time: 13.6600341797
epoch time: 92.0886383057s, input_fired_time: 1.2215751410, output_fired_time: 0.0000000000, propagate_forward_time: 88.5536880493, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3133773804
validation[          , genome  5787] predictions:    6107/  10000 (61.07%), best:    6109/10000 (61.09%), error:     11801.31738, best error:     11630.13965 on epoch:    63, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 1159.1135253906s, input_fired_time: 10.8542547226, output_fired_time: 6.5774559975, propagate_forward_time: 440.7649841309, propagate_backward_time: 687.6119384766, weight_update_time: 1.1490936279, other_time: 13.3048095703
epoch time: 92.9530563354s, input_fired_time: 1.2313781977, output_fired_time: 0.0000000000, propagate_forward_time: 89.3850784302, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3366012573
validation[          , genome  5787] predictions:    6091/  10000 (60.91%), best:    6109/10000 (61.09%), error:     11931.31641, best error:     11630.13965 on epoch:    63, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 1160.8999023438s, input_fired_time: 10.8672609329, output_fired_time: 6.6332087517, propagate_forward_time: 441.1437072754, propagate_backward_time: 688.6330566406, weight_update_time: 1.1669690609, other_time: 13.6226806641
epoch time: 93.1359176636s, input_fired_time: 1.2388033867, output_fired_time: 0.0000000000, propagate_forward_time: 89.5580978394, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3390197754
validation[          , genome  5787] predictions:    6092/  10000 (60.92%), best:    6109/10000 (61.09%), error:     11884.55957, best error:     11630.13965 on epoch:    63, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 1159.5245361328s, input_fired_time: 10.8620357513, output_fired_time: 6.6278381348, propagate_forward_time: 440.0146484375, propagate_backward_time: 688.5386352539, weight_update_time: 1.1592491865, other_time: 13.4813842773
epoch time: 91.9427871704s, input_fired_time: 1.2265787125, output_fired_time: 0.0000000000, propagate_forward_time: 88.4076080322, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3086013794
validation[          , genome  5787] predictions:    6131/  10000 (61.31%), best:    6109/10000 (61.09%), error:     11796.26562, best error:     11630.13965 on epoch:    63, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 1160.0775146484s, input_fired_time: 10.8815116882, output_fired_time: 6.6178588867, propagate_forward_time: 440.1572265625, propagate_backward_time: 688.8884887695, weight_update_time: 1.1584140062, other_time: 13.5324096680
epoch time: 91.1469192505s, input_fired_time: 1.2222071886, output_fired_time: 0.0000000000, propagate_forward_time: 87.6004867554, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3242263794
validation[          , genome  5787] predictions:    6150/  10000 (61.50%), best:    6109/10000 (61.09%), error:     11841.82715, best error:     11630.13965 on epoch:    63, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 1164.2756347656s, input_fired_time: 10.9613199234, output_fired_time: 6.6447834969, propagate_forward_time: 442.0986938477, propagate_backward_time: 691.0640258789, weight_update_time: 1.1572136879, other_time: 13.5068359375
epoch time: 88.4680252075s, input_fired_time: 1.1958566904, output_fired_time: 0.0000000000, propagate_forward_time: 84.9952850342, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2768859863
validation[          , genome  5787] predictions:    6191/  10000 (61.91%), best:    6109/10000 (61.09%), error:     11753.86816, best error:     11630.13965 on epoch:    63, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 1169.5056152344s, input_fired_time: 10.9713716507, output_fired_time: 6.7045006752, propagate_forward_time: 444.9936828613, propagate_backward_time: 693.3502197266, weight_update_time: 1.1579364538, other_time: 13.4859619141
epoch time: 92.5180511475s, input_fired_time: 1.2338614464, output_fired_time: 0.0000000000, propagate_forward_time: 88.9552230835, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3289642334
validation[          , genome  5787] predictions:    6093/  10000 (60.93%), best:    6109/10000 (61.09%), error:     11809.98047, best error:     11630.13965 on epoch:    63, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 1149.1601562500s, input_fired_time: 10.8035583496, output_fired_time: 6.5488786697, propagate_forward_time: 437.4002685547, propagate_backward_time: 681.0707397461, weight_update_time: 1.1444376707, other_time: 13.3367309570
epoch time: 91.3971481323s, input_fired_time: 1.2243366241, output_fired_time: 0.0000000000, propagate_forward_time: 87.8841934204, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2886199951
validation[          , genome  5787] predictions:    6182/  10000 (61.82%), best:    6182/10000 (61.82%), error:     11596.35059, best error:     11596.35059 on epoch:    81, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 1157.8037109375s, input_fired_time: 10.8721179962, output_fired_time: 6.6183996201, propagate_forward_time: 439.7477722168, propagate_backward_time: 687.2435302734, weight_update_time: 1.1469120979, other_time: 13.3218994141
epoch time: 92.6290588379s, input_fired_time: 1.2391273975, output_fired_time: 0.0000000000, propagate_forward_time: 89.0515823364, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3383483887
validation[          , genome  5787] predictions:    6129/  10000 (61.29%), best:    6182/10000 (61.82%), error:     11694.33496, best error:     11596.35059 on epoch:    81, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 1153.2473144531s, input_fired_time: 10.8487625122, output_fired_time: 6.6100282669, propagate_forward_time: 437.9776306152, propagate_backward_time: 684.1923217773, weight_update_time: 1.1566491127, other_time: 13.6185913086
epoch time: 92.7997665405s, input_fired_time: 1.2555272579, output_fired_time: 0.0000000000, propagate_forward_time: 89.1433715820, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4008712769
validation[          , genome  5787] predictions:    6094/  10000 (60.94%), best:    6182/10000 (61.82%), error:     11905.82812, best error:     11596.35059 on epoch:    81, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 1164.7033691406s, input_fired_time: 10.9867868423, output_fired_time: 6.6752514839, propagate_forward_time: 443.3936767578, propagate_backward_time: 689.8911743164, weight_update_time: 1.1692707539, other_time: 13.7564086914
epoch time: 89.2387313843s, input_fired_time: 1.1964837313, output_fired_time: 0.0000000000, propagate_forward_time: 85.7903366089, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2519073486
validation[          , genome  5787] predictions:    6185/  10000 (61.85%), best:    6182/10000 (61.82%), error:     11788.62695, best error:     11596.35059 on epoch:    81, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 2966.7131347656s, input_fired_time: 10.9614086151, output_fired_time: 6.6355443001, propagate_forward_time: 442.1817321777, propagate_backward_time: 2493.3369140625, weight_update_time: 1.1623740196, other_time: 13.5976562500
epoch time: 91.9085845947s, input_fired_time: 1.2390184402, output_fired_time: 0.0000000000, propagate_forward_time: 88.3550567627, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3145065308
validation[          , genome  5787] predictions:    6129/  10000 (61.29%), best:    6182/10000 (61.82%), error:     11818.69922, best error:     11596.35059 on epoch:    81, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 1163.4598388672s, input_fired_time: 10.9284391403, output_fired_time: 6.6419949532, propagate_forward_time: 442.5561828613, propagate_backward_time: 689.9535522461, weight_update_time: 1.1502809525, other_time: 13.3796997070
epoch time: 86.0294113159s, input_fired_time: 1.1629794836, output_fired_time: 0.0000000000, propagate_forward_time: 82.6851272583, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1813049316
validation[          , genome  5787] predictions:    6134/  10000 (61.34%), best:    6182/10000 (61.82%), error:     11848.95410, best error:     11596.35059 on epoch:    81, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 1167.3831787109s, input_fired_time: 10.9961805344, output_fired_time: 6.6433477402, propagate_forward_time: 443.5842895508, propagate_backward_time: 692.7269287109, weight_update_time: 1.1577687263, other_time: 13.4324340820
epoch time: 92.0158386230s, input_fired_time: 1.2378022671, output_fired_time: 0.0000000000, propagate_forward_time: 88.4630661011, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3149719238
validation[          , genome  5787] predictions:    6149/  10000 (61.49%), best:    6182/10000 (61.82%), error:     11846.31445, best error:     11596.35059 on epoch:    81, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 1159.5358886719s, input_fired_time: 10.9111442566, output_fired_time: 6.6051669121, propagate_forward_time: 440.9482116699, propagate_backward_time: 687.7149658203, weight_update_time: 1.1502181292, other_time: 13.3563232422
epoch time: 91.9406356812s, input_fired_time: 1.2355515957, output_fired_time: 0.0000000000, propagate_forward_time: 88.3889236450, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3161621094
validation[          , genome  5787] predictions:    6128/  10000 (61.28%), best:    6182/10000 (61.82%), error:     11768.28223, best error:     11596.35059 on epoch:    81, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 1158.9906005859s, input_fired_time: 10.9356145859, output_fired_time: 6.5956335068, propagate_forward_time: 440.6412048340, propagate_backward_time: 687.4210205078, weight_update_time: 1.1779612303, other_time: 13.3970947266
epoch time: 90.2654342651s, input_fired_time: 1.2186832428, output_fired_time: 0.0000000000, propagate_forward_time: 86.7568511963, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2899017334
validation[          , genome  5787] predictions:    6144/  10000 (61.44%), best:    6182/10000 (61.82%), error:     11772.59277, best error:     11596.35059 on epoch:    81, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 1159.0615234375s, input_fired_time: 10.9468030930, output_fired_time: 6.5927386284, propagate_forward_time: 439.9908142090, propagate_backward_time: 688.2064819336, weight_update_time: 1.1512346268, other_time: 13.3246459961
epoch time: 92.1354980469s, input_fired_time: 1.2419210672, output_fired_time: 0.0000000000, propagate_forward_time: 88.5676803589, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3258972168
validation[          , genome  5787] predictions:    6179/  10000 (61.79%), best:    6182/10000 (61.82%), error:     11699.34277, best error:     11596.35059 on epoch:    81, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 1153.9228515625s, input_fired_time: 10.9032344818, output_fired_time: 6.5818252563, propagate_forward_time: 438.3364257812, propagate_backward_time: 684.8121948242, weight_update_time: 1.1451106071, other_time: 13.2892456055
epoch time: 92.5689544678s, input_fired_time: 1.2430092096, output_fired_time: 0.0000000000, propagate_forward_time: 89.0016937256, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3242492676
validation[          , genome  5787] predictions:    6160/  10000 (61.60%), best:    6182/10000 (61.82%), error:     11760.14648, best error:     11596.35059 on epoch:    81, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 1160.3375244141s, input_fired_time: 10.9458875656, output_fired_time: 6.6035461426, propagate_forward_time: 441.0439758301, propagate_backward_time: 688.3189697266, weight_update_time: 1.1544502974, other_time: 13.4251708984
epoch time: 92.0085601807s, input_fired_time: 1.2496482134, output_fired_time: 0.0000000000, propagate_forward_time: 88.4152069092, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3437042236
validation[          , genome  5787] predictions:    6166/  10000 (61.66%), best:    6182/10000 (61.82%), error:     11713.72754, best error:     11596.35059 on epoch:    81, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 1150.9963378906s, input_fired_time: 10.8901138306, output_fired_time: 6.5733761787, propagate_forward_time: 437.3172302246, propagate_backward_time: 682.8203125000, weight_update_time: 1.1519985199, other_time: 13.3952636719
epoch time: 79.3531188965s, input_fired_time: 1.0805681944, output_fired_time: 0.0000000000, propagate_forward_time: 76.2356491089, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0369033813
validation[          , genome  5787] predictions:    6191/  10000 (61.91%), best:    6182/10000 (61.82%), error:     11657.06445, best error:     11596.35059 on epoch:    81, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 1252.4672851562s, input_fired_time: 12.4971523285, output_fired_time: 7.3842673302, propagate_forward_time: 472.2744750977, propagate_backward_time: 742.2537841797, weight_update_time: 1.2194054127, other_time: 18.0575561523
epoch time: 122.1263198853s, input_fired_time: 1.6450169086, output_fired_time: 0.0000000000, propagate_forward_time: 115.7907485962, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.6905517578
validation[          , genome  5787] predictions:    6147/  10000 (61.47%), best:    6182/10000 (61.82%), error:     11690.92090, best error:     11596.35059 on epoch:    81, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 1335.8654785156s, input_fired_time: 13.4811639786, output_fired_time: 7.8919839859, propagate_forward_time: 503.4234313965, propagate_backward_time: 789.6719360352, weight_update_time: 1.3037732840, other_time: 21.3969116211
epoch time: 110.1998825073s, input_fired_time: 1.5173701048, output_fired_time: 0.0000000000, propagate_forward_time: 104.4358062744, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 4.2467041016
validation[          , genome  5787] predictions:    6089/  10000 (60.89%), best:    6182/10000 (61.82%), error:     11885.98242, best error:     11596.35059 on epoch:    81, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 1452.8103027344s, input_fired_time: 15.0460853577, output_fired_time: 8.6489791870, propagate_forward_time: 548.8817138672, propagate_backward_time: 855.7579345703, weight_update_time: 1.3722627163, other_time: 24.4755859375
epoch time: 113.9748001099s, input_fired_time: 1.5560622215, output_fired_time: 0.0000000000, propagate_forward_time: 108.5327911377, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.8859481812
validation[          , genome  5787] predictions:    6218/  10000 (62.18%), best:    6182/10000 (61.82%), error:     11652.17383, best error:     11596.35059 on epoch:    81, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 1158.1175537109s, input_fired_time: 11.3813953400, output_fired_time: 6.7250313759, propagate_forward_time: 438.5886535645, propagate_backward_time: 686.0151977539, weight_update_time: 1.1477710009, other_time: 15.4074096680
epoch time: 83.4067764282s, input_fired_time: 1.1433219910, output_fired_time: 0.0000000000, propagate_forward_time: 80.1315917969, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1318664551
validation[          , genome  5787] predictions:    6177/  10000 (61.77%), best:    6182/10000 (61.82%), error:     11675.91602, best error:     11596.35059 on epoch:    81, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 1116.3629150391s, input_fired_time: 10.5587072372, output_fired_time: 6.3604702950, propagate_forward_time: 424.4012756348, propagate_backward_time: 662.1332397461, weight_update_time: 1.1394503117, other_time: 12.9092407227
epoch time: 92.8455657959s, input_fired_time: 1.2438741922, output_fired_time: 0.0000000000, propagate_forward_time: 89.2678985596, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3337936401
validation[          , genome  5787] predictions:    6179/  10000 (61.79%), best:    6182/10000 (61.82%), error:     11780.74902, best error:     11596.35059 on epoch:    81, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 1159.2668457031s, input_fired_time: 10.9566602707, output_fired_time: 6.5841221809, propagate_forward_time: 440.2579345703, propagate_backward_time: 688.2535400391, weight_update_time: 1.1460803747, other_time: 13.2145996094
epoch time: 89.8097686768s, input_fired_time: 1.2140420675, output_fired_time: 0.0000000000, propagate_forward_time: 86.3250427246, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2706832886
validation[          , genome  5787] predictions:    6186/  10000 (61.86%), best:    6182/10000 (61.82%), error:     11618.84473, best error:     11596.35059 on epoch:    81, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 1164.2888183594s, input_fired_time: 10.9848051071, output_fired_time: 6.6207056046, propagate_forward_time: 442.2083129883, propagate_backward_time: 691.1807250977, weight_update_time: 1.1513674259, other_time: 13.2941894531
epoch time: 91.9937973022s, input_fired_time: 1.2377696037, output_fired_time: 0.0000000000, propagate_forward_time: 88.4474563599, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3085708618
validation[          , genome  5787] predictions:    6125/  10000 (61.25%), best:    6182/10000 (61.82%), error:     11813.33984, best error:     11596.35059 on epoch:    81, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 467.0934753418s, input_fired_time: 6.1257219315, output_fired_time: 0.0000000000, propagate_forward_time: 449.3487854004, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 11.6189575195
best training[          , genome  5787] predictions:   40101/  50000 (80.20%), best:    6182/10000 (61.82%), error:     30276.39648, best error:     11596.35059 on epoch:    81, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 91.7381515503s, input_fired_time: 1.2298135757, output_fired_time: 0.0000000000, propagate_forward_time: 88.2002258301, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3081130981
   testing[          , genome  5787] predictions:    6182/  10000 (61.82%), best:    6182/10000 (61.82%), error:     11596.35059, best error:     11596.35059 on epoch:    81, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
09:26:37 (20474): called boinc_finish(0)

</stderr_txt>
]]>