Nameexact_genome_1542727803_188_6413_0
Workunit4101274
Created20 Nov 2018, 19:24:08 UTC
Sent20 Nov 2018, 19:25:50 UTC
Report deadline2 Mar 2019, 19:56:45 UTC
Received24 Nov 2018, 1:22:53 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID88437
Run time1 days 7 hours 6 min 36 sec
CPU time1 days 6 hours 40 min 9 sec
Validate stateValid
Credit25,505.37
Device peak FLOPS4.09 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size555.70 MB
Peak swap size577.14 MB
Peak disk usage24.06 MB

Stderr output

<core_client_version>7.8.3</core_client_version>
<![CDATA[
<stderr_txt>
4555053711
epoch time: 74.9217376709s, input_fired_time: 1.2444974184, output_fired_time: 0.0000000000, propagate_forward_time: 71.2882385254, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3889999390
validation[          , genome  6413] predictions:    5924/  10000 (59.24%), best:    5924/10000 (59.24%), error:     11896.37793, best error:     11896.37793 on epoch:    15, epoch:   15/100, mu: 0.7498833537, learning_rate: 0.0000933494, weight_decay: 0.0001824412

epoch time: 1031.6910400391s, input_fired_time: 20.7287597656, output_fired_time: 7.0537495613, propagate_forward_time: 359.3443603516, propagate_backward_time: 630.1569213867, weight_update_time: 0.6186432242, other_time: 14.4072265625
epoch time: 74.0608825684s, input_fired_time: 1.2109624147, output_fired_time: 0.0000000000, propagate_forward_time: 70.5726394653, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2772827148
validation[          , genome  6413] predictions:    5860/  10000 (58.60%), best:    5924/10000 (59.24%), error:     12002.41309, best error:     11896.37793 on epoch:    15, epoch:   16/100, mu: 0.7611287832, learning_rate: 0.0000866662, weight_decay: 0.0001707411

epoch time: 1020.8333740234s, input_fired_time: 20.6398925781, output_fired_time: 7.0803809166, propagate_forward_time: 354.4315185547, propagate_backward_time: 624.2643432617, weight_update_time: 0.6251658797, other_time: 14.4172363281
epoch time: 74.3863449097s, input_fired_time: 1.2050677538, output_fired_time: 0.0000000000, propagate_forward_time: 70.8424224854, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3388519287
validation[          , genome  6413] predictions:    5900/  10000 (59.00%), best:    5924/10000 (59.24%), error:     11952.12109, best error:     11896.37793 on epoch:    15, epoch:   17/100, mu: 0.7718475461, learning_rate: 0.0000804614, weight_decay: 0.0001597914

epoch time: 1018.8611450195s, input_fired_time: 20.6483039856, output_fired_time: 7.0442285538, propagate_forward_time: 353.6459655762, propagate_backward_time: 623.1706542969, weight_update_time: 0.6311417818, other_time: 14.3519287109
epoch time: 74.1012573242s, input_fired_time: 1.2202917337, output_fired_time: 0.0000000000, propagate_forward_time: 70.5540161133, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3269500732
validation[          , genome  6413] predictions:    5875/  10000 (58.75%), best:    5924/10000 (59.24%), error:     11998.04590, best error:     11896.37793 on epoch:    15, epoch:   18/100, mu: 0.7820643187, learning_rate: 0.0000747008, weight_decay: 0.0001495439

epoch time: 1022.6762695313s, input_fired_time: 20.8653450012, output_fired_time: 7.1185474396, propagate_forward_time: 354.6496887207, propagate_backward_time: 625.5890502930, weight_update_time: 0.6301333308, other_time: 14.4536743164
epoch time: 74.3944778442s, input_fired_time: 1.2208077908, output_fired_time: 0.0000000000, propagate_forward_time: 70.8261337280, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3475341797
validation[          , genome  6413] predictions:    5464/  10000 (54.64%), best:    5924/10000 (59.24%), error:     13492.95313, best error:     11896.37793 on epoch:    15, epoch:   19/100, mu: 0.7918026447, learning_rate: 0.0000693527, weight_decay: 0.0001399535

epoch time: 1017.9121704102s, input_fired_time: 20.7452793121, output_fired_time: 7.0838685036, propagate_forward_time: 353.4382324219, propagate_backward_time: 622.2612915039, weight_update_time: 0.6296995878, other_time: 14.3834838867
epoch time: 75.3032836914s, input_fired_time: 1.2480336428, output_fired_time: 0.0000000000, propagate_forward_time: 71.6931533813, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3620986938
validation[          , genome  6413] predictions:    5985/  10000 (59.85%), best:    5985/10000 (59.85%), error:     11859.25293, best error:     11859.25293 on epoch:    20, epoch:   20/100, mu: 0.8010848761, learning_rate: 0.0000643875, weight_decay: 0.0001309782

epoch time: 1023.1407470703s, input_fired_time: 20.7421741486, output_fired_time: 7.0939850807, propagate_forward_time: 355.8081054688, propagate_backward_time: 625.2024536133, weight_update_time: 0.6226208806, other_time: 14.2940063477
epoch time: 75.0793914795s, input_fired_time: 1.2317954302, output_fired_time: 0.0000000000, propagate_forward_time: 71.4976425171, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3499526978
validation[          , genome  6413] predictions:    5726/  10000 (57.26%), best:    5985/10000 (59.85%), error:     12238.96875, best error:     11859.25293 on epoch:    20, epoch:   21/100, mu: 0.8099323511, learning_rate: 0.0000597777, weight_decay: 0.0001225785

epoch time: 1023.8548583984s, input_fired_time: 20.7054138184, output_fired_time: 7.1060886383, propagate_forward_time: 354.1046142578, propagate_backward_time: 627.4608764648, weight_update_time: 0.6289889216, other_time: 14.4778442383
epoch time: 74.4879608154s, input_fired_time: 1.2253230810, output_fired_time: 0.0000000000, propagate_forward_time: 70.9141693115, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3484649658
validation[          , genome  6413] predictions:    5875/  10000 (58.75%), best:    5875/10000 (58.75%), error:     11794.25879, best error:     11794.25879 on epoch:    22, epoch:   22/100, mu: 0.8183655143, learning_rate: 0.0000554980, weight_decay: 0.0001147175

epoch time: 1017.7489624023s, input_fired_time: 20.5848522186, output_fired_time: 7.0365180969, propagate_forward_time: 355.7482299805, propagate_backward_time: 619.9951171875, weight_update_time: 0.6325681210, other_time: 14.3842773438
epoch time: 75.5084762573s, input_fired_time: 1.2766050100, output_fired_time: 0.0000000000, propagate_forward_time: 71.8462295532, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3856430054
validation[          , genome  6413] predictions:    6040/  10000 (60.40%), best:    6040/10000 (60.40%), error:     11583.97070, best error:     11583.97070 on epoch:    23, epoch:   23/100, mu: 0.8264037371, learning_rate: 0.0000515247, weight_decay: 0.0001073606

epoch time: 1022.6936035156s, input_fired_time: 20.7811336517, output_fired_time: 7.1025953293, propagate_forward_time: 354.9694519043, propagate_backward_time: 625.5115356445, weight_update_time: 0.6265050173, other_time: 14.3289184570
epoch time: 75.6697921753s, input_fired_time: 1.2794709206, output_fired_time: 0.0000000000, propagate_forward_time: 71.9369125366, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4534072876
validation[          , genome  6413] predictions:    5835/  10000 (58.35%), best:    6040/10000 (60.40%), error:     12025.81836, best error:     11583.97070 on epoch:    23, epoch:   24/100, mu: 0.8340654969, learning_rate: 0.0000478358, weight_decay: 0.0001004755

epoch time: 1026.2145996094s, input_fired_time: 20.7835063934, output_fired_time: 7.0715646744, propagate_forward_time: 354.5695495605, propagate_backward_time: 629.6291503906, weight_update_time: 0.6316499710, other_time: 14.1607666016
epoch time: 75.2363128662s, input_fired_time: 1.2542461157, output_fired_time: 0.0000000000, propagate_forward_time: 71.5521316528, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4299316406
validation[          , genome  6413] predictions:    6077/  10000 (60.77%), best:    6077/10000 (60.77%), error:     11547.72559, best error:     11547.72559 on epoch:    25, epoch:   25/100, mu: 0.8413684368, learning_rate: 0.0000444111, weight_decay: 0.0000940319

epoch time: 1020.9888916016s, input_fired_time: 20.8163032532, output_fired_time: 7.1032037735, propagate_forward_time: 354.6203613281, propagate_backward_time: 623.8739013672, weight_update_time: 0.6290955544, other_time: 14.5751342773
epoch time: 75.1762313843s, input_fired_time: 1.2745124102, output_fired_time: 0.0000000000, propagate_forward_time: 71.4340744019, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4676437378
validation[          , genome  6413] predictions:    6055/  10000 (60.55%), best:    6055/10000 (60.55%), error:     11503.90527, best error:     11503.90527 on epoch:    26, epoch:   26/100, mu: 0.8483293056, learning_rate: 0.0000412315, weight_decay: 0.0000880016

epoch time: 1022.8872070313s, input_fired_time: 20.8317337036, output_fired_time: 7.0932354927, propagate_forward_time: 355.1622619629, propagate_backward_time: 625.1911010742, weight_update_time: 0.6288706064, other_time: 14.6088256836
epoch time: 74.9455490112s, input_fired_time: 1.2658762932, output_fired_time: 0.0000000000, propagate_forward_time: 71.2195968628, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4600753784
validation[          , genome  6413] predictions:    6071/  10000 (60.71%), best:    6055/10000 (60.55%), error:     11570.24414, best error:     11503.90527 on epoch:    26, epoch:   27/100, mu: 0.8549641967, learning_rate: 0.0000382796, weight_decay: 0.0000823580

epoch time: 1024.8961181641s, input_fired_time: 20.9681568146, output_fired_time: 7.2147741318, propagate_forward_time: 355.7230529785, propagate_backward_time: 626.6769409180, weight_update_time: 0.6168988943, other_time: 14.3131713867
epoch time: 75.5537643433s, input_fired_time: 1.2702112198, output_fired_time: 0.0000000000, propagate_forward_time: 71.7927322388, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4908218384
validation[          , genome  6413] predictions:    6063/  10000 (60.63%), best:    6055/10000 (60.55%), error:     11540.81543, best error:     11503.90527 on epoch:    26, epoch:   28/100, mu: 0.8612883687, learning_rate: 0.0000355390, weight_decay: 0.0000770763

epoch time: 1027.2139892578s, input_fired_time: 21.0594902039, output_fired_time: 7.1065597534, propagate_forward_time: 356.4907531738, propagate_backward_time: 627.9066772461, weight_update_time: 0.6366659403, other_time: 14.6504516602
epoch time: 74.7005386353s, input_fired_time: 1.2317595482, output_fired_time: 0.0000000000, propagate_forward_time: 71.1960067749, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2727737427
validation[          , genome  6413] predictions:    6084/  10000 (60.84%), best:    6084/10000 (60.84%), error:     11429.59082, best error:     11429.59082 on epoch:    29, epoch:   29/100, mu: 0.8673163652, learning_rate: 0.0000329946, weight_decay: 0.0000721334

epoch time: 1024.7241210938s, input_fired_time: 20.8160762787, output_fired_time: 7.1334323883, propagate_forward_time: 355.6448059082, propagate_backward_time: 626.6815185547, weight_update_time: 0.6366866827, other_time: 14.4482421875
epoch time: 74.9030151367s, input_fired_time: 1.2438577414, output_fired_time: 0.0000000000, propagate_forward_time: 71.3317108154, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3274459839
validation[          , genome  6413] predictions:    6163/  10000 (61.63%), best:    6163/10000 (61.63%), error:     11266.10254, best error:     11266.10254 on epoch:    30, epoch:   30/100, mu: 0.8730620146, learning_rate: 0.0000306324, weight_decay: 0.0000675074

epoch time: 1026.5589599609s, input_fired_time: 20.8579730988, output_fired_time: 7.0995616913, propagate_forward_time: 355.1822204590, propagate_backward_time: 629.0623779297, weight_update_time: 0.6361641884, other_time: 14.3568115234
epoch time: 75.8871459961s, input_fired_time: 1.2917113304, output_fired_time: 0.0000000000, propagate_forward_time: 72.0569305420, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5385055542
validation[          , genome  6413] predictions:    6099/  10000 (60.99%), best:    6163/10000 (61.63%), error:     11413.59570, best error:     11266.10254 on epoch:    30, epoch:   31/100, mu: 0.8785386086, learning_rate: 0.0000284393, weight_decay: 0.0000631781

epoch time: 1047.4001464844s, input_fired_time: 21.0426826477, output_fired_time: 7.2015419006, propagate_forward_time: 363.9651184082, propagate_backward_time: 640.6021728516, weight_update_time: 0.6378164291, other_time: 14.5886230469
epoch time: 76.7937164307s, input_fired_time: 1.2977943420, output_fired_time: 0.0000000000, propagate_forward_time: 73.0119094849, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4840164185
validation[          , genome  6413] predictions:    6104/  10000 (61.04%), best:    6163/10000 (61.63%), error:     11365.76465, best error:     11266.10254 on epoch:    30, epoch:   32/100, mu: 0.8837587237, learning_rate: 0.0000264033, weight_decay: 0.0000591265

epoch time: 1034.8149414063s, input_fired_time: 21.1052951813, output_fired_time: 7.2334628105, propagate_forward_time: 359.2390441895, propagate_backward_time: 632.6229248047, weight_update_time: 0.6486247778, other_time: 14.6142578125
epoch time: 74.0812225342s, input_fired_time: 1.2511358261, output_fired_time: 0.0000000000, propagate_forward_time: 70.5199356079, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3101501465
validation[          , genome  6413] predictions:    5955/  10000 (59.55%), best:    6163/10000 (61.63%), error:     11530.67188, best error:     11266.10254 on epoch:    30, epoch:   33/100, mu: 0.8887343407, learning_rate: 0.0000245129, weight_decay: 0.0000553347

epoch time: 1025.9499511719s, input_fired_time: 20.9074344635, output_fired_time: 7.1362528801, propagate_forward_time: 356.2293395996, propagate_backward_time: 627.1978149414, weight_update_time: 0.6329057813, other_time: 14.4791870117
epoch time: 76.5234909058s, input_fired_time: 1.2445009947, output_fired_time: 0.0000000000, propagate_forward_time: 72.8881530762, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3908386230
validation[          , genome  6413] predictions:    5930/  10000 (59.30%), best:    6163/10000 (61.63%), error:     11548.71875, best error:     11266.10254 on epoch:    30, epoch:   34/100, mu: 0.8934769630, learning_rate: 0.0000227580, weight_decay: 0.0000517860

epoch time: 1028.2347412109s, input_fired_time: 21.0049419403, output_fired_time: 7.1504826546, propagate_forward_time: 357.0498962402, propagate_backward_time: 628.6291503906, weight_update_time: 0.6405069232, other_time: 14.4002685547
epoch time: 74.9717636108s, input_fired_time: 1.2651634216, output_fired_time: 0.0000000000, propagate_forward_time: 71.2633056641, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4432983398
validation[          , genome  6413] predictions:    5944/  10000 (59.44%), best:    6163/10000 (61.63%), error:     11697.30664, best error:     11266.10254 on epoch:    30, epoch:   35/100, mu: 0.8979974389, learning_rate: 0.0000211286, weight_decay: 0.0000484650

epoch time: 1027.1511230469s, input_fired_time: 20.8936157227, output_fired_time: 7.2861628532, propagate_forward_time: 356.1066894531, propagate_backward_time: 628.1604614258, weight_update_time: 0.6273347139, other_time: 14.7042236328
epoch time: 74.7263793945s, input_fired_time: 1.2344713211, output_fired_time: 0.0000000000, propagate_forward_time: 71.2372741699, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2546310425
validation[          , genome  6413] predictions:    6080/  10000 (60.80%), best:    6163/10000 (61.63%), error:     11431.31348, best error:     11266.10254 on epoch:    30, epoch:   36/100, mu: 0.9023061991, learning_rate: 0.0000196160, weight_decay: 0.0000453569

epoch time: 1026.8114013672s, input_fired_time: 20.9263267517, output_fired_time: 7.1175956726, propagate_forward_time: 354.6981811523, propagate_backward_time: 629.6924438477, weight_update_time: 0.6322903633, other_time: 14.3768310547
epoch time: 74.6580810547s, input_fired_time: 1.2769201994, output_fired_time: 0.0000000000, propagate_forward_time: 71.0026245117, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3785400391
validation[          , genome  6413] predictions:    6230/  10000 (62.30%), best:    6230/10000 (62.30%), error:     11089.31934, best error:     11089.31934 on epoch:    37, epoch:   37/100, mu: 0.9064131975, learning_rate: 0.0000182116, weight_decay: 0.0000424481

epoch time: 1025.5964355469s, input_fired_time: 20.8920783997, output_fired_time: 7.0887746811, propagate_forward_time: 355.9726562500, propagate_backward_time: 627.1416015625, weight_update_time: 0.6516889334, other_time: 14.5013427734
epoch time: 75.1587982178s, input_fired_time: 1.2887365818, output_fired_time: 0.0000000000, propagate_forward_time: 71.4108276367, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4592361450
validation[          , genome  6413] predictions:    6145/  10000 (61.45%), best:    6230/10000 (62.30%), error:     11228.26465, best error:     11089.31934 on epoch:    37, epoch:   38/100, mu: 0.9103278518, learning_rate: 0.0000169077, weight_decay: 0.0000397259

epoch time: 1028.7935791016s, input_fired_time: 21.0550651550, output_fired_time: 7.1661686897, propagate_forward_time: 357.2936096191, propagate_backward_time: 628.9158935547, weight_update_time: 0.6306778789, other_time: 14.3627929688
epoch time: 74.4336547852s, input_fired_time: 1.2802218199, output_fired_time: 0.0000000000, propagate_forward_time: 70.7723388672, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3810958862
validation[          , genome  6413] predictions:    6178/  10000 (61.78%), best:    6230/10000 (62.30%), error:     11198.98828, best error:     11089.31934 on epoch:    37, epoch:   39/100, mu: 0.9140591621, learning_rate: 0.0000156972, weight_decay: 0.0000371782

epoch time: 1028.3269042969s, input_fired_time: 21.0772914886, output_fired_time: 7.1556634903, propagate_forward_time: 357.2121276855, propagate_backward_time: 628.0459594727, weight_update_time: 0.6340047717, other_time: 14.8358764648
epoch time: 75.0585632324s, input_fired_time: 1.2778007984, output_fired_time: 0.0000000000, propagate_forward_time: 71.3547821045, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4259796143
validation[          , genome  6413] predictions:    6228/  10000 (62.28%), best:    6230/10000 (62.30%), error:     11161.65430, best error:     11089.31934 on epoch:    37, epoch:   40/100, mu: 0.9176157117, learning_rate: 0.0000145734, weight_decay: 0.0000347940

epoch time: 1030.2224121094s, input_fired_time: 21.0734138489, output_fired_time: 7.1808280945, propagate_forward_time: 357.5202636719, propagate_backward_time: 629.5692138672, weight_update_time: 0.6468862891, other_time: 14.8786621094
epoch time: 74.3099212646s, input_fired_time: 1.2673562765, output_fired_time: 0.0000000000, propagate_forward_time: 70.5973739624, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4451904297
validation[          , genome  6413] predictions:    6246/  10000 (62.46%), best:    6246/10000 (62.46%), error:     11016.85938, best error:     11016.85938 on epoch:    41, epoch:   41/100, mu: 0.9210057259, learning_rate: 0.0000135300, weight_decay: 0.0000325626

epoch time: 1020.0709838867s, input_fired_time: 20.9328994751, output_fired_time: 7.1352658272, propagate_forward_time: 353.7493591309, propagate_backward_time: 623.1517944336, weight_update_time: 0.6458212733, other_time: 15.1016235352
epoch time: 76.5117111206s, input_fired_time: 1.4436407089, output_fired_time: 0.0000000000, propagate_forward_time: 72.4725723267, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5954971313
validation[          , genome  6413] predictions:    6282/  10000 (62.82%), best:    6246/10000 (62.46%), error:     11033.05957, best error:     11016.85938 on epoch:    41, epoch:   42/100, mu: 0.9242369533, learning_rate: 0.0000125614, weight_decay: 0.0000304744

epoch time: 1037.9199218750s, input_fired_time: 21.0712814331, output_fired_time: 7.2469797134, propagate_forward_time: 360.8340759277, propagate_backward_time: 633.7880859375, weight_update_time: 0.6462195516, other_time: 14.9794921875
epoch time: 75.5297470093s, input_fired_time: 1.2795174122, output_fired_time: 0.0000000000, propagate_forward_time: 71.8377075195, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4125213623
validation[          , genome  6413] predictions:    6276/  10000 (62.76%), best:    6276/10000 (62.76%), error:     10984.69434, best error:     10984.69434 on epoch:    43, epoch:   43/100, mu: 0.9273168445, learning_rate: 0.0000116621, weight_decay: 0.0000285200

epoch time: 1021.5176391602s, input_fired_time: 20.8572082520, output_fired_time: 7.1281280518, propagate_forward_time: 354.6608581543, propagate_backward_time: 624.4916992188, weight_update_time: 0.6320468187, other_time: 14.3797607422
epoch time: 79.0849380493s, input_fired_time: 1.2810086012, output_fired_time: 0.0000000000, propagate_forward_time: 75.4567184448, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3472137451
validation[          , genome  6413] predictions:    5971/  10000 (59.71%), best:    6276/10000 (62.76%), error:     11736.23145, best error:     10984.69434 on epoch:    43, epoch:   44/100, mu: 0.9302524924, learning_rate: 0.0000108271, weight_decay: 0.0000266910

epoch time: 1016.4160766602s, input_fired_time: 20.8024959564, output_fired_time: 7.1124029160, propagate_forward_time: 352.5831604004, propagate_backward_time: 620.8485107422, weight_update_time: 0.6566520333, other_time: 15.0694580078
epoch time: 74.0586166382s, input_fired_time: 1.2614215612, output_fired_time: 0.0000000000, propagate_forward_time: 70.3355026245, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4616928101
validation[          , genome  6413] predictions:    6224/  10000 (62.24%), best:    6276/10000 (62.76%), error:     11058.25781, best error:     10984.69434 on epoch:    43, epoch:   45/100, mu: 0.9330506325, learning_rate: 0.0000100520, weight_decay: 0.0000249793

epoch time: 1024.8355712891s, input_fired_time: 21.0085105896, output_fired_time: 7.0890808105, propagate_forward_time: 355.7489624023, propagate_backward_time: 626.8049926758, weight_update_time: 0.6232900620, other_time: 14.1840820313
epoch time: 74.4129104614s, input_fired_time: 1.3218919039, output_fired_time: 0.0000000000, propagate_forward_time: 70.6789703369, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4120483398
validation[          , genome  6413] predictions:    6278/  10000 (62.78%), best:    6278/10000 (62.78%), error:     10920.05273, best error:     10920.05273 on epoch:    46, epoch:   46/100, mu: 0.9357177615, learning_rate: 0.0000093323, weight_decay: 0.0000233774

epoch time: 1031.4987792969s, input_fired_time: 21.2024364471, output_fired_time: 7.1726737022, propagate_forward_time: 357.8989562988, propagate_backward_time: 630.6586303711, weight_update_time: 0.6405194402, other_time: 14.5661010742
epoch time: 74.5650482178s, input_fired_time: 1.2766005993, output_fired_time: 0.0000000000, propagate_forward_time: 70.9272766113, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3611679077
validation[          , genome  6413] predictions:    6283/  10000 (62.83%), best:    6283/10000 (62.83%), error:     10910.10352, best error:     10910.10352 on epoch:    47, epoch:   47/100, mu: 0.9382599592, learning_rate: 0.0000086642, weight_decay: 0.0000218782

epoch time: 1022.8469238281s, input_fired_time: 20.9906368256, output_fired_time: 7.1169285774, propagate_forward_time: 354.9761047363, propagate_backward_time: 625.1267700195, weight_update_time: 0.6311439872, other_time: 14.6364135742
epoch time: 74.0090713501s, input_fired_time: 1.2659059763, output_fired_time: 0.0000000000, propagate_forward_time: 70.2982788086, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4448852539
validation[          , genome  6413] predictions:    6248/  10000 (62.48%), best:    6283/10000 (62.83%), error:     10950.05762, best error:     10910.10352 on epoch:    47, epoch:   48/100, mu: 0.9406831264, learning_rate: 0.0000080439, weight_decay: 0.0000204751

epoch time: 1034.2706298828s, input_fired_time: 21.0689964294, output_fired_time: 7.1914377213, propagate_forward_time: 360.2010192871, propagate_backward_time: 630.9803466797, weight_update_time: 0.6370341778, other_time: 14.8288574219
epoch time: 75.6834487915s, input_fired_time: 1.3085850477, output_fired_time: 0.0000000000, propagate_forward_time: 71.9480743408, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4267883301
validation[          , genome  6413] predictions:    6295/  10000 (62.95%), best:    6295/10000 (62.95%), error:     10862.11719, best error:     10862.11719 on epoch:    49, epoch:   49/100, mu: 0.9429928064, learning_rate: 0.0000074680, weight_decay: 0.0000191620

epoch time: 1020.0198974609s, input_fired_time: 20.9336929321, output_fired_time: 7.1035943031, propagate_forward_time: 354.1473693848, propagate_backward_time: 623.8508300781, weight_update_time: 0.6237207651, other_time: 13.9843750000
epoch time: 74.5116424561s, input_fired_time: 1.2897043228, output_fired_time: 0.0000000000, propagate_forward_time: 70.7782363892, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4437026978
validation[          , genome  6413] predictions:    6277/  10000 (62.77%), best:    6295/10000 (62.95%), error:     10930.44531, best error:     10862.11719 on epoch:    49, epoch:   50/100, mu: 0.9451943040, learning_rate: 0.0000069333, weight_decay: 0.0000179331

epoch time: 1021.7388916016s, input_fired_time: 20.8222103119, output_fired_time: 7.0526499748, propagate_forward_time: 353.1093139648, propagate_backward_time: 626.7609863281, weight_update_time: 0.6149647236, other_time: 13.9937133789
epoch time: 74.2823486328s, input_fired_time: 1.2570307255, output_fired_time: 0.0000000000, propagate_forward_time: 70.7308349609, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2944793701
validation[          , genome  6413] predictions:    6260/  10000 (62.60%), best:    6295/10000 (62.95%), error:     10908.57227, best error:     10862.11719 on epoch:    49, epoch:   51/100, mu: 0.9472926855, learning_rate: 0.0000064369, weight_decay: 0.0000167831

epoch time: 1017.1522827148s, input_fired_time: 20.9903583527, output_fired_time: 7.0798549652, propagate_forward_time: 352.8881225586, propagate_backward_time: 621.7263793945, weight_update_time: 0.6252702475, other_time: 14.4675903320
epoch time: 73.5596466064s, input_fired_time: 1.2562776804, output_fired_time: 0.0000000000, propagate_forward_time: 70.1011886597, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2021789551
validation[          , genome  6413] predictions:    6330/  10000 (63.30%), best:    6330/10000 (63.30%), error:     10831.30859, best error:     10831.30859 on epoch:    52, epoch:   52/100, mu: 0.9492927790, learning_rate: 0.0000059761, weight_decay: 0.0000157068

epoch time: 1023.2177124023s, input_fired_time: 21.0083465576, output_fired_time: 7.1317057610, propagate_forward_time: 355.1147155762, propagate_backward_time: 625.1210937500, weight_update_time: 0.6340814233, other_time: 14.8417968750
epoch time: 74.4573822021s, input_fired_time: 1.3087841272, output_fired_time: 0.0000000000, propagate_forward_time: 70.6976776123, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4509201050
validation[          , genome  6413] predictions:    6301/  10000 (63.01%), best:    6330/10000 (63.30%), error:     10838.22363, best error:     10831.30859 on epoch:    52, epoch:   53/100, mu: 0.9511992335, learning_rate: 0.0000055482, weight_decay: 0.0000146995

epoch time: 1028.1652832031s, input_fired_time: 21.0312652588, output_fired_time: 7.1421914101, propagate_forward_time: 355.4855041504, propagate_backward_time: 630.1059570313, weight_update_time: 0.6240006089, other_time: 14.4003906250
epoch time: 75.4441223145s, input_fired_time: 1.3196053505, output_fired_time: 0.0000000000, propagate_forward_time: 71.7246246338, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3998947144
validation[          , genome  6413] predictions:    6387/  10000 (63.87%), best:    6387/10000 (63.87%), error:     10677.78809, best error:     10677.78809 on epoch:    54, epoch:   54/100, mu: 0.9530164003, learning_rate: 0.0000051510, weight_decay: 0.0000137568

epoch time: 1026.0374755859s, input_fired_time: 21.0477104187, output_fired_time: 7.1428184509, propagate_forward_time: 358.8302612305, propagate_backward_time: 624.1437988281, weight_update_time: 0.6390212774, other_time: 14.8728637695
epoch time: 74.0773391724s, input_fired_time: 1.2727154493, output_fired_time: 0.0000000000, propagate_forward_time: 70.4705505371, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3340759277
validation[          , genome  6413] predictions:    6352/  10000 (63.52%), best:    6387/10000 (63.87%), error:     10760.17285, best error:     10677.78809 on epoch:    54, epoch:   55/100, mu: 0.9547484517, learning_rate: 0.0000047822, weight_decay: 0.0000128746

epoch time: 1019.6236572266s, input_fired_time: 20.9968547821, output_fired_time: 7.0834383965, propagate_forward_time: 353.8402709961, propagate_backward_time: 622.9071044922, weight_update_time: 0.6377722025, other_time: 14.7960205078
epoch time: 79.2328720093s, input_fired_time: 1.3064533472, output_fired_time: 0.0000000000, propagate_forward_time: 75.5280532837, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3983688354
validation[          , genome  6413] predictions:    6363/  10000 (63.63%), best:    6387/10000 (63.87%), error:     10766.41797, best error:     10677.78809 on epoch:    54, epoch:   56/100, mu: 0.9563993812, learning_rate: 0.0000044399, weight_decay: 0.0000120489

epoch time: 1020.4629516602s, input_fired_time: 20.9521980286, output_fired_time: 7.0971064568, propagate_forward_time: 354.1967468262, propagate_backward_time: 623.1651000977, weight_update_time: 0.6414991617, other_time: 15.0518188477
epoch time: 74.7874603271s, input_fired_time: 1.3063707352, output_fired_time: 0.0000000000, propagate_forward_time: 70.9891357422, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4919509888
validation[          , genome  6413] predictions:    6311/  10000 (63.11%), best:    6387/10000 (63.87%), error:     10841.14551, best error:     10677.78809 on epoch:    54, epoch:   57/100, mu: 0.9579730034, learning_rate: 0.0000041220, weight_decay: 0.0000112762

epoch time: 1027.6845703125s, input_fired_time: 21.2125968933, output_fired_time: 7.1881670952, propagate_forward_time: 357.0869140625, propagate_backward_time: 626.9820556641, weight_update_time: 0.6416924596, other_time: 15.2148437500
epoch time: 74.7663879395s, input_fired_time: 1.2985779047, output_fired_time: 0.0000000000, propagate_forward_time: 70.8727035522, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5951080322
validation[          , genome  6413] predictions:    6284/  10000 (62.84%), best:    6387/10000 (63.87%), error:     10904.98145, best error:     10677.78809 on epoch:    54, epoch:   58/100, mu: 0.9594729543, learning_rate: 0.0000038269, weight_decay: 0.0000105531

epoch time: 1026.4095458984s, input_fired_time: 21.1302623749, output_fired_time: 7.1020407677, propagate_forward_time: 358.9149475098, propagate_backward_time: 624.4820556641, weight_update_time: 0.6343894005, other_time: 14.7802734375
epoch time: 74.7415771484s, input_fired_time: 1.3313205242, output_fired_time: 0.0000000000, propagate_forward_time: 70.9620590210, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4481964111
validation[          , genome  6413] predictions:    6310/  10000 (63.10%), best:    6387/10000 (63.87%), error:     10882.54590, best error:     10677.78809 on epoch:    54, epoch:   59/100, mu: 0.9609026313, learning_rate: 0.0000035529, weight_decay: 0.0000098763

epoch time: 1018.2055664063s, input_fired_time: 20.8957443237, output_fired_time: 7.0846409798, propagate_forward_time: 353.5382080078, propagate_backward_time: 622.7919921875, weight_update_time: 0.6159325242, other_time: 13.8949584961
epoch time: 75.0786514282s, input_fired_time: 1.3111561537, output_fired_time: 0.0000000000, propagate_forward_time: 71.3044281006, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4630661011
validation[          , genome  6413] predictions:    6352/  10000 (63.52%), best:    6387/10000 (63.87%), error:     10743.96777, best error:     10677.78809 on epoch:    54, epoch:   60/100, mu: 0.9622653723, learning_rate: 0.0000032985, weight_decay: 0.0000092429

epoch time: 1020.6281738281s, input_fired_time: 21.0659790039, output_fired_time: 7.0825853348, propagate_forward_time: 353.9419860840, propagate_backward_time: 623.5560302734, weight_update_time: 0.6348240376, other_time: 14.9815673828
epoch time: 74.3858871460s, input_fired_time: 1.2993298769, output_fired_time: 0.0000000000, propagate_forward_time: 70.6625671387, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4239883423
validation[          , genome  6413] predictions:    6330/  10000 (63.30%), best:    6387/10000 (63.87%), error:     10720.75781, best error:     10677.78809 on epoch:    54, epoch:   61/100, mu: 0.9635642767, learning_rate: 0.0000030624, weight_decay: 0.0000086502

epoch time: 1020.7879638672s, input_fired_time: 20.9809684753, output_fired_time: 7.1571907997, propagate_forward_time: 354.2702636719, propagate_backward_time: 623.8509521484, weight_update_time: 0.6362512112, other_time: 14.5286254883
epoch time: 75.8862380981s, input_fired_time: 1.3145856857, output_fired_time: 0.0000000000, propagate_forward_time: 72.1460418701, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4256134033
validation[          , genome  6413] predictions:    6312/  10000 (63.12%), best:    6387/10000 (63.87%), error:     10735.46973, best error:     10677.78809 on epoch:    54, epoch:   62/100, mu: 0.9648023248, learning_rate: 0.0000028431, weight_decay: 0.0000080954

epoch time: 1025.7607421875s, input_fired_time: 21.0506172180, output_fired_time: 7.3870825768, propagate_forward_time: 355.5253906250, propagate_backward_time: 627.1429443359, weight_update_time: 0.6290959120, other_time: 14.6547241211
epoch time: 75.6002883911s, input_fired_time: 1.3377512693, output_fired_time: 0.0000000000, propagate_forward_time: 71.7457122803, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5168228149
validation[          , genome  6413] predictions:    6349/  10000 (63.49%), best:    6387/10000 (63.87%), error:     10681.49609, best error:     10677.78809 on epoch:    54, epoch:   63/100, mu: 0.9659824371, learning_rate: 0.0000026396, weight_decay: 0.0000075763

epoch time: 1029.7972412109s, input_fired_time: 21.2173690796, output_fired_time: 7.1659512520, propagate_forward_time: 357.3287658691, propagate_backward_time: 629.1958007813, weight_update_time: 0.6403474212, other_time: 14.8894042969
epoch time: 75.7170486450s, input_fired_time: 1.3196781874, output_fired_time: 0.0000000000, propagate_forward_time: 71.8499755859, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5473937988
validation[          , genome  6413] predictions:    6363/  10000 (63.63%), best:    6363/10000 (63.63%), error:     10616.90137, best error:     10616.90137 on epoch:    64, epoch:   64/100, mu: 0.9671072364, learning_rate: 0.0000024506, weight_decay: 0.0000070904

epoch time: 1028.0130615234s, input_fired_time: 21.1933822632, output_fired_time: 7.1513061523, propagate_forward_time: 356.4906921387, propagate_backward_time: 627.9393920898, weight_update_time: 0.6526724696, other_time: 15.2383422852
epoch time: 74.5412521362s, input_fired_time: 1.2857919931, output_fired_time: 0.0000000000, propagate_forward_time: 70.9721221924, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2833404541
validation[          , genome  6413] predictions:    6368/  10000 (63.68%), best:    6363/10000 (63.63%), error:     10699.05371, best error:     10616.90137 on epoch:    64, epoch:   65/100, mu: 0.9681794047, learning_rate: 0.0000022752, weight_decay: 0.0000066357

epoch time: 1029.6060791016s, input_fired_time: 21.1879234314, output_fired_time: 7.1394791603, propagate_forward_time: 357.0722961426, propagate_backward_time: 629.6105957031, weight_update_time: 0.6304021478, other_time: 14.5958251953
epoch time: 74.9587478638s, input_fired_time: 1.2981382608, output_fired_time: 0.0000000000, propagate_forward_time: 71.2751464844, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3854598999
validation[          , genome  6413] predictions:    6364/  10000 (63.64%), best:    6363/10000 (63.63%), error:     10625.60645, best error:     10616.90137 on epoch:    64, epoch:   66/100, mu: 0.9692013264, learning_rate: 0.0000021123, weight_decay: 0.0000062101

epoch time: 1032.2224121094s, input_fired_time: 21.3898658752, output_fired_time: 7.2014050484, propagate_forward_time: 357.9922790527, propagate_backward_time: 630.3850097656, weight_update_time: 0.6489980221, other_time: 15.2537841797
epoch time: 75.9557571411s, input_fired_time: 1.2994552851, output_fired_time: 0.0000000000, propagate_forward_time: 72.3218765259, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3344268799
validation[          , genome  6413] predictions:    6384/  10000 (63.84%), best:    6363/10000 (63.63%), error:     10630.68652, best error:     10616.90137 on epoch:    64, epoch:   67/100, mu: 0.9701753855, learning_rate: 0.0000019610, weight_decay: 0.0000058119

epoch time: 1027.9113769531s, input_fired_time: 21.2100009918, output_fired_time: 7.1262655258, propagate_forward_time: 356.5103149414, propagate_backward_time: 628.9921875000, weight_update_time: 0.6195095778, other_time: 14.0725708008
epoch time: 74.9215164185s, input_fired_time: 1.2895420790, output_fired_time: 0.0000000000, propagate_forward_time: 71.2804412842, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3515319824
validation[          , genome  6413] predictions:    6368/  10000 (63.68%), best:    6368/10000 (63.68%), error:     10561.79297, best error:     10561.79297 on epoch:    68, epoch:   68/100, mu: 0.9711038470, learning_rate: 0.0000018206, weight_decay: 0.0000054391

epoch time: 1035.4229736328s, input_fired_time: 21.2888221741, output_fired_time: 7.1580686569, propagate_forward_time: 362.0163574219, propagate_backward_time: 630.0059814453, weight_update_time: 0.6412346959, other_time: 14.9537353516
epoch time: 75.4640350342s, input_fired_time: 1.3263747692, output_fired_time: 0.0000000000, propagate_forward_time: 71.6345825195, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5030746460
validation[          , genome  6413] predictions:    6335/  10000 (63.35%), best:    6368/10000 (63.68%), error:     10611.01270, best error:     10561.79297 on epoch:    68, epoch:   69/100, mu: 0.9719887972, learning_rate: 0.0000016903, weight_decay: 0.0000050903

epoch time: 1036.9437255859s, input_fired_time: 21.3050518036, output_fired_time: 7.1817345619, propagate_forward_time: 363.1210937500, propagate_backward_time: 630.7638549805, weight_update_time: 0.6305751204, other_time: 14.5719604492
epoch time: 75.8923721313s, input_fired_time: 1.3163994551, output_fired_time: 0.0000000000, propagate_forward_time: 72.1319961548, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4439773560
validation[          , genome  6413] predictions:    6414/  10000 (64.14%), best:    6368/10000 (63.68%), error:     10575.91406, best error:     10561.79297 on epoch:    68, epoch:   70/100, mu: 0.9728323221, learning_rate: 0.0000015693, weight_decay: 0.0000047639

epoch time: 1034.8580322266s, input_fired_time: 21.3466835022, output_fired_time: 7.5941314697, propagate_forward_time: 358.4586181641, propagate_backward_time: 632.9203491211, weight_update_time: 0.6275740266, other_time: 14.5382690430
epoch time: 76.0144271851s, input_fired_time: 1.3551292419, output_fired_time: 0.0000000000, propagate_forward_time: 72.1488418579, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5104598999
validation[          , genome  6413] predictions:    6339/  10000 (63.39%), best:    6368/10000 (63.68%), error:     10660.01758, best error:     10561.79297 on epoch:    68, epoch:   71/100, mu: 0.9736363292, learning_rate: 0.0000014569, weight_decay: 0.0000044584

epoch time: 1046.8077392578s, input_fired_time: 21.3295536041, output_fired_time: 7.2462244034, propagate_forward_time: 359.2325134277, propagate_backward_time: 643.1886596680, weight_update_time: 0.6552715302, other_time: 15.8107299805
epoch time: 78.3177642822s, input_fired_time: 1.3750624657, output_fired_time: 0.0000000000, propagate_forward_time: 74.2814025879, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6613006592
validation[          , genome  6413] predictions:    6437/  10000 (64.37%), best:    6437/10000 (64.37%), error:     10526.12598, best error:     10526.12598 on epoch:    72, epoch:   72/100, mu: 0.9744026661, learning_rate: 0.0000013526, weight_decay: 0.0000041725

epoch time: 1028.2359619141s, input_fired_time: 21.2143173218, output_fired_time: 7.2107453346, propagate_forward_time: 356.6553344727, propagate_backward_time: 628.2608032227, weight_update_time: 0.6458669901, other_time: 14.8947753906
epoch time: 74.6897506714s, input_fired_time: 1.2878812551, output_fired_time: 0.0000000000, propagate_forward_time: 71.1548690796, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2470016479
validation[          , genome  6413] predictions:    6406/  10000 (64.06%), best:    6437/10000 (64.37%), error:     10601.96094, best error:     10526.12598 on epoch:    72, epoch:   73/100, mu: 0.9751331210, learning_rate: 0.0000012558, weight_decay: 0.0000039049

epoch time: 1040.3809814453s, input_fired_time: 21.4751510620, output_fired_time: 7.2761125565, propagate_forward_time: 361.1394958496, propagate_backward_time: 635.6326904297, weight_update_time: 0.6464582682, other_time: 14.8575439453
epoch time: 75.3971481323s, input_fired_time: 1.3290075064, output_fired_time: 0.0000000000, propagate_forward_time: 71.6073455811, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4607925415
validation[          , genome  6413] predictions:    6419/  10000 (64.19%), best:    6419/10000 (64.19%), error:     10515.08594, best error:     10515.08594 on epoch:    74, epoch:   74/100, mu: 0.9758293629, learning_rate: 0.0000011659, weight_decay: 0.0000036545

epoch time: 1032.0930175781s, input_fired_time: 21.3548908234, output_fired_time: 7.2218847275, propagate_forward_time: 358.2489013672, propagate_backward_time: 630.8174438477, weight_update_time: 0.6225820184, other_time: 14.4498901367
epoch time: 75.8615341187s, input_fired_time: 1.3289828300, output_fired_time: 0.0000000000, propagate_forward_time: 72.0443420410, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4882125854
validation[          , genome  6413] predictions:    6393/  10000 (63.93%), best:    6419/10000 (64.19%), error:     10557.93457, best error:     10515.08594 on epoch:    74, epoch:   75/100, mu: 0.9764930010, learning_rate: 0.0000010824, weight_decay: 0.0000034201

epoch time: 1039.0649414063s, input_fired_time: 21.4397258759, output_fired_time: 7.2166552544, propagate_forward_time: 360.5536499023, propagate_backward_time: 634.9359130859, weight_update_time: 0.6464031935, other_time: 14.9190063477
epoch time: 75.2429351807s, input_fired_time: 1.3403662443, output_fired_time: 0.0000000000, propagate_forward_time: 71.3736343384, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5289382935
validation[          , genome  6413] predictions:    6391/  10000 (63.91%), best:    6419/10000 (64.19%), error:     10585.84961, best error:     10515.08594 on epoch:    74, epoch:   76/100, mu: 0.9771255851, learning_rate: 0.0000010049, weight_decay: 0.0000032008

epoch time: 1039.6123046875s, input_fired_time: 21.3926849365, output_fired_time: 7.1983890533, propagate_forward_time: 357.0644226074, propagate_backward_time: 639.0543823242, weight_update_time: 0.6438143849, other_time: 14.9024047852
epoch time: 77.0597000122s, input_fired_time: 1.3578299284, output_fired_time: 0.0000000000, propagate_forward_time: 73.2056579590, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4962158203
validation[          , genome  6413] predictions:    6436/  10000 (64.36%), best:    6436/10000 (64.36%), error:     10476.30078, best error:     10476.30078 on epoch:    77, epoch:   77/100, mu: 0.9777285457, learning_rate: 0.0000009330, weight_decay: 0.0000029955

epoch time: 1031.9285888672s, input_fired_time: 21.2559165955, output_fired_time: 7.1781711578, propagate_forward_time: 358.2463684082, propagate_backward_time: 631.0062255859, weight_update_time: 0.6161985397, other_time: 14.2419433594
epoch time: 75.0027465820s, input_fired_time: 1.3134603500, output_fired_time: 0.0000000000, propagate_forward_time: 71.1678085327, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5214767456
validation[          , genome  6413] predictions:    6403/  10000 (64.03%), best:    6436/10000 (64.36%), error:     10577.98828, best error:     10476.30078 on epoch:    77, epoch:   78/100, mu: 0.9783032537, learning_rate: 0.0000008662, weight_decay: 0.0000028034

epoch time: 1030.2764892578s, input_fired_time: 21.2619132996, output_fired_time: 7.1650228500, propagate_forward_time: 357.5145568848, propagate_backward_time: 629.5121459961, weight_update_time: 0.6451258659, other_time: 14.8228149414
epoch time: 75.5653152466s, input_fired_time: 1.3447540998, output_fired_time: 0.0000000000, propagate_forward_time: 71.7406616211, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4798965454
validation[          , genome  6413] predictions:    6428/  10000 (64.28%), best:    6436/10000 (64.36%), error:     10520.22363, best error:     10476.30078 on epoch:    77, epoch:   79/100, mu: 0.9788510203, learning_rate: 0.0000008042, weight_decay: 0.0000026236

epoch time: 1039.2448730469s, input_fired_time: 21.4634304047, output_fired_time: 7.2439708710, propagate_forward_time: 360.4574890137, propagate_backward_time: 635.5971679688, weight_update_time: 0.6303943396, other_time: 14.4827880859
epoch time: 75.4751052856s, input_fired_time: 1.3120841980, output_fired_time: 0.0000000000, propagate_forward_time: 71.7642669678, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3987579346
validation[          , genome  6413] predictions:    6404/  10000 (64.04%), best:    6436/10000 (64.36%), error:     10550.82617, best error:     10476.30078 on epoch:    77, epoch:   80/100, mu: 0.9793731570, learning_rate: 0.0000007466, weight_decay: 0.0000024554

epoch time: 1035.2205810547s, input_fired_time: 21.4358711243, output_fired_time: 7.2283253670, propagate_forward_time: 359.0051879883, propagate_backward_time: 632.0794677734, weight_update_time: 0.6669476032, other_time: 15.4717407227
epoch time: 75.3294601440s, input_fired_time: 1.3430423737, output_fired_time: 0.0000000000, propagate_forward_time: 71.4849548340, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5014648438
validation[          , genome  6413] predictions:    6400/  10000 (64.00%), best:    6436/10000 (64.36%), error:     10515.55176, best error:     10476.30078 on epoch:    77, epoch:   81/100, mu: 0.9798708558, learning_rate: 0.0000006931, weight_decay: 0.0000022979

epoch time: 1031.5676269531s, input_fired_time: 21.3134613037, output_fired_time: 7.2121925354, propagate_forward_time: 357.5503234863, propagate_backward_time: 631.0273437500, weight_update_time: 0.6254665852, other_time: 14.4642333984
epoch time: 75.9701232910s, input_fired_time: 1.3491286039, output_fired_time: 0.0000000000, propagate_forward_time: 72.1098098755, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5111846924
validation[          , genome  6413] predictions:    6430/  10000 (64.30%), best:    6436/10000 (64.36%), error:     10524.43555, best error:     10476.30078 on epoch:    77, epoch:   82/100, mu: 0.9803452492, learning_rate: 0.0000006435, weight_decay: 0.0000021505

epoch time: 1034.9338378906s, input_fired_time: 21.4451313019, output_fired_time: 7.2408423424, propagate_forward_time: 358.9924926758, propagate_backward_time: 631.7979736328, weight_update_time: 0.6415643096, other_time: 15.4573974609
epoch time: 75.0884552002s, input_fired_time: 1.3156468868, output_fired_time: 0.0000000000, propagate_forward_time: 71.3227157593, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4500961304
validation[          , genome  6413] predictions:    6438/  10000 (64.38%), best:    6436/10000 (64.36%), error:     10502.27051, best error:     10476.30078 on epoch:    77, epoch:   83/100, mu: 0.9807974100, learning_rate: 0.0000005974, weight_decay: 0.0000020126

epoch time: 1051.0639648438s, input_fired_time: 21.4588470459, output_fired_time: 7.3003807068, propagate_forward_time: 368.9789123535, propagate_backward_time: 638.3571777344, weight_update_time: 0.6484386921, other_time: 14.9686279297
epoch time: 75.4253158569s, input_fired_time: 1.3296480179, output_fired_time: 0.0000000000, propagate_forward_time: 71.6059112549, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4897537231
validation[          , genome  6413] predictions:    6463/  10000 (64.63%), best:    6436/10000 (64.36%), error:     10515.54883, best error:     10476.30078 on epoch:    77, epoch:   84/100, mu: 0.9812284112, learning_rate: 0.0000005547, weight_decay: 0.0000018835

epoch time: 1035.7667236328s, input_fired_time: 21.5305633545, output_fired_time: 7.2005114555, propagate_forward_time: 359.2431945801, propagate_backward_time: 632.2821655273, weight_update_time: 0.6588715315, other_time: 15.5103149414
epoch time: 76.1922531128s, input_fired_time: 1.3236211538, output_fired_time: 0.0000000000, propagate_forward_time: 72.4769210815, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3917083740
validation[          , genome  6413] predictions:    6388/  10000 (63.88%), best:    6436/10000 (64.36%), error:     10543.19727, best error:     10476.30078 on epoch:    77, epoch:   85/100, mu: 0.9816392064, learning_rate: 0.0000005150, weight_decay: 0.0000017627

epoch time: 1034.8631591797s, input_fired_time: 21.3806667328, output_fired_time: 7.2159590721, propagate_forward_time: 359.5950012207, propagate_backward_time: 631.9541015625, weight_update_time: 0.6407241821, other_time: 14.7174072266
epoch time: 75.6330184937s, input_fired_time: 1.3383346796, output_fired_time: 0.0000000000, propagate_forward_time: 71.7965545654, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4981307983
validation[          , genome  6413] predictions:    6440/  10000 (64.40%), best:    6440/10000 (64.40%), error:     10472.39160, best error:     10472.39160 on epoch:    86, epoch:   86/100, mu: 0.9820307493, learning_rate: 0.0000004781, weight_decay: 0.0000016497

epoch time: 1027.7387695313s, input_fired_time: 21.1851234436, output_fired_time: 7.1637268066, propagate_forward_time: 356.7137145996, propagate_backward_time: 628.3435668945, weight_update_time: 0.6190119982, other_time: 14.3325805664
epoch time: 75.4687118530s, input_fired_time: 1.3452556133, output_fired_time: 0.0000000000, propagate_forward_time: 71.6224212646, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5010375977
validation[          , genome  6413] predictions:    6422/  10000 (64.22%), best:    6422/10000 (64.22%), error:     10470.26660, best error:     10470.26660 on epoch:    87, epoch:   87/100, mu: 0.9824039936, learning_rate: 0.0000004439, weight_decay: 0.0000015439

epoch time: 1035.4332275391s, input_fired_time: 21.4175605774, output_fired_time: 7.2376627922, propagate_forward_time: 359.1676025391, propagate_backward_time: 632.2577514648, weight_update_time: 0.6543991566, other_time: 15.3526611328
epoch time: 76.0201416016s, input_fired_time: 1.3713700771, output_fired_time: 0.0000000000, propagate_forward_time: 72.0553283691, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5934448242
validation[          , genome  6413] predictions:    6454/  10000 (64.54%), best:    6422/10000 (64.22%), error:     10481.20996, best error:     10470.26660 on epoch:    87, epoch:   88/100, mu: 0.9827597141, learning_rate: 0.0000004121, weight_decay: 0.0000014449

epoch time: 1042.9355468750s, input_fired_time: 21.5321044922, output_fired_time: 7.2753834724, propagate_forward_time: 361.4279479980, propagate_backward_time: 637.5010986328, weight_update_time: 0.6491294503, other_time: 15.1989746094
epoch time: 75.4157409668s, input_fired_time: 1.3574525118, output_fired_time: 0.0000000000, propagate_forward_time: 71.5861892700, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4720993042
validation[          , genome  6413] predictions:    6449/  10000 (64.49%), best:    6422/10000 (64.22%), error:     10476.38574, best error:     10470.26660 on epoch:    87, epoch:   89/100, mu: 0.9830988050, learning_rate: 0.0000003826, weight_decay: 0.0000013522

epoch time: 1035.4080810547s, input_fired_time: 21.4095802307, output_fired_time: 7.2450118065, propagate_forward_time: 359.3303222656, propagate_backward_time: 632.2055664063, weight_update_time: 0.6437938213, other_time: 15.2175903320
epoch time: 77.0797500610s, input_fired_time: 1.3379110098, output_fired_time: 0.0000000000, propagate_forward_time: 73.2947845459, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4470520020
validation[          , genome  6413] predictions:    6421/  10000 (64.21%), best:    6421/10000 (64.21%), error:     10466.52344, best error:     10466.52344 on epoch:    90, epoch:   90/100, mu: 0.9834219813, learning_rate: 0.0000003552, weight_decay: 0.0000012655

epoch time: 1034.8576660156s, input_fired_time: 21.4355564117, output_fired_time: 7.2183146477, propagate_forward_time: 358.9963684082, propagate_backward_time: 632.9311523438, weight_update_time: 0.6249410510, other_time: 14.2762451172
epoch time: 75.3177719116s, input_fired_time: 1.3338017464, output_fired_time: 0.0000000000, propagate_forward_time: 71.4414215088, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5425491333
validation[          , genome  6413] predictions:    6437/  10000 (64.37%), best:    6421/10000 (64.21%), error:     10498.24609, best error:     10466.52344 on epoch:    90, epoch:   91/100, mu: 0.9837300777, learning_rate: 0.0000003298, weight_decay: 0.0000011844

epoch time: 1027.1917724609s, input_fired_time: 21.2525329590, output_fired_time: 7.1692185402, propagate_forward_time: 356.7018737793, propagate_backward_time: 628.1950683594, weight_update_time: 0.6230190992, other_time: 13.8730468750
epoch time: 75.7290802002s, input_fired_time: 1.3582112789, output_fired_time: 0.0000000000, propagate_forward_time: 71.8612976074, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5095748901
validation[          , genome  6413] predictions:    6445/  10000 (64.45%), best:    6421/10000 (64.21%), error:     10492.10449, best error:     10466.52344 on epoch:    90, epoch:   92/100, mu: 0.9840236902, learning_rate: 0.0000003062, weight_decay: 0.0000011084

epoch time: 1049.1623535156s, input_fired_time: 21.6331558228, output_fired_time: 7.2785649300, propagate_forward_time: 362.3405456543, propagate_backward_time: 642.8871459961, weight_update_time: 0.6431937814, other_time: 15.0228881836
epoch time: 75.3582305908s, input_fired_time: 1.3440041542, output_fired_time: 0.0000000000, propagate_forward_time: 71.5020370483, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5121917725
validation[          , genome  6413] predictions:    6466/  10000 (64.66%), best:    6421/10000 (64.21%), error:     10468.19336, best error:     10466.52344 on epoch:    90, epoch:   93/100, mu: 0.9843035936, learning_rate: 0.0000002842, weight_decay: 0.0000010373

epoch time: 1030.5690917969s, input_fired_time: 21.3439540863, output_fired_time: 7.1874551773, propagate_forward_time: 357.6671447754, propagate_backward_time: 629.5160522461, weight_update_time: 0.6331321001, other_time: 14.8545532227
epoch time: 75.4355468750s, input_fired_time: 1.3165810108, output_fired_time: 0.0000000000, propagate_forward_time: 71.7229843140, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3959808350
validation[          , genome  6413] predictions:    6451/  10000 (64.51%), best:    6451/10000 (64.51%), error:     10458.95313, best error:     10458.95313 on epoch:    94, epoch:   94/100, mu: 0.9845703840, learning_rate: 0.0000002639, weight_decay: 0.0000009708

epoch time: 1041.5913085938s, input_fired_time: 21.5884895325, output_fired_time: 7.2599911690, propagate_forward_time: 359.9468994141, propagate_backward_time: 637.7980957031, weight_update_time: 0.6461223960, other_time: 14.9978027344
epoch time: 75.4231338501s, input_fired_time: 1.3431278467, output_fired_time: 0.0000000000, propagate_forward_time: 71.5749359131, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5050735474
validation[          , genome  6413] predictions:    6451/  10000 (64.51%), best:    6451/10000 (64.51%), error:     10446.39551, best error:     10446.39551 on epoch:    95, epoch:   95/100, mu: 0.9848246574, learning_rate: 0.0000002450, weight_decay: 0.0000009085

epoch time: 1032.2001953125s, input_fired_time: 21.4550514221, output_fired_time: 7.2527666092, propagate_forward_time: 357.8458862305, propagate_backward_time: 630.7550659180, weight_update_time: 0.6412512064, other_time: 14.8914184570
epoch time: 75.5435714722s, input_fired_time: 1.3463352919, output_fired_time: 0.0000000000, propagate_forward_time: 71.6765060425, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5207290649
validation[          , genome  6413] predictions:    6445/  10000 (64.45%), best:    6451/10000 (64.51%), error:     10474.54492, best error:     10446.39551 on epoch:    95, epoch:   96/100, mu: 0.9850670099, learning_rate: 0.0000002275, weight_decay: 0.0000008503

epoch time: 1046.6760253906s, input_fired_time: 21.4490871429, output_fired_time: 7.3564686775, propagate_forward_time: 364.0782165527, propagate_backward_time: 639.0697021484, weight_update_time: 0.6227752566, other_time: 14.7225341797
epoch time: 81.6096420288s, input_fired_time: 1.4043669701, output_fired_time: 0.0000000000, propagate_forward_time: 77.6247177124, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5805587769
validation[          , genome  6413] predictions:    6456/  10000 (64.56%), best:    6451/10000 (64.51%), error:     10447.50586, best error:     10446.39551 on epoch:    95, epoch:   97/100, mu: 0.9852980375, learning_rate: 0.0000002112, weight_decay: 0.0000007957

epoch time: 1035.8135986328s, input_fired_time: 21.1295871735, output_fired_time: 7.1061682701, propagate_forward_time: 363.2835693359, propagate_backward_time: 629.5542602539, weight_update_time: 0.6392459273, other_time: 14.7400512695
epoch time: 75.2234878540s, input_fired_time: 1.3428163528, output_fired_time: 0.0000000000, propagate_forward_time: 71.3839111328, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4967575073
validation[          , genome  6413] predictions:    6439/  10000 (64.39%), best:    6451/10000 (64.51%), error:     10471.59766, best error:     10446.39551 on epoch:    95, epoch:   98/100, mu: 0.9855182171, learning_rate: 0.0000001960, weight_decay: 0.0000007447

epoch time: 1041.1596679688s, input_fired_time: 21.6018352509, output_fired_time: 7.2509241104, propagate_forward_time: 361.2398071289, propagate_backward_time: 635.9205932617, weight_update_time: 0.6421610713, other_time: 15.1465454102
epoch time: 75.1673202515s, input_fired_time: 1.3351980448, output_fired_time: 0.0000000000, propagate_forward_time: 71.3232040405, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5089187622
validation[          , genome  6413] predictions:    6420/  10000 (64.20%), best:    6451/10000 (64.51%), error:     10456.30273, best error:     10446.39551 on epoch:    95, epoch:   99/100, mu: 0.9857280850, learning_rate: 0.0000001820, weight_decay: 0.0000006970

epoch time: 1034.0192871094s, input_fired_time: 21.4896488190, output_fired_time: 7.1970868111, propagate_forward_time: 358.6098022461, propagate_backward_time: 631.7885742188, weight_update_time: 0.6463366747, other_time: 14.9342041016
epoch time: 75.1507186890s, input_fired_time: 1.3367705345, output_fired_time: 0.0000000000, propagate_forward_time: 71.3654632568, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4484863281
validation[          , genome  6413] predictions:    6455/  10000 (64.55%), best:    6451/10000 (64.51%), error:     10464.07324, best error:     10446.39551 on epoch:    95, epoch:  100/100, mu: 0.9859281778, learning_rate: 0.0000001690, weight_decay: 0.0000006523

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 378.6376953125s, input_fired_time: 6.8763122559, output_fired_time: 0.0000000000, propagate_forward_time: 359.1361999512, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 12.6251831055
best training[          , genome  6413] predictions:   33979/  50000 (67.96%), best:    6451/10000 (64.51%), error:     48263.74219, best error:     10446.39551 on epoch:    95, epoch:  101/100, mu: 0.9861188531, learning_rate: 0.0000001569, weight_decay: 0.0000006104
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 75.2309799194s, input_fired_time: 1.3525596857, output_fired_time: 0.0000000000, propagate_forward_time: 71.4312667847, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4471511841
   testing[          , genome  6413] predictions:    6451/  10000 (64.51%), best:    6451/10000 (64.51%), error:     10446.39551, best error:     10446.39551 on epoch:    95, epoch:  101/100, mu: 0.9861188531, learning_rate: 0.0000001569, weight_decay: 0.0000006104
backpropagation finished successfully!
19:22:37 (3712): called boinc_finish(0)

</stderr_txt>
]]>