Nameexact_genome_1512735002_44_24452_2
Workunit2693580
Created20 Dec 2017, 5:50:42 UTC
Sent20 Dec 2017, 6:30:27 UTC
Report deadline22 Feb 2018, 20:29:58 UTC
Received21 Dec 2017, 16:04:03 UTC
Server stateOver
OutcomeSuccess
Client stateDone
Exit status0 (0x0)
Computer ID64195
Run time1 days 4 hours 11 min 33 sec
CPU time1 days 3 hours 27 min 7 sec
Validate stateInitial
Credit0.00
Device peak FLOPS3.75 GFLOPS
Application versionEXACT Batch Norm With Scaled FMP CNN Trainer v0.34
Peak working set size185.04 MB
Peak swap size188.00 MB
Peak disk usage7.71 MB

Stderr output

<core_client_version>7.8.3</core_client_version>
<![CDATA[
<stderr_txt>
och time: 73.5618362427s, input_fired_time: 1.5848541260, output_fired_time: 0.0000000000, propagate_forward_time: 69.8056335449, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1713485718
validation[          , genome 24452] predictions:    9820/  10000 (98.20%), best:    9853/10000 (98.53%), error:       596.55280, best error:       480.39285 on epoch:     6, epoch:   15/100, mu: 0.7629874349, learning_rate: 0.0057911389, weight_decay: 0.0002316456

epoch time: 941.0339355469s, input_fired_time: 12.7842655182, output_fired_time: 12.1495847702, propagate_forward_time: 351.8181762695, propagate_backward_time: 552.3422851563, weight_update_time: 0.7875343561, other_time: 11.9396362305
epoch time: 75.2292480469s, input_fired_time: 1.5894154310, output_fired_time: 0.0000000000, propagate_forward_time: 71.4169998169, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2228317261
validation[          , genome 24452] predictions:    9801/  10000 (98.01%), best:    9853/10000 (98.53%), error:       616.69031, best error:       480.39285 on epoch:     6, epoch:   16/100, mu: 0.7743380666, learning_rate: 0.0055015818, weight_decay: 0.0002200633

epoch time: 939.4707031250s, input_fired_time: 12.8017072678, output_fired_time: 12.1049051285, propagate_forward_time: 351.3131713867, propagate_backward_time: 551.2093505859, weight_update_time: 0.7863156199, other_time: 12.0415649414
epoch time: 74.2667922974s, input_fired_time: 1.6010056734, output_fired_time: 0.0000000000, propagate_forward_time: 70.4940795898, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1717071533
validation[          , genome 24452] predictions:    9802/  10000 (98.02%), best:    9853/10000 (98.53%), error:       632.09406, best error:       480.39285 on epoch:     6, epoch:   17/100, mu: 0.7851211429, learning_rate: 0.0052265027, weight_decay: 0.0002090601

epoch time: 952.6833496094s, input_fired_time: 13.0002365112, output_fired_time: 12.1827106476, propagate_forward_time: 356.3666992188, propagate_backward_time: 559.0051269531, weight_update_time: 0.8007004261, other_time: 12.1285400391
epoch time: 80.7664337158s, input_fired_time: 1.7478984594, output_fired_time: 0.0000000000, propagate_forward_time: 76.6317749023, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3867568970
validation[          , genome 24452] predictions:    9860/  10000 (98.60%), best:    9860/10000 (98.60%), error:       449.33850, best error:       449.33850 on epoch:    18, epoch:   18/100, mu: 0.7953650951, learning_rate: 0.0049651773, weight_decay: 0.0001986071

epoch time: 949.3556518555s, input_fired_time: 12.8591556549, output_fired_time: 12.3480501175, propagate_forward_time: 355.2194824219, propagate_backward_time: 556.8314819336, weight_update_time: 0.7856565714, other_time: 12.0975341797
epoch time: 73.7171936035s, input_fired_time: 1.5866619349, output_fired_time: 0.0000000000, propagate_forward_time: 69.9630889893, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1674423218
validation[          , genome 24452] predictions:    9828/  10000 (98.28%), best:    9860/10000 (98.60%), error:       514.81805, best error:       449.33850 on epoch:    18, epoch:   19/100, mu: 0.8050968647, learning_rate: 0.0047169183, weight_decay: 0.0001886768

epoch time: 941.0805053711s, input_fired_time: 12.8173656464, output_fired_time: 12.1649761200, propagate_forward_time: 351.9234619141, propagate_backward_time: 552.3063354492, weight_update_time: 0.7830886245, other_time: 11.8683471680
epoch time: 82.3889083862s, input_fired_time: 1.8264634609, output_fired_time: 0.0000000000, propagate_forward_time: 78.0268249512, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5356216431
validation[          , genome 24452] predictions:    9854/  10000 (98.54%), best:    9860/10000 (98.60%), error:       450.88428, best error:       449.33850 on epoch:    18, epoch:   20/100, mu: 0.8143420219, learning_rate: 0.0044810725, weight_decay: 0.0001792429

epoch time: 995.1651000977s, input_fired_time: 13.4945278168, output_fired_time: 12.7002716064, propagate_forward_time: 372.0833740234, propagate_backward_time: 584.2090454102, weight_update_time: 0.8635165691, other_time: 12.6779174805
epoch time: 79.0001220703s, input_fired_time: 1.7172493935, output_fired_time: 0.0000000000, propagate_forward_time: 74.8848571777, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3980178833
validation[          , genome 24452] predictions:    9856/  10000 (98.56%), best:    9856/10000 (98.56%), error:       447.84088, best error:       447.84088 on epoch:    21, epoch:   21/100, mu: 0.8231249452, learning_rate: 0.0042570187, weight_decay: 0.0001702808

epoch time: 1013.1876831055s, input_fired_time: 14.0847816467, output_fired_time: 12.7851057053, propagate_forward_time: 378.8556213379, propagate_backward_time: 594.5164184570, weight_update_time: 0.8627567887, other_time: 12.9457397461
epoch time: 84.6851730347s, input_fired_time: 1.8392720222, output_fired_time: 0.0000000000, propagate_forward_time: 79.9950332642, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8508682251
validation[          , genome 24452] predictions:    9841/  10000 (98.41%), best:    9856/10000 (98.56%), error:       499.85028, best error:       447.84088 on epoch:    21, epoch:   22/100, mu: 0.8314687014, learning_rate: 0.0040441677, weight_decay: 0.0001617667

epoch time: 984.0432128906s, input_fired_time: 13.4907608032, output_fired_time: 12.8771219254, propagate_forward_time: 367.8262634277, propagate_backward_time: 577.5123901367, weight_update_time: 0.8463237286, other_time: 12.3366088867
epoch time: 74.0073699951s, input_fired_time: 1.5952445269, output_fired_time: 0.0000000000, propagate_forward_time: 70.1874847412, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2246398926
validation[          , genome 24452] predictions:    9857/  10000 (98.57%), best:    9856/10000 (98.56%), error:       470.63214, best error:       447.84088 on epoch:    21, epoch:   23/100, mu: 0.8393952847, learning_rate: 0.0038419592, weight_decay: 0.0001536784

epoch time: 1022.8577270508s, input_fired_time: 13.8136281967, output_fired_time: 13.1548013687, propagate_forward_time: 383.1018676758, propagate_backward_time: 599.6082153320, weight_update_time: 0.8784031272, other_time: 13.1792602539
epoch time: 83.2452468872s, input_fired_time: 1.7770754099, output_fired_time: 0.0000000000, propagate_forward_time: 79.0846176147, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3835525513
validation[          , genome 24452] predictions:    9873/  10000 (98.73%), best:    9873/10000 (98.73%), error:       400.55188, best error:       400.55188 on epoch:    24, epoch:   24/100, mu: 0.8469254971, learning_rate: 0.0036498611, weight_decay: 0.0001459945

epoch time: 1009.9822998047s, input_fired_time: 13.8064718246, output_fired_time: 12.7151622772, propagate_forward_time: 377.9432983398, propagate_backward_time: 592.8363037109, weight_update_time: 0.9556450248, other_time: 12.6810913086
epoch time: 92.5528106689s, input_fired_time: 2.0319151878, output_fired_time: 0.0000000000, propagate_forward_time: 87.8862457275, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6346511841
validation[          , genome 24452] predictions:    9843/  10000 (98.43%), best:    9873/10000 (98.73%), error:       470.48074, best error:       400.55188 on epoch:    24, epoch:   25/100, mu: 0.8540792465, learning_rate: 0.0034673680, weight_decay: 0.0001386948

epoch time: 1050.6152343750s, input_fired_time: 14.2628459930, output_fired_time: 14.0181150436, propagate_forward_time: 392.8605041504, propagate_backward_time: 616.0919189453, weight_update_time: 0.8625975847, other_time: 13.3818359375
epoch time: 80.9873275757s, input_fired_time: 1.8496538401, output_fired_time: 0.0000000000, propagate_forward_time: 76.7741317749, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3635406494
validation[          , genome 24452] predictions:    9853/  10000 (98.53%), best:    9873/10000 (98.73%), error:       421.50681, best error:       400.55188 on epoch:    24, epoch:   26/100, mu: 0.8608753085, learning_rate: 0.0032939995, weight_decay: 0.0001317600

epoch time: 1012.3999023438s, input_fired_time: 13.9367828369, output_fired_time: 12.9823493958, propagate_forward_time: 378.8346252441, propagate_backward_time: 593.7178344727, weight_update_time: 0.8331040144, other_time: 12.9282836914
epoch time: 78.1247863770s, input_fired_time: 1.6554945707, output_fired_time: 0.0000000000, propagate_forward_time: 74.0633621216, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4059295654
validation[          , genome 24452] predictions:    9844/  10000 (98.44%), best:    9873/10000 (98.73%), error:       460.25604, best error:       400.55188 on epoch:    24, epoch:   27/100, mu: 0.8673315644, learning_rate: 0.0031292995, weight_decay: 0.0001251720

epoch time: 1025.0784912109s, input_fired_time: 14.0257797241, output_fired_time: 12.9618368149, propagate_forward_time: 383.7520751953, propagate_backward_time: 601.2199707031, weight_update_time: 0.8311684728, other_time: 13.1188354492
epoch time: 96.5176544189s, input_fired_time: 2.2696154118, output_fired_time: 0.0000000000, propagate_forward_time: 91.4237136841, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8243255615
validation[          , genome 24452] predictions:    9829/  10000 (98.29%), best:    9873/10000 (98.73%), error:       540.09436, best error:       400.55188 on epoch:    24, epoch:   28/100, mu: 0.8734650016, learning_rate: 0.0029728345, weight_decay: 0.0001189134

epoch time: 1032.6464843750s, input_fired_time: 13.8207511902, output_fired_time: 13.0502948761, propagate_forward_time: 386.8810424805, propagate_backward_time: 605.4585571289, weight_update_time: 0.9405573606, other_time: 13.4358520508
epoch time: 87.9700622559s, input_fired_time: 1.8368251324, output_fired_time: 0.0000000000, propagate_forward_time: 83.4431762695, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6900634766
validation[          , genome 24452] predictions:    9879/  10000 (98.79%), best:    9879/10000 (98.79%), error:       388.78601, best error:       388.78601 on epoch:    29, epoch:   29/100, mu: 0.8792917728, learning_rate: 0.0028241926, weight_decay: 0.0001129677

epoch time: 997.7128906250s, input_fired_time: 13.5699701309, output_fired_time: 12.9231481552, propagate_forward_time: 372.6281433105, propagate_backward_time: 585.7590332031, weight_update_time: 0.9403582215, other_time: 12.8326416016
epoch time: 87.3161926270s, input_fired_time: 1.8206462860, output_fired_time: 0.0000000000, propagate_forward_time: 82.8273696899, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6681747437
validation[          , genome 24452] predictions:    9851/  10000 (98.51%), best:    9879/10000 (98.79%), error:       441.61090, best error:       388.78601 on epoch:    29, epoch:   30/100, mu: 0.8848271966, learning_rate: 0.0026829829, weight_decay: 0.0001073193

epoch time: 1016.6521606445s, input_fired_time: 13.9398794174, output_fired_time: 13.1875085831, propagate_forward_time: 379.3365173340, propagate_backward_time: 597.3023681641, weight_update_time: 0.9081631899, other_time: 12.8858642578
epoch time: 102.2671203613s, input_fired_time: 2.1607139111, output_fired_time: 0.0000000000, propagate_forward_time: 97.2243041992, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8821029663
validation[          , genome 24452] predictions:    9873/  10000 (98.73%), best:    9879/10000 (98.79%), error:       404.49356, best error:       388.78601 on epoch:    29, epoch:   31/100, mu: 0.8900858164, learning_rate: 0.0025488338, weight_decay: 0.0001019534

epoch time: 1034.1975097656s, input_fired_time: 14.2788801193, output_fired_time: 13.2903385162, propagate_forward_time: 387.0738220215, propagate_backward_time: 606.3752441406, weight_update_time: 0.8920017481, other_time: 13.1791992188
epoch time: 90.0554428101s, input_fired_time: 1.8643008471, output_fired_time: 0.0000000000, propagate_forward_time: 85.4986495972, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.6924896240
validation[          , genome 24452] predictions:    9865/  10000 (98.65%), best:    9879/10000 (98.79%), error:       436.09909, best error:       388.78601 on epoch:    29, epoch:   32/100, mu: 0.8950815201, learning_rate: 0.0024213921, weight_decay: 0.0000968557

epoch time: 971.4320678711s, input_fired_time: 13.2367343903, output_fired_time: 12.4633150101, propagate_forward_time: 363.4725036621, propagate_backward_time: 569.8927612305, weight_update_time: 0.8778461814, other_time: 12.3667602539
epoch time: 97.7969131470s, input_fired_time: 1.9483551979, output_fired_time: 0.0000000000, propagate_forward_time: 92.8857192993, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.9628372192
validation[          , genome 24452] predictions:    9851/  10000 (98.51%), best:    9879/10000 (98.79%), error:       445.69211, best error:       388.78601 on epoch:    29, epoch:   33/100, mu: 0.8998274207, learning_rate: 0.0023003225, weight_decay: 0.0000920129

epoch time: 1029.1566162109s, input_fired_time: 14.1249008179, output_fired_time: 13.1069459915, propagate_forward_time: 384.7139282227, propagate_backward_time: 604.0135498047, weight_update_time: 0.8465628028, other_time: 13.1973266602
epoch time: 98.7979354858s, input_fired_time: 2.2263684273, output_fired_time: 0.0000000000, propagate_forward_time: 93.7321319580, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.8394317627
validation[          , genome 24452] predictions:    9869/  10000 (98.69%), best:    9879/10000 (98.79%), error:       416.88507, best error:       388.78601 on epoch:    29, epoch:   34/100, mu: 0.9043360353, learning_rate: 0.0021853063, weight_decay: 0.0000874123

epoch time: 1001.0071411133s, input_fired_time: 13.8662109375, output_fired_time: 12.8398847580, propagate_forward_time: 374.1511840820, propagate_backward_time: 587.2556152344, weight_update_time: 0.8315940499, other_time: 12.8942260742
epoch time: 84.1360092163s, input_fired_time: 1.8853965998, output_fired_time: 0.0000000000, propagate_forward_time: 79.7762527466, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.4743576050
validation[          , genome 24452] predictions:    9873/  10000 (98.73%), best:    9879/10000 (98.79%), error:       405.64938, best error:       388.78601 on epoch:    29, epoch:   35/100, mu: 0.9086192250, learning_rate: 0.0020760410, weight_decay: 0.0000830417

epoch time: 964.9246215820s, input_fired_time: 13.1505460739, output_fired_time: 12.5349826813, propagate_forward_time: 360.7092590332, propagate_backward_time: 566.3201904297, weight_update_time: 0.7997130752, other_time: 12.2095947266
epoch time: 78.1632080078s, input_fired_time: 1.6625372171, output_fired_time: 0.0000000000, propagate_forward_time: 74.2579650879, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2427062988
validation[          , genome 24452] predictions:    9877/  10000 (98.77%), best:    9879/10000 (98.79%), error:       408.65146, best error:       388.78601 on epoch:    29, epoch:   36/100, mu: 0.9126882553, learning_rate: 0.0019722388, weight_decay: 0.0000788896

epoch time: 962.8976440430s, input_fired_time: 13.1082305908, output_fired_time: 12.4761238098, propagate_forward_time: 360.2420959473, propagate_backward_time: 564.8725585938, weight_update_time: 0.8158083558, other_time: 12.1986083984
epoch time: 74.6361770630s, input_fired_time: 1.6311013699, output_fired_time: 0.0000000000, propagate_forward_time: 70.7496643066, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2554092407
validation[          , genome 24452] predictions:    9860/  10000 (98.60%), best:    9879/10000 (98.79%), error:       411.19711, best error:       388.78601 on epoch:    29, epoch:   37/100, mu: 0.9165538549, learning_rate: 0.0018736268, weight_decay: 0.0000749451

epoch time: 951.5339965820s, input_fired_time: 13.0266704559, output_fired_time: 12.2826976776, propagate_forward_time: 355.5631408691, propagate_backward_time: 558.5995483398, weight_update_time: 0.8149670959, other_time: 12.0619506836
epoch time: 74.3297882080s, input_fired_time: 1.6037200689, output_fired_time: 0.0000000000, propagate_forward_time: 70.5018005371, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2242660522
validation[          , genome 24452] predictions:    9868/  10000 (98.68%), best:    9879/10000 (98.79%), error:       418.05316, best error:       388.78601 on epoch:    29, epoch:   38/100, mu: 0.9202261567, learning_rate: 0.0017799455, weight_decay: 0.0000711978

epoch time: 959.7114868164s, input_fired_time: 13.0517492294, output_fired_time: 12.2446670532, propagate_forward_time: 358.8711242676, propagate_backward_time: 563.4568481445, weight_update_time: 0.7839189768, other_time: 12.0870971680
epoch time: 76.8361663818s, input_fired_time: 1.6513783932, output_fired_time: 0.0000000000, propagate_forward_time: 72.9797363281, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2050552368
validation[          , genome 24452] predictions:    9884/  10000 (98.84%), best:    9884/10000 (98.84%), error:       353.14029, best error:       353.14029 on epoch:    39, epoch:   39/100, mu: 0.9237148762, learning_rate: 0.0016909481, weight_decay: 0.0000676379

epoch time: 952.2814331055s, input_fired_time: 12.9881753922, output_fired_time: 12.2362489700, propagate_forward_time: 355.8627319336, propagate_backward_time: 559.0498657227, weight_update_time: 0.7832624316, other_time: 12.1444091797
epoch time: 80.2477111816s, input_fired_time: 1.7434890270, output_fired_time: 0.0000000000, propagate_forward_time: 76.2484283447, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2557907104
validation[          , genome 24452] predictions:    9832/  10000 (98.32%), best:    9884/10000 (98.84%), error:       528.15063, best error:       353.14029 on epoch:    39, epoch:   40/100, mu: 0.9270291328, learning_rate: 0.0016064007, weight_decay: 0.0000642560

epoch time: 965.6807250977s, input_fired_time: 13.1012735367, output_fired_time: 12.4429349899, propagate_forward_time: 361.0173950195, propagate_backward_time: 566.7708740234, weight_update_time: 0.8633028269, other_time: 12.3482666016
epoch time: 76.7836456299s, input_fired_time: 1.6515142918, output_fired_time: 0.0000000000, propagate_forward_time: 72.8001098633, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3320236206
validation[          , genome 24452] predictions:    9877/  10000 (98.77%), best:    9884/10000 (98.84%), error:       378.58694, best error:       353.14029 on epoch:    39, epoch:   41/100, mu: 0.9301776886, learning_rate: 0.0015260807, weight_decay: 0.0000610432

epoch time: 950.5711669922s, input_fired_time: 12.8676652908, output_fired_time: 12.4288196564, propagate_forward_time: 355.3173217773, propagate_backward_time: 557.8565063477, weight_update_time: 0.7993676662, other_time: 12.1008300781
epoch time: 76.7212600708s, input_fired_time: 1.6392190456, output_fired_time: 0.0000000000, propagate_forward_time: 72.8292007446, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2528381348
validation[          , genome 24452] predictions:    9894/  10000 (98.94%), best:    9894/10000 (98.94%), error:       327.59378, best error:       327.59378 on epoch:    42, epoch:   42/100, mu: 0.9331688285, learning_rate: 0.0014497766, weight_decay: 0.0000579911

epoch time: 965.9732666016s, input_fired_time: 13.0943012238, output_fired_time: 12.3972530365, propagate_forward_time: 361.3246154785, propagate_backward_time: 566.8313598633, weight_update_time: 0.8312574625, other_time: 12.3257446289
epoch time: 75.6014633179s, input_fired_time: 1.6233456135, output_fired_time: 0.0000000000, propagate_forward_time: 71.7738723755, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2042465210
validation[          , genome 24452] predictions:    9885/  10000 (98.85%), best:    9894/10000 (98.94%), error:       352.02637, best error:       327.59378 on epoch:    42, epoch:   43/100, mu: 0.9360103607, learning_rate: 0.0013772878, weight_decay: 0.0000550915

epoch time: 961.0527954102s, input_fired_time: 13.0426406860, output_fired_time: 12.2026138306, propagate_forward_time: 360.0000610352, propagate_backward_time: 563.7333984375, weight_update_time: 0.7991882563, other_time: 12.0740356445
epoch time: 74.0358276367s, input_fired_time: 1.6583729982, output_fired_time: 0.0000000000, propagate_forward_time: 70.1985092163, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1789474487
validation[          , genome 24452] predictions:    9896/  10000 (98.96%), best:    9894/10000 (98.94%), error:       345.07541, best error:       327.59378 on epoch:    42, epoch:   44/100, mu: 0.9387098551, learning_rate: 0.0013084234, weight_decay: 0.0000523369

epoch time: 952.5566406250s, input_fired_time: 13.1330842972, output_fired_time: 12.3188276291, propagate_forward_time: 356.2691040039, propagate_backward_time: 558.6303100586, weight_update_time: 0.8003928661, other_time: 12.2053222656
epoch time: 76.3454895020s, input_fired_time: 1.6588702202, output_fired_time: 0.0000000000, propagate_forward_time: 72.4375381470, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2490844727
validation[          , genome 24452] predictions:    9874/  10000 (98.74%), best:    9894/10000 (98.94%), error:       375.26166, best error:       327.59378 on epoch:    42, epoch:   45/100, mu: 0.9412743449, learning_rate: 0.0012430021, weight_decay: 0.0000497201

epoch time: 930.2562866211s, input_fired_time: 12.7835445404, output_fired_time: 11.9439077377, propagate_forward_time: 347.3853149414, propagate_backward_time: 546.3007812500, weight_update_time: 0.7959972620, other_time: 11.8427124023
epoch time: 71.8806381226s, input_fired_time: 1.5804115534, output_fired_time: 0.0000000000, propagate_forward_time: 68.1391906738, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1610336304
validation[          , genome 24452] predictions:    9874/  10000 (98.74%), best:    9894/10000 (98.94%), error:       379.46472, best error:       327.59378 on epoch:    42, epoch:   46/100, mu: 0.9437106252, learning_rate: 0.0011808521, weight_decay: 0.0000472341

epoch time: 917.5081787109s, input_fired_time: 12.6721582413, output_fired_time: 11.8346424103, propagate_forward_time: 342.4345703125, propagate_backward_time: 538.7951660156, weight_update_time: 0.7740026712, other_time: 11.7716064453
epoch time: 72.3417587280s, input_fired_time: 1.5942281485, output_fired_time: 0.0000000000, propagate_forward_time: 68.5837554932, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1637725830
validation[          , genome 24452] predictions:    9887/  10000 (98.87%), best:    9894/10000 (98.94%), error:       355.09708, best error:       327.59378 on epoch:    42, epoch:   47/100, mu: 0.9460250735, learning_rate: 0.0011218095, weight_decay: 0.0000448724

epoch time: 918.3989257813s, input_fired_time: 12.6955299377, output_fired_time: 11.8434410095, propagate_forward_time: 342.6974792480, propagate_backward_time: 539.4315795898, weight_update_time: 0.7760635614, other_time: 11.7308959961
epoch time: 71.6912689209s, input_fired_time: 1.5722911358, output_fired_time: 0.0000000000, propagate_forward_time: 67.9706344604, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1483459473
validation[          , genome 24452] predictions:    9875/  10000 (98.75%), best:    9894/10000 (98.94%), error:       356.89560, best error:       327.59378 on epoch:    42, epoch:   48/100, mu: 0.9482238293, learning_rate: 0.0010657189, weight_decay: 0.0000426288

epoch time: 919.3389282227s, input_fired_time: 12.6474790573, output_fired_time: 11.8691844940, propagate_forward_time: 342.8751220703, propagate_backward_time: 540.1871337891, weight_update_time: 0.7768533826, other_time: 11.7600097656
epoch time: 72.4740829468s, input_fired_time: 1.5883977413, output_fired_time: 0.0000000000, propagate_forward_time: 68.7258911133, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1597976685
validation[          , genome 24452] predictions:    9845/  10000 (98.45%), best:    9894/10000 (98.94%), error:       458.18069, best error:       327.59378 on epoch:    42, epoch:   49/100, mu: 0.9503126144, learning_rate: 0.0010124330, weight_decay: 0.0000404973

epoch time: 901.2756958008s, input_fired_time: 12.4977788925, output_fired_time: 11.6126451492, propagate_forward_time: 335.9104614258, propagate_backward_time: 529.6307373047, weight_update_time: 0.7659156322, other_time: 11.6240234375
epoch time: 70.9602355957s, input_fired_time: 1.5693552494, output_fired_time: 0.0000000000, propagate_forward_time: 67.2589035034, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1319732666
validation[          , genome 24452] predictions:    9886/  10000 (98.86%), best:    9894/10000 (98.94%), error:       355.42642, best error:       327.59378 on epoch:    42, epoch:   50/100, mu: 0.9522969723, learning_rate: 0.0009618113, weight_decay: 0.0000384725

epoch time: 892.0241088867s, input_fired_time: 12.3961267471, output_fired_time: 11.5425014496, propagate_forward_time: 331.2240905762, propagate_backward_time: 525.2698974609, weight_update_time: 0.7633876801, other_time: 11.5915527344
epoch time: 69.7009811401s, input_fired_time: 1.5423282385, output_fired_time: 0.0000000000, propagate_forward_time: 66.0576019287, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1010513306
validation[          , genome 24452] predictions:    9894/  10000 (98.94%), best:    9894/10000 (98.94%), error:       354.69131, best error:       327.59378 on epoch:    42, epoch:   51/100, mu: 0.9541821480, learning_rate: 0.0009137207, weight_decay: 0.0000365488

epoch time: 916.6591186523s, input_fired_time: 12.6372985840, output_fired_time: 11.7867412567, propagate_forward_time: 342.0035705566, propagate_backward_time: 538.5278930664, weight_update_time: 0.7712686658, other_time: 11.7036743164
epoch time: 79.3200759888s, input_fired_time: 1.6589034796, output_fired_time: 0.0000000000, propagate_forward_time: 75.4134521484, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2477188110
validation[          , genome 24452] predictions:    9889/  10000 (98.89%), best:    9894/10000 (98.94%), error:       376.82355, best error:       327.59378 on epoch:    42, epoch:   52/100, mu: 0.9559730291, learning_rate: 0.0008680347, weight_decay: 0.0000347214

epoch time: 959.6339721680s, input_fired_time: 13.1960792542, output_fired_time: 12.4294738770, propagate_forward_time: 358.6264343262, propagate_backward_time: 563.2521972656, weight_update_time: 0.8504641652, other_time: 12.1297607422
epoch time: 73.6399612427s, input_fired_time: 1.6122534275, output_fired_time: 0.0000000000, propagate_forward_time: 69.8595581055, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1681518555
validation[          , genome 24452] predictions:    9884/  10000 (98.84%), best:    9894/10000 (98.94%), error:       358.75491, best error:       327.59378 on epoch:    42, epoch:   53/100, mu: 0.9576743841, learning_rate: 0.0008246329, weight_decay: 0.0000329853

epoch time: 989.7145385742s, input_fired_time: 13.5057506561, output_fired_time: 12.8337717056, propagate_forward_time: 370.1650085449, propagate_backward_time: 580.7088012695, weight_update_time: 0.7974208593, other_time: 12.5011596680
epoch time: 74.6811141968s, input_fired_time: 1.6161744595, output_fired_time: 0.0000000000, propagate_forward_time: 70.8963394165, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1686019897
validation[          , genome 24452] predictions:    9892/  10000 (98.92%), best:    9894/10000 (98.94%), error:       339.98914, best error:       327.59378 on epoch:    42, epoch:   54/100, mu: 0.9592906833, learning_rate: 0.0007834013, weight_decay: 0.0000313361

epoch time: 934.3712158203s, input_fired_time: 12.8176898956, output_fired_time: 12.0354537964, propagate_forward_time: 349.3647155762, propagate_backward_time: 548.2703857422, weight_update_time: 0.7831524611, other_time: 11.8829345703
epoch time: 73.5915603638s, input_fired_time: 1.6153835058, output_fired_time: 0.0000000000, propagate_forward_time: 69.8110885620, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1650848389
validation[          , genome 24452] predictions:    9891/  10000 (98.91%), best:    9894/10000 (98.94%), error:       348.28296, best error:       327.59378 on epoch:    42, epoch:   55/100, mu: 0.9608261585, learning_rate: 0.0007442312, weight_decay: 0.0000297693

epoch time: 955.3228149414s, input_fired_time: 13.1820240021, output_fired_time: 12.2663288116, propagate_forward_time: 357.5794982910, propagate_backward_time: 560.2132568359, weight_update_time: 0.7982494235, other_time: 12.0816650391
epoch time: 76.0132751465s, input_fired_time: 1.6584793329, output_fired_time: 0.0000000000, propagate_forward_time: 72.1711349487, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1836624146
validation[          , genome 24452] predictions:    9899/  10000 (98.99%), best:    9899/10000 (98.99%), error:       320.07077, best error:       320.07077 on epoch:    56, epoch:   56/100, mu: 0.9622848630, learning_rate: 0.0007070196, weight_decay: 0.0000282808

epoch time: 959.7819824219s, input_fired_time: 13.1468658447, output_fired_time: 12.1951971054, propagate_forward_time: 359.0642700195, propagate_backward_time: 563.2197265625, weight_update_time: 0.7833699584, other_time: 12.1559448242
epoch time: 75.4014816284s, input_fired_time: 1.6842970848, output_fired_time: 0.0000000000, propagate_forward_time: 71.5091018677, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2080841064
validation[          , genome 24452] predictions:    9886/  10000 (98.86%), best:    9899/10000 (98.99%), error:       375.93936, best error:       320.07077 on epoch:    56, epoch:   57/100, mu: 0.9636706114, learning_rate: 0.0006716687, weight_decay: 0.0000268668

epoch time: 958.3618774414s, input_fired_time: 13.0914573669, output_fired_time: 12.2725362778, propagate_forward_time: 358.6761169434, propagate_backward_time: 562.1399536133, weight_update_time: 0.7822319865, other_time: 12.1818237305
epoch time: 73.4204406738s, input_fired_time: 1.6165018082, output_fired_time: 0.0000000000, propagate_forward_time: 69.6264801025, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1774597168
validation[          , genome 24452] predictions:    9906/  10000 (99.06%), best:    9906/10000 (99.06%), error:       305.10101, best error:       305.10101 on epoch:    58, epoch:   58/100, mu: 0.9649870992, learning_rate: 0.0006380852, weight_decay: 0.0000255234

epoch time: 901.6541137695s, input_fired_time: 12.5527629852, output_fired_time: 11.5820579529, propagate_forward_time: 336.1252746582, propagate_backward_time: 529.7181396484, weight_update_time: 0.7668251395, other_time: 11.6759033203
epoch time: 70.2203292847s, input_fired_time: 1.5645461082, output_fired_time: 0.0000000000, propagate_forward_time: 66.5404663086, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1153182983
validation[          , genome 24452] predictions:    9895/  10000 (98.95%), best:    9906/10000 (99.06%), error:       337.56155, best error:       305.10101 on epoch:    58, epoch:   59/100, mu: 0.9662377238, learning_rate: 0.0006061810, weight_decay: 0.0000242472

epoch time: 933.6807250977s, input_fired_time: 12.8451795578, output_fired_time: 12.0019111633, propagate_forward_time: 349.0569458008, propagate_backward_time: 547.9257812500, weight_update_time: 0.7825304270, other_time: 11.8509521484
epoch time: 72.2120361328s, input_fired_time: 1.5919487476, output_fired_time: 0.0000000000, propagate_forward_time: 68.4762954712, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1437911987
validation[          , genome 24452] predictions:    9880/  10000 (98.80%), best:    9906/10000 (99.06%), error:       372.11411, best error:       305.10101 on epoch:    58, epoch:   60/100, mu: 0.9674258232, learning_rate: 0.0005758719, weight_decay: 0.0000230349

epoch time: 920.4392700195s, input_fired_time: 12.7310113907, output_fired_time: 11.8482761383, propagate_forward_time: 343.7575073242, propagate_backward_time: 540.3220825195, weight_update_time: 0.7778895497, other_time: 11.7803955078
epoch time: 73.5289230347s, input_fired_time: 1.6090013981, output_fired_time: 0.0000000000, propagate_forward_time: 69.7602615356, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1596603394
validation[          , genome 24452] predictions:    9857/  10000 (98.57%), best:    9906/10000 (99.06%), error:       428.85443, best error:       305.10101 on epoch:    58, epoch:   61/100, mu: 0.9685545564, learning_rate: 0.0005470783, weight_decay: 0.0000218831

epoch time: 925.8227539063s, input_fired_time: 12.8098917007, output_fired_time: 11.8951139450, propagate_forward_time: 345.6056213379, propagate_backward_time: 543.6708374023, weight_update_time: 0.7773922682, other_time: 11.8412475586
epoch time: 71.3682708740s, input_fired_time: 1.5828263760, output_fired_time: 0.0000000000, propagate_forward_time: 67.6340408325, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1514053345
validation[          , genome 24452] predictions:    9901/  10000 (99.01%), best:    9906/10000 (99.06%), error:       321.66013, best error:       305.10101 on epoch:    58, epoch:   62/100, mu: 0.9696268439, learning_rate: 0.0005197244, weight_decay: 0.0000207890

epoch time: 874.2514038086s, input_fired_time: 12.2996358871, output_fired_time: 11.2565927505, propagate_forward_time: 324.0214538574, propagate_backward_time: 515.1751708984, weight_update_time: 0.7494850159, other_time: 11.4985351563
epoch time: 65.9766464233s, input_fired_time: 1.4909372330, output_fired_time: 0.0000000000, propagate_forward_time: 62.4380989075, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0476112366
validation[          , genome 24452] predictions:    9910/  10000 (99.10%), best:    9910/10000 (99.10%), error:       304.16736, best error:       304.16736 on epoch:    63, epoch:   63/100, mu: 0.9706454873, learning_rate: 0.0004937382, weight_decay: 0.0000197495

epoch time: 867.2445068359s, input_fired_time: 12.2498960495, output_fired_time: 11.2386226654, propagate_forward_time: 321.4046936035, propagate_backward_time: 510.9092102051, weight_update_time: 0.7496451735, other_time: 11.4421081543
epoch time: 70.7590866089s, input_fired_time: 1.5743432045, output_fired_time: 0.0000000000, propagate_forward_time: 67.0777740479, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1069717407
validation[          , genome 24452] predictions:    9900/  10000 (99.00%), best:    9910/10000 (99.10%), error:       336.63953, best error:       304.16736 on epoch:    63, epoch:   64/100, mu: 0.9716132283, learning_rate: 0.0004690512, weight_decay: 0.0000187621

epoch time: 888.0373535156s, input_fired_time: 12.4493827820, output_fired_time: 11.4074172974, propagate_forward_time: 330.8370056152, propagate_backward_time: 521.7601928711, weight_update_time: 0.7615182996, other_time: 11.5833129883
epoch time: 67.7862472534s, input_fired_time: 1.5223985910, output_fired_time: 0.0000000000, propagate_forward_time: 64.1633682251, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1004791260
validation[          , genome 24452] predictions:    9913/  10000 (99.13%), best:    9913/10000 (99.13%), error:       303.69006, best error:       303.69006 on epoch:    65, epoch:   65/100, mu: 0.9725325704, learning_rate: 0.0004455987, weight_decay: 0.0000178240

epoch time: 890.5959472656s, input_fired_time: 12.4596519470, output_fired_time: 11.4457778931, propagate_forward_time: 330.7289428711, propagate_backward_time: 524.3962402344, weight_update_time: 0.7610689998, other_time: 11.5653076172
epoch time: 71.7874603271s, input_fired_time: 1.5886261463, output_fired_time: 0.0000000000, propagate_forward_time: 68.0594406128, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1393966675
validation[          , genome 24452] predictions:    9902/  10000 (99.02%), best:    9913/10000 (99.13%), error:       311.69345, best error:       303.69006 on epoch:    65, epoch:   66/100, mu: 0.9734059572, learning_rate: 0.0004233187, weight_decay: 0.0000169328

epoch time: 905.6091918945s, input_fired_time: 12.6121768951, output_fired_time: 11.6466817856, propagate_forward_time: 337.9623413086, propagate_backward_time: 531.7015380859, weight_update_time: 0.7673930526, other_time: 11.6864624023
epoch time: 72.4740676880s, input_fired_time: 1.5999656916, output_fired_time: 0.0000000000, propagate_forward_time: 68.7230987549, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1510009766
validation[          , genome 24452] predictions:    9893/  10000 (98.93%), best:    9913/10000 (99.13%), error:       330.09033, best error:       303.69006 on epoch:    65, epoch:   67/100, mu: 0.9742356539, learning_rate: 0.0004021528, weight_decay: 0.0000160861

epoch time: 915.5259399414s, input_fired_time: 12.6934671402, output_fired_time: 11.7684106827, propagate_forward_time: 341.4755554199, propagate_backward_time: 537.8701782227, weight_update_time: 0.7705375552, other_time: 11.7183227539
epoch time: 72.1285018921s, input_fired_time: 1.5948208570, output_fired_time: 0.0000000000, propagate_forward_time: 68.3991317749, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1345520020
validation[          , genome 24452] predictions:    9902/  10000 (99.02%), best:    9913/10000 (99.13%), error:       332.33075, best error:       303.69006 on epoch:    65, epoch:   68/100, mu: 0.9750238657, learning_rate: 0.0003820452, weight_decay: 0.0000152818

epoch time: 939.3871459961s, input_fired_time: 12.9959430695, output_fired_time: 12.0047855377, propagate_forward_time: 350.8726501465, propagate_backward_time: 551.6028442383, weight_update_time: 0.7802470326, other_time: 11.9109497070
epoch time: 72.6894989014s, input_fired_time: 1.6047949791, output_fired_time: 0.0000000000, propagate_forward_time: 68.9444122314, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1402893066
validation[          , genome 24452] predictions:    9887/  10000 (98.87%), best:    9913/10000 (99.13%), error:       333.28094, best error:       303.69006 on epoch:    65, epoch:   69/100, mu: 0.9757726789, learning_rate: 0.0003629429, weight_decay: 0.0000145177

epoch time: 890.1383666992s, input_fired_time: 12.4596023560, output_fired_time: 11.4188032150, propagate_forward_time: 331.0162353516, propagate_backward_time: 523.7192382813, weight_update_time: 0.7577517629, other_time: 11.5244750977
epoch time: 67.3210906982s, input_fired_time: 1.5207909346, output_fired_time: 0.0000000000, propagate_forward_time: 63.7243232727, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0759773254
validation[          , genome 24452] predictions:    9906/  10000 (99.06%), best:    9906/10000 (99.06%), error:       299.79620, best error:       299.79620 on epoch:    70, epoch:   70/100, mu: 0.9764840603, learning_rate: 0.0003447958, weight_decay: 0.0000137918

epoch time: 828.5076904297s, input_fired_time: 11.9069395065, output_fired_time: 10.7569808960, propagate_forward_time: 305.3049621582, propagate_backward_time: 489.3372497559, weight_update_time: 0.7274760008, other_time: 11.2015991211
epoch time: 62.9175796509s, input_fired_time: 1.4403600693, output_fired_time: 0.0000000000, propagate_forward_time: 59.4641342163, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0130844116
validation[          , genome 24452] predictions:    9898/  10000 (98.98%), best:    9906/10000 (99.06%), error:       321.67242, best error:       299.79620 on epoch:    70, epoch:   71/100, mu: 0.9771598577, learning_rate: 0.0003275560, weight_decay: 0.0000131022

epoch time: 782.3614501953s, input_fired_time: 11.5420970917, output_fired_time: 10.1844081879, propagate_forward_time: 286.9955139160, propagate_backward_time: 462.9234924316, weight_update_time: 0.6873599291, other_time: 10.7159423828
epoch time: 61.5298500061s, input_fired_time: 1.4240894318, output_fired_time: 0.0000000000, propagate_forward_time: 58.1268424988, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9789161682
validation[          , genome 24452] predictions:    9900/  10000 (99.00%), best:    9906/10000 (99.06%), error:       309.87607, best error:       299.79620 on epoch:    70, epoch:   72/100, mu: 0.9778018594, learning_rate: 0.0003111782, weight_decay: 0.0000124471

epoch time: 752.9237060547s, input_fired_time: 11.2936019897, output_fired_time: 9.8714828491, propagate_forward_time: 275.7936096191, propagate_backward_time: 445.3534851074, weight_update_time: 0.6804271936, other_time: 10.6115722656
epoch time: 61.9042205811s, input_fired_time: 1.4253902435, output_fired_time: 0.0000000000, propagate_forward_time: 58.4997406006, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9790878296
validation[          , genome 24452] predictions:    9905/  10000 (99.05%), best:    9906/10000 (99.06%), error:       325.76794, best error:       299.79620 on epoch:    70, epoch:   73/100, mu: 0.9784117937, learning_rate: 0.0002956192, weight_decay: 0.0000118248

epoch time: 847.1542358398s, input_fired_time: 12.1193208694, output_fired_time: 10.9573459625, propagate_forward_time: 313.6323242188, propagate_backward_time: 499.2257995605, weight_update_time: 0.7290133834, other_time: 11.2194519043
epoch time: 69.1175003052s, input_fired_time: 1.5506882668, output_fired_time: 0.0000000000, propagate_forward_time: 65.4764404297, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0903701782
validation[          , genome 24452] predictions:    9878/  10000 (98.78%), best:    9906/10000 (99.06%), error:       371.67407, best error:       299.79620 on epoch:    70, epoch:   74/100, mu: 0.9789912105, learning_rate: 0.0002808383, weight_decay: 0.0000112335

epoch time: 918.9541015625s, input_fired_time: 12.7597494125, output_fired_time: 11.8034057617, propagate_forward_time: 342.7130126953, propagate_backward_time: 539.8818969727, weight_update_time: 0.7742861509, other_time: 11.7960205078
epoch time: 76.1322021484s, input_fired_time: 1.6426696777, output_fired_time: 0.0000000000, propagate_forward_time: 72.1747436523, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3147888184
validation[          , genome 24452] predictions:    9895/  10000 (98.95%), best:    9906/10000 (99.06%), error:       312.36282, best error:       299.79620 on epoch:    70, epoch:   75/100, mu: 0.9795416594, learning_rate: 0.0002667964, weight_decay: 0.0000106719

epoch time: 969.8551635742s, input_fired_time: 13.3221006393, output_fired_time: 12.5509958267, propagate_forward_time: 362.6397705078, propagate_backward_time: 568.9976806641, weight_update_time: 0.7985847592, other_time: 12.3446044922
epoch time: 82.4428176880s, input_fired_time: 1.7651337385, output_fired_time: 0.0000000000, propagate_forward_time: 78.1667938232, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5108871460
validation[          , genome 24452] predictions:    9904/  10000 (99.04%), best:    9906/10000 (99.06%), error:       303.71906, best error:       299.79620 on epoch:    70, epoch:   76/100, mu: 0.9800645709, learning_rate: 0.0002534565, weight_decay: 0.0000101383

epoch time: 984.9506835938s, input_fired_time: 13.6624956131, output_fired_time: 12.4920082092, propagate_forward_time: 368.5187683105, propagate_backward_time: 577.8905029297, weight_update_time: 0.7977318764, other_time: 12.3869628906
epoch time: 73.7707366943s, input_fired_time: 1.6275339127, output_fired_time: 0.0000000000, propagate_forward_time: 69.9633255005, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1798782349
validation[          , genome 24452] predictions:    9905/  10000 (99.05%), best:    9906/10000 (99.06%), error:       305.10022, best error:       299.79620 on epoch:    70, epoch:   77/100, mu: 0.9805613160, learning_rate: 0.0002407837, weight_decay: 0.0000096314

epoch time: 939.0885620117s, input_fired_time: 12.9565286636, output_fired_time: 11.9849090576, propagate_forward_time: 351.2761535645, propagate_backward_time: 550.8501586914, weight_update_time: 0.7822165489, other_time: 12.0208129883
epoch time: 74.1132354736s, input_fired_time: 1.6533212662, output_fired_time: 0.0000000000, propagate_forward_time: 70.2648620605, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1950531006
validation[          , genome 24452] predictions:    9898/  10000 (98.98%), best:    9906/10000 (99.06%), error:       313.11676, best error:       299.79620 on epoch:    70, epoch:   78/100, mu: 0.9810332656, learning_rate: 0.0002287445, weight_decay: 0.0000091498

epoch time: 969.9271240234s, input_fired_time: 13.5506935120, output_fired_time: 12.3561401367, propagate_forward_time: 362.1390991211, propagate_backward_time: 569.5462646484, weight_update_time: 0.7833545804, other_time: 12.3348999023
epoch time: 82.9439315796s, input_fired_time: 1.8151723146, output_fired_time: 0.0000000000, propagate_forward_time: 78.7774200439, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.3513412476
validation[          , genome 24452] predictions:    9906/  10000 (99.06%), best:    9906/10000 (99.06%), error:       308.52905, best error:       299.79620 on epoch:    70, epoch:   79/100, mu: 0.9814816117, learning_rate: 0.0002173073, weight_decay: 0.0000086923

epoch time: 1047.8659667969s, input_fired_time: 14.7260065079, output_fired_time: 13.3899898529, propagate_forward_time: 392.0456542969, propagate_backward_time: 614.5758666992, weight_update_time: 0.8584131598, other_time: 13.1284790039
epoch time: 101.4836502075s, input_fired_time: 2.4922060966, output_fired_time: 0.0000000000, propagate_forward_time: 95.9011535645, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 3.0902938843
validation[          , genome 24452] predictions:    9904/  10000 (99.04%), best:    9906/10000 (99.06%), error:       302.35187, best error:       299.79620 on epoch:    70, epoch:   80/100, mu: 0.9819075465, learning_rate: 0.0002064419, weight_decay: 0.0000082577

epoch time: 1023.3593139648s, input_fired_time: 14.2152051926, output_fired_time: 12.7128467560, propagate_forward_time: 382.3354187012, propagate_backward_time: 601.0997314453, weight_update_time: 0.8921916485, other_time: 12.9960937500
epoch time: 84.8180007935s, input_fired_time: 1.8454833031, output_fired_time: 0.0000000000, propagate_forward_time: 80.3961639404, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.5763549805
validation[          , genome 24452] predictions:    9908/  10000 (99.08%), best:    9906/10000 (99.06%), error:       300.48349, best error:       299.79620 on epoch:    70, epoch:   81/100, mu: 0.9823121428, learning_rate: 0.0001961198, weight_decay: 0.0000078448

epoch time: 1030.9428710938s, input_fired_time: 14.5788850784, output_fired_time: 13.2846269608, propagate_forward_time: 385.7284851074, propagate_backward_time: 604.3249511719, weight_update_time: 0.8784307241, other_time: 13.0260009766
epoch time: 79.0297164917s, input_fired_time: 1.8075062037, output_fired_time: 0.0000000000, propagate_forward_time: 74.9376220703, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.2845916748
validation[          , genome 24452] predictions:    9907/  10000 (99.07%), best:    9906/10000 (99.06%), error:       311.28738, best error:       299.79620 on epoch:    70, epoch:   82/100, mu: 0.9826965332, learning_rate: 0.0001863138, weight_decay: 0.0000074526

epoch time: 881.1193237305s, input_fired_time: 12.4398069382, output_fired_time: 11.3273439407, propagate_forward_time: 327.6279296875, propagate_backward_time: 518.2095336914, weight_update_time: 0.7539531589, other_time: 11.5147094727
epoch time: 67.0693054199s, input_fired_time: 1.5132085085, output_fired_time: 0.0000000000, propagate_forward_time: 63.4809989929, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0750999451
validation[          , genome 24452] predictions:    9901/  10000 (99.01%), best:    9906/10000 (99.06%), error:       310.68204, best error:       299.79620 on epoch:    70, epoch:   83/100, mu: 0.9830617309, learning_rate: 0.0001769981, weight_decay: 0.0000070799

epoch time: 817.0171508789s, input_fired_time: 11.8440790176, output_fired_time: 10.5638446808, propagate_forward_time: 301.4833984375, propagate_backward_time: 482.0902709961, weight_update_time: 0.7120629549, other_time: 11.0355834961
epoch time: 58.6790618896s, input_fired_time: 1.3756854534, output_fired_time: 0.0000000000, propagate_forward_time: 55.3360099792, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9673652649
validation[          , genome 24452] predictions:    9902/  10000 (99.02%), best:    9906/10000 (99.06%), error:       308.95419, best error:       299.79620 on epoch:    70, epoch:   84/100, mu: 0.9834086299, learning_rate: 0.0001681482, weight_decay: 0.0000067259

epoch time: 818.1647949219s, input_fired_time: 11.8538560867, output_fired_time: 10.5680246353, propagate_forward_time: 301.5299682617, propagate_backward_time: 483.1041870117, weight_update_time: 0.7199957967, other_time: 11.1087036133
epoch time: 66.5170059204s, input_fired_time: 1.5069644451, output_fired_time: 0.0000000000, propagate_forward_time: 62.9509544373, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0590858459
validation[          , genome 24452] predictions:    9907/  10000 (99.07%), best:    9906/10000 (99.06%), error:       313.84418, best error:       299.79620 on epoch:    70, epoch:   85/100, mu: 0.9837381840, learning_rate: 0.0001597408, weight_decay: 0.0000063896

epoch time: 864.4899902344s, input_fired_time: 12.2674446106, output_fired_time: 11.1657285690, propagate_forward_time: 320.2344055176, propagate_backward_time: 509.4546203613, weight_update_time: 0.7420135140, other_time: 11.3677673340
epoch time: 70.0741348267s, input_fired_time: 1.5737639666, output_fired_time: 0.0000000000, propagate_forward_time: 66.3941268921, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1062469482
validation[          , genome 24452] predictions:    9906/  10000 (99.06%), best:    9906/10000 (99.06%), error:       313.18509, best error:       299.79620 on epoch:    70, epoch:   86/100, mu: 0.9840512872, learning_rate: 0.0001517538, weight_decay: 0.0000060702

epoch time: 899.2276000977s, input_fired_time: 12.5794429779, output_fired_time: 11.5528469086, propagate_forward_time: 335.1811523438, propagate_backward_time: 528.2525634766, weight_update_time: 0.7640593648, other_time: 11.6615600586
epoch time: 69.6599655151s, input_fired_time: 1.5585749149, output_fired_time: 0.0000000000, propagate_forward_time: 65.9882659912, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1131210327
validation[          , genome 24452] predictions:    9911/  10000 (99.11%), best:    9911/10000 (99.11%), error:       299.64520, best error:       299.64520 on epoch:    87, epoch:   87/100, mu: 0.9843487144, learning_rate: 0.0001441661, weight_decay: 0.0000057666

epoch time: 906.3299560547s, input_fired_time: 12.6369028091, output_fired_time: 11.6370964050, propagate_forward_time: 337.9278259277, propagate_backward_time: 532.4345092773, weight_update_time: 0.7663739920, other_time: 11.6936645508
epoch time: 69.2476043701s, input_fired_time: 1.5574008226, output_fired_time: 0.0000000000, propagate_forward_time: 65.5876770020, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1025238037
validation[          , genome 24452] predictions:    9900/  10000 (99.00%), best:    9911/10000 (99.11%), error:       332.08234, best error:       299.64520 on epoch:    87, epoch:   88/100, mu: 0.9846313000, learning_rate: 0.0001369578, weight_decay: 0.0000054783

epoch time: 845.8448486328s, input_fired_time: 12.1304521561, output_fired_time: 10.8328781128, propagate_forward_time: 312.8962097168, propagate_backward_time: 498.7031860352, weight_update_time: 0.7334488630, other_time: 11.2821350098
epoch time: 60.7626953125s, input_fired_time: 1.4175058603, output_fired_time: 0.0000000000, propagate_forward_time: 57.3629646301, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9822235107
validation[          , genome 24452] predictions:    9912/  10000 (99.12%), best:    9912/10000 (99.12%), error:       298.05182, best error:       298.05182 on epoch:    89, epoch:   89/100, mu: 0.9848997593, learning_rate: 0.0001301099, weight_decay: 0.0000052044

epoch time: 809.9978637695s, input_fired_time: 11.7853021622, output_fired_time: 10.4968614578, propagate_forward_time: 297.9142761230, propagate_backward_time: 478.8229980469, weight_update_time: 0.7101923227, other_time: 10.9784240723
epoch time: 65.2400436401s, input_fired_time: 1.4960805178, output_fired_time: 0.0000000000, propagate_forward_time: 61.6924896240, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0514717102
validation[          , genome 24452] predictions:    9905/  10000 (99.05%), best:    9905/10000 (99.05%), error:       294.06354, best error:       294.06354 on epoch:    90, epoch:   90/100, mu: 0.9851547480, learning_rate: 0.0001236044, weight_decay: 0.0000049442

epoch time: 783.9074096680s, input_fired_time: 11.6000452042, output_fired_time: 10.1762113571, propagate_forward_time: 289.4253845215, propagate_backward_time: 461.8845520020, weight_update_time: 0.6927941442, other_time: 10.8212280273
epoch time: 57.1343994141s, input_fired_time: 1.3537837267, output_fired_time: 0.0000000000, propagate_forward_time: 53.8862419128, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8943748474
validation[          , genome 24452] predictions:    9910/  10000 (99.10%), best:    9905/10000 (99.05%), error:       303.30042, best error:       294.06354 on epoch:    90, epoch:   91/100, mu: 0.9853969812, learning_rate: 0.0001174242, weight_decay: 0.0000046970

epoch time: 684.6694335938s, input_fired_time: 10.7363405228, output_fired_time: 9.0157747269, propagate_forward_time: 247.9226684570, propagate_backward_time: 406.9630737305, weight_update_time: 0.6307199597, other_time: 10.0316162109
epoch time: 53.4500427246s, input_fired_time: 1.2936983109, output_fired_time: 0.0000000000, propagate_forward_time: 50.2886085510, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.8677368164
validation[          , genome 24452] predictions:    9901/  10000 (99.01%), best:    9905/10000 (99.05%), error:       329.84503, best error:       294.06354 on epoch:    90, epoch:   92/100, mu: 0.9856271148, learning_rate: 0.0001115530, weight_decay: 0.0000044621

epoch time: 712.0595092773s, input_fired_time: 10.9811162949, output_fired_time: 9.3429822922, propagate_forward_time: 259.6359863281, propagate_backward_time: 421.8370666504, weight_update_time: 0.6469144821, other_time: 10.2623596191
epoch time: 57.2165222168s, input_fired_time: 1.3503940105, output_fired_time: 0.0000000000, propagate_forward_time: 53.9524421692, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9136848450
validation[          , genome 24452] predictions:    9908/  10000 (99.08%), best:    9905/10000 (99.05%), error:       309.05698, best error:       294.06354 on epoch:    90, epoch:   93/100, mu: 0.9858457446, learning_rate: 0.0001059753, weight_decay: 0.0000042390

epoch time: 774.1051025391s, input_fired_time: 11.4619569778, output_fired_time: 10.1207084656, propagate_forward_time: 283.0375061035, propagate_backward_time: 458.7600097656, weight_update_time: 0.6862602234, other_time: 10.7248840332
epoch time: 60.7306709290s, input_fired_time: 1.4113630056, output_fired_time: 0.0000000000, propagate_forward_time: 57.3642692566, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9550399780
validation[          , genome 24452] predictions:    9908/  10000 (99.08%), best:    9905/10000 (99.05%), error:       301.18198, best error:       294.06354 on epoch:    90, epoch:   94/100, mu: 0.9860534668, learning_rate: 0.0001006766, weight_decay: 0.0000040271

epoch time: 789.7258300781s, input_fired_time: 11.6448640823, output_fired_time: 10.2348003387, propagate_forward_time: 291.5860595703, propagate_backward_time: 465.4069519043, weight_update_time: 0.6988778114, other_time: 10.8531799316
epoch time: 63.0632781982s, input_fired_time: 1.4525306225, output_fired_time: 0.0000000000, propagate_forward_time: 59.6330223083, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9777259827
validation[          , genome 24452] predictions:    9907/  10000 (99.07%), best:    9905/10000 (99.05%), error:       308.39233, best error:       294.06354 on epoch:    90, epoch:   95/100, mu: 0.9862508178, learning_rate: 0.0000956427, weight_decay: 0.0000038257

epoch time: 749.9161987305s, input_fired_time: 11.2941808701, output_fired_time: 9.8621902466, propagate_forward_time: 274.5393066406, propagate_backward_time: 443.6734008789, weight_update_time: 0.6725029945, other_time: 10.5471191406
epoch time: 59.7540206909s, input_fired_time: 1.3970450163, output_fired_time: 0.0000000000, propagate_forward_time: 56.3997383118, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9572372437
validation[          , genome 24452] predictions:    9908/  10000 (99.08%), best:    9905/10000 (99.05%), error:       303.12344, best error:       294.06354 on epoch:    90, epoch:   96/100, mu: 0.9864382744, learning_rate: 0.0000908606, weight_decay: 0.0000036344

epoch time: 820.4589233398s, input_fired_time: 11.8979282379, output_fired_time: 10.5761127472, propagate_forward_time: 302.7772521973, propagate_backward_time: 484.1511535645, weight_update_time: 0.7132583857, other_time: 11.0564575195
epoch time: 67.7419433594s, input_fired_time: 1.5316400528, output_fired_time: 0.0000000000, propagate_forward_time: 64.1160507202, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0942535400
validation[          , genome 24452] predictions:    9908/  10000 (99.08%), best:    9905/10000 (99.05%), error:       298.89545, best error:       294.06354 on epoch:    90, epoch:   97/100, mu: 0.9866163731, learning_rate: 0.0000863176, weight_decay: 0.0000034527

epoch time: 871.8000488281s, input_fired_time: 12.3407144547, output_fired_time: 11.1857461929, propagate_forward_time: 323.2517700195, propagate_backward_time: 513.5352172852, weight_update_time: 0.7512103319, other_time: 11.4866333008
epoch time: 66.2536392212s, input_fired_time: 1.5043941736, output_fired_time: 0.0000000000, propagate_forward_time: 62.6682014465, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0810432434
validation[          , genome 24452] predictions:    9899/  10000 (98.99%), best:    9905/10000 (99.05%), error:       312.36282, best error:       294.06354 on epoch:    90, epoch:   98/100, mu: 0.9867855310, learning_rate: 0.0000820017, weight_decay: 0.0000032801

epoch time: 848.2554321289s, input_fired_time: 12.1436252594, output_fired_time: 10.8667039871, propagate_forward_time: 314.1613159180, propagate_backward_time: 499.7172546387, weight_update_time: 0.7420518398, other_time: 11.3665466309
epoch time: 69.0810012817s, input_fired_time: 1.5532630682, output_fired_time: 0.0000000000, propagate_forward_time: 65.4277114868, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.1000289917
validation[          , genome 24452] predictions:    9904/  10000 (99.04%), best:    9905/10000 (99.05%), error:       303.46814, best error:       294.06354 on epoch:    90, epoch:   99/100, mu: 0.9869462252, learning_rate: 0.0000779016, weight_decay: 0.0000031161

epoch time: 848.4552001953s, input_fired_time: 12.1423082352, output_fired_time: 10.9039077759, propagate_forward_time: 313.4712829590, propagate_backward_time: 500.6151733398, weight_update_time: 0.7360755205, other_time: 11.3224792480
epoch time: 64.5250167847s, input_fired_time: 1.4780423641, output_fired_time: 0.0000000000, propagate_forward_time: 61.0080184937, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 2.0389556885
validation[          , genome 24452] predictions:    9907/  10000 (99.07%), best:    9905/10000 (99.05%), error:       298.75452, best error:       294.06354 on epoch:    90, epoch:  100/100, mu: 0.9870989323, learning_rate: 0.0000740065, weight_decay: 0.0000029603

evaluating best weights on full training data.
evaluting training set with running mean/variance:
epoch time: 320.4227905273s, input_fired_time: 7.3639845848, output_fired_time: 0.0000000000, propagate_forward_time: 302.8746032715, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 10.1842041016
best training[          , genome 24452] predictions:   50000/  50000 (100.00%), best:    9905/10000 (99.05%), error:        97.82541, best error:       294.06354 on epoch:    90, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
evaluating best weights on test data.
evaluting test set with running mean/variance:
epoch time: 62.8571929932s, input_fired_time: 1.4400788546, output_fired_time: 0.0000000000, propagate_forward_time: 59.4193649292, propagate_backward_time: 0.0000000000, weight_update_time: 0.0000000000, other_time: 1.9977493286
   testing[          , genome 24452] predictions:    9923/  10000 (99.23%), best:    9905/10000 (99.05%), error:       258.85291, best error:       294.06354 on epoch:    90, epoch:  101/100, mu: 0.9872440100, learning_rate: 0.0000703062, weight_decay: 0.0000028122
backpropagation finished successfully!
16:54:52 (15748): called boinc_finish(0)

</stderr_txt>
]]>